About
Candle-based LLM inference worker with AMD ROCm acceleration
Platform Support
Platforms
linux
Requirements
- •gcc
- •rocm
Features
✓
Supports gguf✓
Supports safetensorsrbee is a free, open-source AI orchestration tool that lets you install workers directly to your system with one click.