About
Candle-based LLM inference worker with NVIDIA CUDA acceleration
Platform Support
Platforms
linuxwindows
Requirements
- •gcc
- •cuda
Features
✓
Supports gguf✓
Supports safetensorsrbee is a free, open-source AI orchestration tool that lets you install workers directly to your system with one click.