## 🍋 Lemonade: Refreshingly fast local AI
Want your app featured here? Just submit a marketplace PR!
## Supported Platforms | Platform | Build | |----------|-------| | [](https://lemonade-server.ai/docs/guide/install/arch/) | [](https://github.com/lemonade-sdk/lemonade/actions/workflows/linux_distro_builds.yml) | | [](https://lemonade-server.ai/docs/guide/install/debian/) | [](https://github.com/lemonade-sdk/lemonade/actions/workflows/linux_distro_builds.yml) | | [](https://lemonade-server.ai/docs/guide/install/docker/) | [](https://github.com/lemonade-sdk/lemonade/actions/workflows/build-and-push-container.yml) | | [](https://lemonade-server.ai/docs/guide/install/fedora/) | [](https://github.com/lemonade-sdk/lemonade/actions/workflows/cpp_server_build_test_release.yml) | | [](https://github.com/lemonade-sdk/lemonade/releases) | [](https://github.com/lemonade-sdk/lemonade/actions/workflows/cpp_server_build_test_release.yml) | | [](https://snapcraft.io/lemonade-server) | [](https://github.com/lemonade-sdk/lemonade-server-snap/actions/workflows/snap-build.yaml) | | [](https://lemonade-server.ai/docs/guide/install/ubuntu/) | [](https://github.com/lemonade-sdk/lemonade/actions/workflows/launchpad-ppa.yml) | | [](https://github.com/lemonade-sdk/lemonade/releases/latest/download/lemonade.msi) | [](https://github.com/lemonade-sdk/lemonade/actions/workflows/cpp_server_build_test_release.yml) | ## Using the CLI To run and chat with Gemma: ``` lemonade run Gemma-4-E2B-it-GGUF ``` To code with Lemonade models: ``` lemonade launch claude ``` Multi-modality: ``` # image gen lemonade run SDXL-Turbo # speech gen lemonade run kokoro-v1 # transcription lemonade run Whisper-Large-v3-Turbo ``` To see available models and download them: ``` lemonade list lemonade pull Gemma-4-E2B-it-GGUF ``` To manage model aliases for environment-independent naming and active-standby failover: ``` lemonade alias add production-llm Gemma-4-E2B-it-GGUF lemonade alias list # Instant active-standby failover to a different model target lemonade alias add production-llm Qwen3-0.6B-GGUF lemonade alias remove production-llm ``` To see the backends available on your PC: ``` lemonade backends ``` For hybrid setups, Lemonade can also route to any OpenAI-compatible cloud provider (Fireworks, OpenAI, OpenRouter, Together, …) alongside local models — see [Cloud Offload](./docs/guide/configuration/cloud.md). *(Experimental.)* ## Model Library
Lemonade supports a wide variety of LLMs (**GGUF**, **FLM**, and **ONNX**), whisper, stable diffusion, etc. models across CPU, GPU, and NPU.
Use `lemonade pull` or the built-in **Model Manager** to download models. Custom GGUF/ONNX models can be pulled from Hugging Face or ModelScope, with their source retained for future updates.
**[Browse all built-in models →](https://lemonade-server.ai/models.html)**
| Modality | Engine | Backend | Device | OS |
|---|---|---|---|---|
| Text generation | llamacpp |
system |
x86_64/ARM64 CPU, GPU |
Linux |
metal |
Apple Silicon GPU | macOS | ||
cuda |
NVIDIA GPUs (Turing or newer)** | Windows, Linux | ||
vulkan |
x86_64 CPU, AMD iGPU, AMD dGPU; ARM64 CPU/GPU (Linux) |
Windows, Linux | ||
rocm |
AMD GPUs supported by ROCm | Windows, Linux | ||
cpu |
x86_64 CPU; ARM64 CPU (Linux) |
Windows, Linux | ||
llamacpp-hrx (experimental) |
hrx |
AMD GPUs (gfx1100, gfx1151) | Linux | |
flm |
npu |
XDNA2 NPU | Windows, Linux | |
ryzenai-llm |
npu |
XDNA2 NPU | Windows | |
vllm (experimental) |
rocm |
Strix Halo iGPU (gfx1151) | Linux | |
ds4 (experimental) |
rocm |
Prebuilt ds4 for AMD Strix Halo | Linux | |
| Speech-to-text | whispercpp |
npu |
XDNA2 NPU | Windows |
metal |
Apple Silicon GPU | macOS | ||
vulkan |
x86_64 CPU |
Windows, Linux | ||
rocm |
Supported AMD ROCm iGPU/dGPU families* | Windows, Linux | ||
cpu |
x86_64 CPU |
Windows, Linux | ||
moonshine |
cpu |
x86_64/arm64 CPU |
Windows, Linux, macOS | |
| Text-to-speech | kokoro |
metal |
Apple Silicon GPU | macOS |
cpu |
x86_64 CPU |
Windows, Linux | ||
openmoss (experimental) |
cuda |
NVIDIA GPUs | Windows, Linux | |
vulkan |
Vulkan-capable GPUs | Windows, Linux | ||
rocm |
AMD GPUs (ROCm via TheRock) | Windows, Linux | ||
| Audio generation | thinksound (experimental) |
cuda |
NVIDIA GPUs | Windows, Linux |
vulkan |
Vulkan-capable GPUs | Windows, Linux | ||
rocm |
Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock) | Windows, Linux | ||
acestep (experimental) |
cuda |
NVIDIA GPUs | Windows, Linux | |
vulkan |
Vulkan-capable GPUs | Windows, Linux | ||
rocm |
Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock) | Windows, Linux | ||
| Image generation | sd-cpp |
metal |
Apple Silicon GPU | macOS |
cuda |
NVIDIA GPUs (Turing or newer)** | Windows, Linux | ||
vulkan |
Vulkan-capable GPUs | Windows, Linux | ||
rocm |
Supported AMD ROCm iGPU/dGPU families* | Windows, Linux | ||
cpu |
x86_64 CPU |
Windows, Linux | ||
thenoise (experimental) |
rocm |
Supported AMD ROCm iGPU families | Linux | |
| 3D generation | trellis (experimental) |
cuda |
NVIDIA GPUs | Windows, Linux |
vulkan |
Vulkan-capable GPUs | Windows, Linux | ||
rocm |
Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock) | Windows, Linux | ||
| Text classification | onnxruntime (experimental) |
cpu |
x86_64 CPU |
Windows |
cpu |
x86_64/arm64 CPU |
Linux | ||
cpu |
arm64 CPU |
macOS |
| Architecture | Platform Support | GPU Models |
|---|---|---|
| gfx1151 (STX Halo) | Windows, Ubuntu | Ryzen AI MAX+ Pro 395 |
| gfx120X (RDNA4) | Windows, Ubuntu | Radeon AI PRO R9700, RX 9070 XT/GRE/9070, RX 9060 XT |
| gfx110X (RDNA3) | Windows, Ubuntu | Radeon PRO W7900/W7800/W7700/V710, RX 7900 XTX/XT/GRE, RX 7800 XT, RX 7700 XT |
| Compute Capability | Architecture | GPU Models |
|---|---|---|
| sm_75 | Turing | RTX 20-series, GTX 16-series, T4 |
| sm_80 / sm_86 | Ampere | RTX 30-series, A100, A40 |
| sm_89 | Ada Lovelace | RTX 40-series, L40, L4 |
| sm_90 | Hopper | H100, H200 |
| sm_100 / sm_120 | Blackwell | RTX 50-series, B100, B200 |