## 🍋 Lemonade: Refreshingly fast local AI

Discord PRs Welcome Latest Release GitHub downloads GitHub issues License: Apache Star History Chart

Lemonade Banner

Download | Documentation | Discord

Lemonade is the local AI server that gives you the same capabilities as cloud APIs, except 100% free and private. Use the latest models for chat, coding, speech, and image generation on your own NPU and GPU. Lemonade comes in two flavors: * **Lemonade Server** installs a service you can connect to hundreds of great apps using standard OpenAI, Anthropic, and Ollama APIs. * **Embeddable Lemonade** is a portable binary you can package into your own application to give it multi-modal local AI that auto-optimizes for your user’s PC. *This project is built by the community for every PC, with optimizations by AMD engineers to get the most from Ryzen AI, Radeon, and Strix Halo PCs.* ## Getting Started 1. **Install**: [Windows](https://github.com/lemonade-sdk/lemonade/releases/latest/download/lemonade.msi) · [Linux](#supported-platforms) · [macOS](https://github.com/lemonade-sdk/lemonade/releases) · [Docker](https://lemonade-server.ai/docs/guide/install/docker) · [Source](./docs/dev/getting-started.md) 2. **Get Models**: Browse and download with the [Model Manager](#model-library) 3. **Generate**: Try models with the built-in interfaces for chat, image gen, speech gen, and more 4. **Mobile**: Take your lemonade to go: [iOS](https://apps.apple.com/us/app/lemonade-mobile/id6757372210) · [Android](https://play.google.com/store/apps/details?id=com.lemonade.mobile.chat.ai&pli=1) · [Source](https://github.com/lemonade-sdk/lemonade-mobile) 5. **Connect**: Use Lemonade with your [favorite apps](https://lemonade-server.ai/marketplace):

Claude Code  Firefox Chatbot  AnythingLLM  Dify  GAIA  GitHub Copilot  Infinity Arcade  n8n  Open WebUI  OpenHands

Want your app featured here? Just submit a marketplace PR!

## Supported Platforms | Platform | Build | |----------|-------| | [![Arch Linux](https://img.shields.io/badge/Arch%20Linux-supported-1793D1?logo=arch-linux&logoColor=white)](https://lemonade-server.ai/docs/guide/install/arch/) | [![Build on Arch](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade/linux_distro_builds.yml?branch=main&label=Build%20on%20Arch)](https://github.com/lemonade-sdk/lemonade/actions/workflows/linux_distro_builds.yml) | | [![Debian Trixie+](https://img.shields.io/badge/Debian-Trixie%2B-A81D33?logo=debian&logoColor=white)](https://lemonade-server.ai/docs/guide/install/debian/) | [![Build on Debian](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade/linux_distro_builds.yml?branch=main&label=Build%20on%20Debian)](https://github.com/lemonade-sdk/lemonade/actions/workflows/linux_distro_builds.yml) | | [![Docker](https://img.shields.io/badge/Docker-supported-2496ED?logo=docker&logoColor=white)](https://lemonade-server.ai/docs/guide/install/docker/) | [![Build Container Image](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade/build-and-push-container.yml?branch=main&label=Build%20Container%20Image)](https://github.com/lemonade-sdk/lemonade/actions/workflows/build-and-push-container.yml) | | [![Fedora 43+](https://img.shields.io/badge/Fedora-43%2B-294172?logo=fedora&logoColor=white)](https://lemonade-server.ai/docs/guide/install/fedora/) | [![Build .rpm](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade/cpp_server_build_test_release.yml?branch=main&label=Build%20.rpm)](https://github.com/lemonade-sdk/lemonade/actions/workflows/cpp_server_build_test_release.yml) | | [![macOS](https://img.shields.io/badge/macOS-supported-999999?logo=apple&logoColor=white)](https://github.com/lemonade-sdk/lemonade/releases) | [![Build .pkg](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade/cpp_server_build_test_release.yml?branch=main&label=Build%20.pkg)](https://github.com/lemonade-sdk/lemonade/actions/workflows/cpp_server_build_test_release.yml) | | [![Snap](https://img.shields.io/badge/Snap-supported-82BEA0?logo=snapcraft&logoColor=white)](https://snapcraft.io/lemonade-server) | [![Build Snap](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade-server-snap/snap-build.yaml?branch=main&label=Build%20Snap)](https://github.com/lemonade-sdk/lemonade-server-snap/actions/workflows/snap-build.yaml) | | [![Ubuntu 24.04+](https://img.shields.io/badge/Ubuntu-24.04%2B-E95420?logo=ubuntu&logoColor=white)](https://lemonade-server.ai/docs/guide/install/ubuntu/) | [![Build Launchpad PPA](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade/launchpad-ppa.yml?branch=main&label=Build%20Launchpad%20PPA)](https://github.com/lemonade-sdk/lemonade/actions/workflows/launchpad-ppa.yml) | | [![Windows 11](https://img.shields.io/badge/Windows-11-0078D6?logo=windows&logoColor=white)](https://github.com/lemonade-sdk/lemonade/releases/latest/download/lemonade.msi) | [![Build .msi](https://img.shields.io/github/actions/workflow/status/lemonade-sdk/lemonade/cpp_server_build_test_release.yml?branch=main&label=Build%20.msi)](https://github.com/lemonade-sdk/lemonade/actions/workflows/cpp_server_build_test_release.yml) | ## Using the CLI To run and chat with Gemma: ``` lemonade run Gemma-4-E2B-it-GGUF ``` To code with Lemonade models: ``` lemonade launch claude ``` Multi-modality: ``` # image gen lemonade run SDXL-Turbo # speech gen lemonade run kokoro-v1 # transcription lemonade run Whisper-Large-v3-Turbo ``` To see available models and download them: ``` lemonade list lemonade pull Gemma-4-E2B-it-GGUF ``` To manage model aliases for environment-independent naming and active-standby failover: ``` lemonade alias add production-llm Gemma-4-E2B-it-GGUF lemonade alias list # Instant active-standby failover to a different model target lemonade alias add production-llm Qwen3-0.6B-GGUF lemonade alias remove production-llm ``` To see the backends available on your PC: ``` lemonade backends ``` For hybrid setups, Lemonade can also route to any OpenAI-compatible cloud provider (Fireworks, OpenAI, OpenRouter, Together, …) alongside local models — see [Cloud Offload](./docs/guide/configuration/cloud.md). *(Experimental.)* ## Model Library Model Manager Lemonade supports a wide variety of LLMs (**GGUF**, **FLM**, and **ONNX**), whisper, stable diffusion, etc. models across CPU, GPU, and NPU. Use `lemonade pull` or the built-in **Model Manager** to download models. Custom GGUF/ONNX models can be pulled from Hugging Face or ModelScope, with their source retained for future updates. **[Browse all built-in models →](https://lemonade-server.ai/models.html)**
## Supported Configurations Lemonade supports multiple inference engines for LLM, speech, TTS, and image generation, and each has its own backend and hardware requirements.
Modality Engine Backend Device OS
Text generation llamacpp system x86_64/ARM64 CPU, GPU Linux
metal Apple Silicon GPU macOS
cuda NVIDIA GPUs (Turing or newer)** Windows, Linux
vulkan x86_64 CPU, AMD iGPU, AMD dGPU; ARM64 CPU/GPU (Linux) Windows, Linux
rocm AMD GPUs supported by ROCm Windows, Linux
cpu x86_64 CPU; ARM64 CPU (Linux) Windows, Linux
llamacpp-hrx (experimental) hrx AMD GPUs (gfx1100, gfx1151) Linux
flm npu XDNA2 NPU Windows, Linux
ryzenai-llm npu XDNA2 NPU Windows
vllm (experimental) rocm Strix Halo iGPU (gfx1151) Linux
ds4 (experimental) rocm Prebuilt ds4 for AMD Strix Halo Linux
Speech-to-text whispercpp npu XDNA2 NPU Windows
metal Apple Silicon GPU macOS
vulkan x86_64 CPU Windows, Linux
rocm Supported AMD ROCm iGPU/dGPU families* Windows, Linux
cpu x86_64 CPU Windows, Linux
moonshine cpu x86_64/arm64 CPU Windows, Linux, macOS
Text-to-speech kokoro metal Apple Silicon GPU macOS
cpu x86_64 CPU Windows, Linux
openmoss (experimental) cuda NVIDIA GPUs Windows, Linux
vulkan Vulkan-capable GPUs Windows, Linux
rocm AMD GPUs (ROCm via TheRock) Windows, Linux
Audio generation thinksound (experimental) cuda NVIDIA GPUs Windows, Linux
vulkan Vulkan-capable GPUs Windows, Linux
rocm Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock) Windows, Linux
acestep (experimental) cuda NVIDIA GPUs Windows, Linux
vulkan Vulkan-capable GPUs Windows, Linux
rocm Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock) Windows, Linux
Image generation sd-cpp metal Apple Silicon GPU macOS
cuda NVIDIA GPUs (Turing or newer)** Windows, Linux
vulkan Vulkan-capable GPUs Windows, Linux
rocm Supported AMD ROCm iGPU/dGPU families* Windows, Linux
cpu x86_64 CPU Windows, Linux
thenoise (experimental) rocm Supported AMD ROCm iGPU families Linux
3D generation trellis (experimental) cuda NVIDIA GPUs Windows, Linux
vulkan Vulkan-capable GPUs Windows, Linux
rocm Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock) Windows, Linux
Text classification onnxruntime (experimental) cpu x86_64 CPU Windows
cpu x86_64/arm64 CPU Linux
cpu arm64 CPU macOS
To check exactly which recipes/backends are supported on your own machine, run: ``` lemonade backends ```
* See supported AMD ROCm platforms
Architecture Platform Support GPU Models
gfx1151 (STX Halo) Windows, Ubuntu Ryzen AI MAX+ Pro 395
gfx120X (RDNA4) Windows, Ubuntu Radeon AI PRO R9700, RX 9070 XT/GRE/9070, RX 9060 XT
gfx110X (RDNA3) Windows, Ubuntu Radeon PRO W7900/W7800/W7700/V710, RX 7900 XTX/XT/GRE, RX 7800 XT, RX 7700 XT
** See supported NVIDIA CUDA platforms
Compute Capability Architecture GPU Models
sm_75 Turing RTX 20-series, GTX 16-series, T4
sm_80 / sm_86 Ampere RTX 30-series, A100, A40
sm_89 Ada Lovelace RTX 40-series, L40, L4
sm_90 Hopper H100, H200
sm_100 / sm_120 Blackwell RTX 50-series, B100, B200
## Project Roadmap Lemonade's roadmap is defined by a set of working groups. Visit the landing page [here](./docs/dev/working-groups/README.md) to learn each group's goal and roadmap. ## Integrate Embeddable Lemonade in Your Application Embeddable Lemonade is a binary version of Lemonade that you can bundle into your own app to give it a portable, auto-optimizing, multi-modal local AI stack. This lets users focus on your app, with zero Lemonade installers, branding, or telemetry. Check out the [Embeddable Lemonade guide](docs/embeddable/README.md). ## Connect Lemonade Server to Your Application You can use any OpenAI-compatible client library by configuring it to use `http://localhost:13305/v1` as the base URL. A table containing official and popular OpenAI clients on different languages is shown below. Feel free to pick and choose your preferred language. | Python | C++ | Java | C# | Node.js | Go | Ruby | Rust | PHP | |--------|-----|------|----|---------|----|-------|------|-----| | [openai-python](https://github.com/openai/openai-python) | [openai-cpp](https://github.com/olrea/openai-cpp) | [openai-java](https://github.com/openai/openai-java) | [openai-dotnet](https://github.com/openai/openai-dotnet) | [openai-node](https://github.com/openai/openai-node) | [go-openai](https://github.com/sashabaranov/go-openai) | [ruby-openai](https://github.com/alexrudall/ruby-openai) | [async-openai](https://github.com/64bit/async-openai) | [openai-php](https://github.com/openai-php/client) | ### Python Client Example ```python from openai import OpenAI # Initialize the client to use Lemonade Server client = OpenAI( base_url="http://localhost:13305/api/v1", api_key="lemonade" # required but unused ) # Create a chat completion completion = client.chat.completions.create( model="Gemma-4-E2B-it-GGUF", # or any other available model messages=[ {"role": "user", "content": "What is the capital of France?"} ] ) # Print the response print(completion.choices[0].message.content) ``` Click to learn more about the [available APIs](./docs/api/README.md) and how to [embed Lemonade](./docs/embeddable/README.md) in your own application. ## FAQ To read our frequently asked questions, see our [FAQ Guide](./docs/guide/faq.md) ## Contributing Lemonade is built by the local AI community! If you would like to contribute to this project, please check out our [contribution guide](./docs/dev/contribute.md). ## Maintainers This is a community project with many maintainers, please see the [maintainers list here](./docs/dev/contribute.md#maintainers) to see their subject areas. You can reach us by filing an [issue](https://github.com/lemonade-sdk/lemonade/issues) or joining our [Discord](https://discord.gg/5xXzkMu8Zk). This project is sponsored by [AMD](mailto:lemonade@amd.com). ## Code Signing Policy Free code signing provided by [SignPath.io](https://signpath.io), certificate by [SignPath Foundation](https://signpath.org). - **Committers and reviewers**: [Maintainers](#maintainers) of this repo - **Approvers**: [Owners](https://github.com/orgs/lemonade-sdk/people?query=role%3Aowner) **Privacy policy**: This program will not transfer any information to other networked systems unless specifically requested by the user or the person installing or operating it. When the user requests a model download or registry lookup, Lemonade may contact [Hugging Face Hub](https://huggingface.co/) (see their [privacy policy](https://huggingface.co/privacy)) or [ModelScope](https://modelscope.cn/), according to the model source selected by the user or packager. ## License and Attribution This project is: - Built with C++ (server) and React (app) with ❤️ for the open source community, - Standing on the shoulders of great tools from: - [ggml/llama.cpp](https://github.com/ggml-org/llama.cpp) - [ggml/whisper.cpp](https://github.com/ggerganov/whisper.cpp) - [ggml/stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp) - [kokoros](https://github.com/lucasjinreal/Kokoros) - [OnnxRuntime GenAI](https://github.com/microsoft/onnxruntime-genai) - [Hugging Face Hub](https://github.com/huggingface/huggingface_hub) - [ModelScope](https://github.com/modelscope/modelscope) - [OpenAI API](https://github.com/openai/openai-python) - [IRON/MLIR-AIE](https://github.com/Xilinx/mlir-aie) - and more... - Licensed under the [Apache 2.0 License](https://github.com/lemonade-sdk/lemonade/blob/main/LICENSE). - Portions of the project are licensed as described in [LICENSE](./LICENSE).