[](https://github.com/GradientHQ/parallax/tree/main/LICENSE)
[](https://github.com/GradientHQ/parallax/issues)
[](https://github.com/GradientHQ/parallax/issues)
[**Gradient**](https://gradient.network) |
[**Blog**](https://gradient.network/blog/parallax-the-sovereign-ai-os) |
[**X/Twitter (Gradient)**](https://x.com/Gradient_HQ) |
[**X/Twitter (Parallax)**](https://x.com/tryParallax) |
[**Discord**](https://discord.gg/parallaxai) |
[**Arxiv**](https://arxiv.org/pdf/2509.26182v1)
## News
- [2026/02] 🦞 Parallax now supports OpenClaw integration! See [Docs](./docs/user_guide/work_with_openclaw.md)
- [2025/10] 🔥 Parallax won #1 Product of The Day on Product Hunt!
- [2025/10] 🔥 Parallax version 0.0.1 has been released!
## About
A fully decentralized inference engine developed by [Gradient](https://gradient.network). Parallax lets you build your own AI cluster for model inference onto a set of distributed nodes despite their varying configuration and physical location. Its core features include:
- **Host local LLM on personal devices**
- **Cross-platform support**
- **Pipeline parallel model sharding**
- **Paged KV cache management & continuous batching for Mac**
- **Dynamic request scheduling and routing for high performance**
The backend architecture:
* P2P communication powered by [Lattica](https://github.com/GradientHQ/lattica)
* GPU backend powered by [SGLang](https://github.com/sgl-project/sglang) and [vLLM](https://github.com/vllm-project/vllm)
* Mac backend powered by [MLX LM](https://github.com/ml-explore/mlx-lm)
## User Guide
- [Installation](./docs/user_guide/install.md)
- [Getting Started](./docs/user_guide/quick_start.md)
- [Working with OpenClaw 🦞](./docs/user_guide/work_with_openclaw.md)
## Quick Install
```sh
git clone https://github.com/GradientHQ/parallax.git
cd parallax
./install.sh
source .venv/bin/activate
parallax serve -m Qwen/Qwen3.5-0.8B
```
## Contributing
We warmly welcome contributions of all kinds! For guidelines on how to get involved, please refer to our [Contributing Guide](./docs/CONTRIBUTING.md).
## Supported Models
| | Provider | HuggingFace Collection | Blog | Description |
|:-------------|:-------------|:----------------------------:|:----------------------------:|:----------------------------|
|DeepSeek | Deepseek | [DeepSeek-V3.2](https://huggingface.co/deepseek-ai/DeepSeek-V3.2)