OmniVoice-Triton-API
ghcr.io/hsiang-han/omnivoice-triton-api:latest
https://ghcr.io
bridge
bash
false
https://github.com/hsiang-han/OmniVoice-Triton-API/issues
https://github.com/hsiang-han/OmniVoice-Triton-API
OpenAI-compatible TTS API powered by OmniVoice with Triton kernel fusion + CUDA Graph acceleration. 646 languages, voice cloning, voice design. Up to 3.4x faster than stock OmniVoice, ~170ms per utterance. Supports RTX 50-series (Blackwell) GPUs. First start downloads model (~2GB) from HuggingFace. China users: set HF_ENDPOINT to https://hf-mirror.com for faster downloads. Requires NVIDIA GPU with driver 550+.
AI: Productivity: Tools:
http://[IP]:[PORT:8080]/docs
https://raw.githubusercontent.com/hsiang-han/unraid_templates/main/templates/omnivoice-triton-api.xml
https://raw.githubusercontent.com/hsiang-han/unraid_templates/main/assets/omnivoice-triton-api-icon.png
--gpus all --shm-size=4g
8080
/mnt/user/appdata/omnivoice-triton-api/models
triton
32
https://huggingface.co
all
compute,utility