HermitUI is a lightweight, modern, and highly responsive single-page web interface for interacting with local AI models. Built entirely in a single file, it requires no build steps, backend, or installation.
By design, it prioritizes your privacy—no chat history is saved across sessions.
Importing loads the conversation from the file and discards the one on screen.
Nothing is saved anywhere, so the current chat cannot be recovered — export it first if you want to keep it.
➕ Start a new chat?
This clears the conversation on screen along with anything in the composer.
Nothing is saved anywhere, so it cannot be recovered — export it first if you want to keep it.
⚙️ Settings
Accepts direct .gguf links, Hugging Face /blob/ page URLs, or hf:user/repo/file.gguf. The model streams straight into memory — nothing is ever stored, so it is fetched again next session.💾 Save a copy to disk to avoid that: download it once, then load it with the file picker above.
Status: Unloaded
Auto uses the model's embedded template when present, else infers from its architecture.
Larger = more history but more memory/slower load (the KV cache grows with it — if the model fails to load, lower this). 0 = use the model's built-in default. Applied when the model is loaded.
Upper bound on tokens generated per reply. Applied immediately (no reload needed). Must fit within the context window.
Note: On some systems (especially integrated graphics) WebGPU may be slower than CPU. Uncheck to force CPU-only mode.
🐛 Debug output (engine load, model metadata, chosen template, the prompt sent, tokens/sec) streams to the drop-down console at the top of the screen — click the 🐛 button in the header.
⚠️
Privacy Warning: This endpoint is not on your machine or local network (). Your chat data will leave your local machine.
🚫
Blocked by your browser: this page is served over HTTPS, so it cannot call a plain http:// address other than localhost. Use https://, run HermitUI from a local file, or point it at localhost.
👁️ vision
Advanced parameters
⚠️Privacy Warning: You are using a cloud provider (). Your chat data leaves your local machine.
🔗This link wants to load from for in-browser inference.