Strata ghcr.io/williamkunz/strata:latest https://github.com/williamkunz/strata-docker/pkgs/container/strata bridge bash false https://github.com/williamkunz/strata-docker/issues https://github.com/Niko1221/Strata https://raw.githubusercontent.com/williamkunz/strata-docker/main/README.md Strata runs the Qwen3.8-Flash-Next mixture-of-experts model on one NVIDIA GPU plus system RAM, and serves an OpenAI- and Anthropic-compatible API, a chat page and a live monitor. Requirements: the Nvidia Driver plugin on driver 580 or newer; an RTX 20/30/40/50 card with 12 GB of VRAM or more; an AVX2 CPU; 48-62 GB of free RAM depending on the model; 70-90 GB of disk on an SSD pool. First start: downloads the model (about 70 GB for IQ2_XS) and sets it up, which can take a few hours. Watch the log; it resumes if it stops. Later starts go straight to serving, and loading the model into RAM takes 1-3 minutes. Changing settings later: switching Model or Model family needs nothing extra. Changing context, vision, KV cache, API key or low-RAM mode for a model already set up needs Reinstall = 1 for one start (nothing is downloaded again), then set it back to 0. No API key by default: anyone who can reach the port can use the model. Keep it LAN-only, or set an API key. This is an unofficial image built from Strata's own Dockerfile. Report template or image problems at the Support link, not to the Strata project. AI: llm qwen local ai openai anthropic api inference chat nvidia cuda gpu http://[IP]:[PORT:8080]/ https://raw.githubusercontent.com/williamkunz/strata-docker/main/templates/strata.xml https://raw.githubusercontent.com/williamkunz/strata-docker/main/icon.png MIT --runtime=nvidia --ulimit memlock=-1 --stop-timeout 60 **Nvidia Driver plugin** on driver 580 or newer. Do not pin CPUs: the engine sets its own thread affinity and breaks inside a cpuset. Do not set a memory limit unless Low-RAM mode is on. 8080 /mnt/cache/appdata/strata IQ2_XS qwen 32768 no 0 int8 auto compute,utility