LocalAI localai/localai:latest https://hub.docker.com/r/localai/localai latest Latest standard release (CPU only) latest-gpu-nvidia-cuda-11 Latest standard release with Nvidia GPU (CUDA 11) support latest-gpu-nvidia-cuda-12 Latest standard release with Nvidia GPU (CUDA 12) support latest-nvidia-l4t-arm64 Latest standard release with Nvidia Jetson (L4T) ARM64 support latest-gpu-hipblas Latest standard release with AMD GPU support latest-gpu-intel-f16 Latest standard release with Intel iGPU (sycl f16) support latest-gpu-intel-f32 Latest standard release with Intel iGPU (sycl f32) support latest-aio-cpu Latest all-in-one release (CPU only) latest-aio-gpu-nvidia-cuda-11 Latest all-in-one release with Nvidia GPU (CUDA 11) support latest-aio-gpu-nvidia-cuda-12 Latest all-in-one release with Nvidia GPU (CUDA 12) support latest-aio-gpu-hipblas Latest all-in-one release with AMD GPU support latest-aio-gpu-intel-f16 Latest all-in-one release with Intel iGPU (sycl f16) support latest-aio-gpu-intel-f32 Latest all-in-one release with Intel iGPU (sycl f32) support bridge http://[IP]:[PORT:8080]/ bash false https://forums.unraid.net/topic/133764-support-grtgbln-docker-templates https://localai.io/ The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities. Additional image variants are also available: https://localai.io/basics/container/#standard-container-images For Nvidia GPU support, add "--gpus all" to the Extra Parameters field under Advanced. For AMD GPU support, add "/dev/kfd" and "/dev/dri" each as a Device and add the required Variables: https://localai.io/features/gpu-acceleration/#setup-example-dockercontainerd For Intel iGPU support, add "/dev/dri" as a Device and add "--device=/dev/dri" to the Extra Parameters field under Advanced. False AI: Productivity: Tools: Other: Status:Stable https://github.com/go-skynet/LocalAI/assets/2420543/0966aa2a-166e-4f99-a3e5-6c915fc997dd https://raw.githubusercontent.com/nwithan8/unraid_templates/main/templates/local_ai.xml https://github.com/nwithan8 The images for this container are several gigabytes (standard images upwards of ~17 GB, AIO images upwards of ~40 GB). If you receive a "no space left on device" warning during installation, please increase the vDisk size in your Docker settings. Additional image variants are also available: https://localai.io/basics/container/#standard-container-images ### 2025-06-25 Add new Docker tags ### 2024-06-20 Update documentation for Intel iGPU passthrough ### 2024-06-15 Add required GPU parameters by default, add non-AIO branches, add better size estimate in install warning ### 2024-06-07 Remove broken GALLERIES environmental variable ### 2024-04-30 Fix port mapping via bridge network ### 2024-04-20 Initial release --gpus=all 8080 /mnt/user/appdata/local_ai/models