ollama ollama/ollama https://hub.docker.com/r/ollama/ollama/ latest Use for Nvidia or CPU rocm Use for AMD bridge bash false https://hub.docker.com/r/ollama/ollama/ Official Ollama images for Nvidia or AMD GPUs. Intel Arc GPUs could potentially work with Vulkan enabled. NOTE: Extra Parameters needed for Nvidia: --gpus=all Additionally you can add a Variable called CUDA_VISIBLE_DEVICES to only use specific Nvidia GPU(s) by ID. Example: 0 or 0,1 Extra Parameters needed for AMD: --device='/dev/kfd' --device='/dev/dri' Additionally you can add a Variable called ROCR_VISIBLE_DEVICES to only use specific AMD GPU(s) by UUID. Example: GPU-67246603a11f0a21 or GPU-XXXXXXX,GPU-YYYYYYY Docs: https://docs.ollama.com/ AI: Other: http://[IP]:[PORT:11434]/ https://raw.githubusercontent.com/Joly0/unraid-templates/main/templates/ollama.xml https://ollama.ai/public/ollama.png **Nvidia-Driver plugin** (nVidia Support)
**Radeon-TOP plugin** (AMD Support) /mnt/user/appdata/ollama 11434 0.0.0.0:11434 * 5m 5m 1 4096 f16 /root/.ollama/models 0 512 0