whatmodel.sh: find the best AI models you can run

The open AI model leaderboard. Every model is ranked by one score built from 37,490 published benchmark results, with its price, the memory it needs and the command to run it.
Filter by your computer or budget at whatmodel.sh, or read the same leaderboard below. About this repo

**llm** · [image](pages/image.md) · [video](pages/video.md) · [tts](pages/tts.md) · [stt](pages/stt.md) · [decision](pages/decision.md) updated 2026-11-03 02:37 UTC · 891 models · scores combine 575 benchmarks · [how it works](pages/method.md) · [benchmark your machine](https://whatmodel.sh/bench) · [interactive version](https://whatmodel.sh/)
Extra: filter models and choose a score scale [All sets](https://whatmodel.sh/) · [LMArena (text) · 1194 models](https://whatmodel.sh/?set=lmarena-text) · [ARC Challenge · 8 models](https://whatmodel.sh/?set=arc-challenge%40paper-2005.14165v4) · [ANLI Round 1 (prompted) · 8 models](https://whatmodel.sh/?set=anli-r1%40paper-2112.06905v2) · [LAMBADA (OpenAI version), last-word accuracy · 7 models](https://whatmodel.sh/?set=lambada-openai%40paper-2112.11446v2) · [ARC Challenge · 3 models](https://whatmodel.sh/?set=arc-challenge%40first-party-aleph-alpha) · [ARC Challenge · 2 models](https://whatmodel.sh/?set=arc-challenge%40first-party-ai21) · [GPQA Diamond · 2 models](https://whatmodel.sh/?set=gpqa-diamond%40first-party-liquid-scores) Filtering keeps overall scores. On the site, choose **within selected set** to use only that set’s evaluations. Models without a shared score scale are marked **not yet calibrated**.
Run `curl "whatmodel.sh/?mac=$(sysctl -n hw.memsize)"` to see what your Mac can run, or `curl whatmodel.sh` for this list in your terminal.
Linux, Windows and common machines ```sh curl "whatmodel.sh/?ram=$(awk '/MemT/{print $2}' /proc/meminfo)&vram=$(nvidia-smi -i 0 --query-gpu=memory.total --format=csv,noheader,nounits 2>/dev/null || cat /sys/class/drm/card*/device/mem_info_vram_total 2>/dev/null | sort -n | tail -1)" # Linux curl.exe "whatmodel.sh/?ram=$((gcim Win32_ComputerSystem).TotalPhysicalMemory)&vram=$(nvidia-smi -i 0 --query-gpu=memory.total --format=csv,noheader,nounits 2>$null)" # Windows ``` [16GB Mac](https://whatmodel.sh/?ram=16&gpu=apple) · [32GB Mac](https://whatmodel.sh/?ram=32&gpu=apple) · [64GB Mac](https://whatmodel.sh/?ram=64&gpu=apple) · [128GB Mac](https://whatmodel.sh/?ram=128&gpu=apple) · [12GB graphics card](https://whatmodel.sh/?ram=32&gpu=card&vram=12) · [24GB graphics card](https://whatmodel.sh/?ram=64&gpu=card&vram=24) · [16GB, no graphics card](https://whatmodel.sh/?ram=16&gpu=none)
```text score vs API price │ DeepSeek V4.1 Flash 1017 GPT-6.1 Terra ◆──────◇──────◆────────◆ GPT-6 Astra 80 ┤ · · · · · · · · ●─●──∘─●◇∘∘●∘───◇∘●─∘─∘◇∘∘∘∘∘∘◇◇∘ ·◇◇◇◇◇◇◇◇ ·◇·◇◇ · · ◇ · ·◇·◇· ◇ ◇ · 60 ┤ · · · · · ·◆─∘──∘∘∘∘∘∘·◇∘∘·◇∘∘∘∘∘ ◇◇∘∘∘◇∘∘∘ ·∘◇◇·∘·∘◇◇∘◇◇ · ◇ · · ·◇· · ◇ · ◇ · · · · 40 ┤ · · · · · ●┘◇∘∘ ·∘◇∘∘ · ·∘·∘∘ · · · ·◇· · ·◇· · · · · ·∘· · · ··· · · · · · · · · · · │ ●────────┘ └──────────────────┬──────────────────────┬──────────────────────┬───────────────────── $0.1 $1 $10 ```
Full charts: score vs price and memory ```text score vs API price (USD per 1M tokens, 3 input : 1 output, log) ● open weights ◆ API only ─┘ best for the price │ Claude Opus 5.5 │ · · ◆────────◆ GPT-6 Astra │ GPT-6.1 Terra ◆──────◇──────┘ ◇ ◇ 80 ┤ · ·DeepSeek V4.1 Flash 1017 · · · ●─MiMo-V2.6-Pro · · ◇ · · ·◇··◇ · · ◇ · · · · · ◇ · │ ●◇─◇●────◇─┘ ∘ ◇∘ ∘∘ ◇ ◇ ◇∘ ◇ ◇ │ ·●────┘ ∘ ◇ ·◇ ∘◇◇ ◇∘ ◇◇◇◇ ◇ ◇ ◇ ◇ │ ●─┘ ∘ ∘ ∘∘ ◇∘∘∘◇ ∘◇∘∘∘∘∘∘◇ ∘ ◇ ◇ ◇ │ ◆────┘· ∘ ◇∘ ∘ ∘ ∘ ◇ ∘ ∘∘∘ ◇◇ ◇ ∘◇ ∘ · ◇ 60 ┤ · · · · · ·│· · ∘ ∘ ◇∘· · ·∘∘∘·∘∘ · ◇∘◇∘∘ · · · · · ◇◇· · · · · · · · · · · · · · · · │ ● ∘ ∘·∘∘∘ ◇ ∘ ∘ ∘ ∘ ◇∘∘∘◇· ∘ ◇ ◇ · ◇ │ │ ∘∘∘ ∘ ◇∘ ◇∘ ∘ ∘ ∘ ∘ ◇ │ │ ∘ ·◇ ∘ ∘ · ◇ · ◇ │ ●┘◇ ∘ ∘ ∘ ∘ ◇ ∘ │ │ ∘ · ∘ · · 40 ┤ · · · · · │ · · · ·∘· · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · │ │ · · · │ ●─Llama 3.2 1B Instruct │ · · · └──────────────────┬──────────────────────┬──────────────────────┬───────────────────── $0.1 $1 $10 ``` ```text score vs memory to run it (GB, log) ─┘ best for the memory │ Hy4 preview (770B-A49B) │ · · MiMo-V2.6-Flash (309B-A15… ●───∘─● MiMo-V2.6-Pro │ Spark-X2.6 4B Qwen3.8 27B ●────────────●─∘──∘●─∘●──∘──∘ ∘∘ ∘∘ ∘ ∘ ∘ │ · ●────●────∘───────∘∘∘∘∘ ∘ ∘ ∘∘∘∘∘ ∘∘∘∘∘∘ ∘∘ ∘ ∘ ∘∘∘ · ∘ │ ●───∘ ∘ ∘ ∘ ∘∘∘∘ ∘ ∘ ∘∘∘∘ ∘∘∘∘ ∘ ∘∘∘ ∘∘ ∘∘∘ ∘∘ ∘∘ │ · ∘ ∘ ∘ ∘ ∘ ∘∘∘∘∘ ∘∘∘∘∘∘∘∘∘∘ ∘∘ ∘ ∘ ∘·∘ ∘ ∘ · 50 ┤ ·●───────∘· ·∘· ∘ ∘ ∘ ∘∘∘∘∘∘·∘∘ ∘∘∘∘∘∘∘∘·∘·∘∘∘· ∘∘· · · · · ·∘· · · · · ∘ · · · · · · │ ∘ ∘ ∘ ∘ ∘ ∘ ∘∘∘∘∘∘ ∘∘∘ ∘∘∘∘∘∘∘ ∘ ·∘ ∘ ∘ │ ∘ ∘ ∘ ∘ ∘ ∘ ∘∘∘∘∘∘∘ ∘ ∘∘ ∘ ∘ │ ∘ ∘ ∘ ∘ ∘ ∘∘∘· ∘∘ ∘∘ ∘ · ∘ ∘ · │ ∘ ∘ ∘ ∘ ∘ ∘ ∘∘∘ ∘ ∘ │ ∘ ∘ ∘ ∘ ∘ ∘ ∘· ∘ · · │ ∘ ∘ ∘ ∘ │ · ∘ ∘ · ∘ · · 0 ┤ · · · · ·∘· · · · · · · · · · ·∘· · · · · · · · · · · · · · · · · · · · · · · · · · · │ · ∘ · · · │ ∘ │ · · · · └──┬───────────────────────┬────────────────────────┬───────────────────────┬────────── 1GB 10GB 100GB 1TB ```
  #  model                                     score  where                   RAM       speed  context  get it
  1  GPT-6 Astra                               85±1   api $20.00/M                                1.1M  openai.com ↗
  2  Claude Opus 5.5                           85±1   api $8.00/M                                   1M  anthropic.com ↗
  3  GPT-6.1 Terra                             84±1   api $2.00/M                                       openai.com ↗
  4  Gemini 4 Carbon                           83±1   limited preview
  5  GPT-6.1 Sol                               83±1   api $4.00/M                                 1.1M  openai.com ↗
  6  Claude Fable 5.1                          82±1   api $20.00/M                                  1M  anthropic.com ↗
  7  Muse Wonder Full                          82±1   Muse Code only                                1M  research.meta.a…
  8  Claude Sonnet 5.5                         82±1   api $4.00/M                                   1M  claude.com ↗
  9  Gemini 4 Argon                            81±1   api $4.00/M                                   1M  google.dev ↗
 10  Claude Opus 5                             81±1   api $10.00/M                                  1M  anthropic.com ↗
 11  GPT-6 Sol                                 80±1   api $4.00/M                                 1.1M  openai.com ↗
 12  GPT-5.5 Pro                               80±1   api $67.50/M                                1.1M  openai.com ↗
 13  GPT-5.6 Sol                               80±1   api $8.00/M                                 1.1M  openai.com ↗
 14  Claude Fable 5                            79±1   api $20.00/M                                  1M  anthropic.com ↗
 15  Claude Mythos Preview (li…                79±1†  limited preview                               1M
 16  GPT-5.4 Pro                               79±1   api $67.50/M                                1.1M  openai.com ↗
 17  Muse Wonder                               78±1   api $8.00/M                                   1M  dev.meta.ai ↗
 18  GPT-5.5                                   78±0   api $11.25/M                                1.1M  openai.com ↗
 19  MiMo-V2.6-Pro                             77±1   api $0.54/M +local   ~443GB                   1M  mimo.mi.com ↗
 20  DeepSeek V4.1 Flash 1017                  77±1   api $0.26/M                                   1M  deepseek.com ↗
 21  Hy4 preview (770B-A49B)                   77±1   api $1.25/M +local   ~248GB                   1M  tencent.com ↗
 22  GPT-5.6 Terra                             77±1   api $4.50/M                                 1.1M  openai.com ↗
 23  Qwen3.8 Max (2.4T-A95B)                   76±1   api $3.00/M +local   ~380GB                 262k  deepinfra.com ↗
 24  Claude Opus 4.8                           76±0   api $10.00/M                                  1M  anthropic.com ↗
 25  GPT-5.4                                   76±1   api $5.63/M                                 1.1M  openai.com ↗
 26  Muse Spark 1.3                            76±1   api $2.00/M                                   1M  dev.meta.ai ↗
 27  MiMo-V2.6-Flash (309B-A15…                76±1   api $0.17/M +local   ~136GB                   1M  mimo.mi.com ↗
 28  Gemini 3.8 Flash                          76±1   api $1.50/M                                   1M  google.dev ↗
 29  DeepSeek V4.1 Flash                       76±1   local                ~512GB   ~12 tok/s       1M  how to run ›
 30  Kimi K3                                   75±1   api $6.00/M +local   ~884GB                   1M  moonshot.ai ↗
 31  GPT-5.2 Pro                               75±1   api $57.75/M                                400k  openai.com ↗
 32  Claude Haiku 5.5                          75±1   api $0.20/M                                   1M  claude.com ↗
 33  GPT-6 Luna                                75±1   api $0.20/M                                 1.1M  openai.com ↗
 34  GPT-5.6 Luna                              75±1   api $0.45/M                                 1.1M  openai.com ↗
 35  Grok 4.6                                  75±1   api $3.00/M                                 500k  x.ai ↗
 36  Gemini 3.7 Flash                          75±1   api $1.50/M                                   1M  google.dev ↗
 37  DeepSeek V4 Pro (0813)                    75±1   api $1.63/M +local  ~1010GB                   1M  deepinfra.com ↗
 38  GLM-5.3                                   75±1   api $2.15/M +local   ~239GB                   1M  z.ai ↗
 39  Qwen3.8 Max (0902)                        74±1   api $3.00/M                                   1M  alibabacloud.co…
 40  Muse Spark Open                           74±1   api $2.00/M +local   ~190GB                   1M  fireworks.ai ↗
 41  DeepSeek V3.2 Speciale                    74±3†  comparison only
 42  Muse Spark                                74±2   comparison only
 43  Gemini 3.1 Pro (Preview)                  74±0   api $4.50/M                                   1M  google.dev ↗
 44  Claude Opus 4.7                           74±1   api $10.00/M                                  1M  anthropic.com ↗
 45  Grok 4.5                                  74±1   api $3.00/M                                 500k  x.ai ↗
 46  Qwen3.8-Omni-Flash                        74±1†  api $0.23/M                                   1M  alibabacloud.co…
 47  DeepSeek V4 Flash Vision …                74±2   local                ~104GB                   1M  llama.cpp ›
 48  Claude Sonnet 5                           73±1   api $4.00/M                                   1M  anthropic.com ↗
 49  Qwen3.8-Flash-Next                        73±1   local                 ~59GB   ~27 tok/s     262k  llama.cpp ›
 50  Claude Opus 4.6                           73±1   api $10.00/M                                  1M  anthropic.com ↗
 51  Muse Spark 1.1                            73±1   api $2.00/M                                   1M  dev.meta.ai ↗
 52  Grok 4.7                                  73±1   api $3.00/M                                 500k  x.ai ↗
 53  Muse Spark 1.2                            73±1   api $2.00/M                                   1M  dev.meta.ai ↗
 54  Step 5 Preview                            73±1   comparison only
 55  GPT-5.3-Codex                             73±1   api $4.81/M                                 400k  openai.com ↗
 56  Gemini 3.5 Flash                          73±1   api $3.38/M                                   1M  google.dev ↗
 57  Qwen3.7 Max                               73±1   api $3.75/M                                   1M  deepinfra.com ↗
 58  DeepSeek V4 Flash (0731)                  72±1   api $0.11/M +local    ~92GB                   1M  deepinfra.com ↗
 59  GLM-5.3-Flash                             72±1   api $0.24/M +local   ~103GB                   1M  z.ai ↗
 60  GPT-5.2                                   72±1   api $4.81/M                                 400k  openai.com ↗
 61  Gemini 3.6 Flash                          72±1   api $1.50/M                                   1M  google.dev ↗
 62  GLM-5.2                                   72±1   api $2.15/M +local   ~121GB                   1M  z.ai ↗
 63  Grok 4.20 Multi-Agent (03…                72±2   api $1.56/M                                   1M  x.ai ↗
 64  Dola Seed 2.0 Pro                         72±2   comparison only
 65  Hunyuan Hy3 (295B-A21B)                   72±1   api $0.23/M +local    ~94GB                 256k  deepinfra.com ↗
 66  Qwen3.8 27B                               72±1   api $1.60/M +local    ~18GB  ~6.7 tok/s     262k  groq.com ↗
 67  LongCat 2.0 (1.6T-A48B)                   72±2   api $1.30/M +local  ~2155GB                   1M  longcat.chat ↗
 68  Kimi K2.6                                 72±1   api $1.71/M +local   ~317GB                 262k  moonshot.ai ↗
 69  GPT-5 Pro                                 72±1   api $41.25/M                                400k  openai.com ↗
 70  Gemini 3 Pro (Preview)                    71±1   comparison only                               1M
 71  GPT-5                                     71±1   api $3.44/M                                 400k  openai.com ↗
 72  Qwen3.6 Max Preview                       71±1   api $2.92/M                                 256k  alibabacloud.co…
 73  Mistral Large 4 (public p…                71±1   comparison only                               1M
 74  Claude Sonnet 4.6                         71±1   api $6.00/M                                   1M  anthropic.com ↗
 75  Gemini 3 Flash (Preview)                  71±1   api $1.13/M                                   1M  google.dev ↗
 76  DeepSeek V4 Pro (Preview,…                71±1   local                ~604GB                       llama.cpp ›
 77  Claude Opus 4.5                           71±1   api $10.00/M                                200k  anthropic.com ↗
 78  Qwen3.7 Plus                              71±1   api $0.70/M                                   1M  alibabacloud.co…
 79  Kimi K2.7 Code                            71±1   api $1.71/M +local   ~359GB                 262k  kimi.ai ↗
 80  North Small Translate 1.0                 71±5†  api price unknown                            16k  cohere.com ↗
 81  Solar Open 2 (250B-A15B)                  71±1†  local                ~527GB                   1M  how to run ›
 82  DeepSeek V4 Flash (Previe…                70±1   local                ~103GB                       llama.cpp ›
 83  Grok 4.20 (0309 reasoning)                70±1   api $1.56/M                                   1M  x.ai ↗
 84  Beam 1.0 501B A23B                        70±1   api price unknown                             1M  reflection.ai ↗
 85  GPT-5.4 mini                              70±1   api $1.69/M                                 400k  openai.com ↗
 86  Ling 3.0 Flash (124B-A5B)                 70±2†  api $0.090/M +loc…    ~71GB                 131k  deepinfra.com ↗
 87  GPT-5.1                                   70±1   api $3.44/M                                 400k  openai.com ↗
 88  GLM-5.1                                   70±0   api $2.15/M +local   ~119GB                 200k  z.ai ↗
 89  o3-pro                                    70±2   api $35.00/M                                200k  openai.com ↗
 90  Qwen3.5 397B-A17B                         69±0   api $1.09/M +local    ~65GB                 262k  deepinfra.com ↗
 91  Gemini 2.5 Pro Preview (0…                69±2   comparison only
 92  KAT-Coder-V2.5-Dev (35B-A…                69±2†  local                 ~21GB                 262k  LM Studio ›
 93  Ornith 1.5 35B-A3B                        69±1†  local                 ~21GB   ~80 tok/s     262k  LM Studio ›
 94  Grok 4.3                                  69±1   api $1.56/M                                   1M  x.ai ↗
 95  MiniMax-M3                                69±1   api $0.48/M +local   ~131GB                   1M  deepinfra.com ↗
 96  Qwen3.6 Plus                              69±1   api $1.13/M                                   1M  together.ai ↗
 97  Kimi K2.5                                 69±1   api $1.20/M +local   ~160GB                 262k  aws.amazon.com ↗
 98  MiMo-V2-Pro                               69±1   comparison only
 99  Qwen3-Max (2026-01-23)                    69±1†  comparison only
100  GLM-5                                     69±1   api $1.55/M +local   ~119GB                 205k  z.ai ↗
101  MiMo-V2.5-Pro (1T-A42B)                   69±1   api $0.65/M +local   ~163GB                   1M  novita.ai ↗
102  Muse Glimmer 30B                          69±1   api $0.64/M +local    ~18GB   ~27 tok/s     131k  fireworks.ai ↗
103  o3                                        68±1   api $3.50/M                                 200k  openai.com ↗
104  Nemotron 3 Ultra 550B-A55B                68±1   api $1.35/M +local    ~89GB                   1M  together.ai ↗
105  Inkling Small (266B-A12B)                 68±1   api $0.64/M +local    ~86GB                   1M  deepinfra.com ↗
106  Qwen3.6 27B                               68±1   api $1.20/M +local    ~18GB   ~16 tok/s     262k  groq.com ↗
107  Ring-2.6-1T                               68±2†  comparison only
108  A.X K2 (688B-A33B)                        68±1†  local               ~1454GB                 262k  how to run ›
109  MiMo-V2.5 (310B-A15B)                     68±1   api $0.21/M +local   ~100GB                   1M  novita.ai ↗
110  GPT-5.5 Instant                           68±1   comparison only
111  Qwen3.5 Plus                              68±2   api $0.90/M                                   1M  alibabacloud.co…
112  Gemini 3.5 Flash-Lite                     68±1   api $0.85/M                                   1M  google.dev ↗
113  Qwen3.5 122B-A10B                         68±1   api $1.10/M +local    ~71GB                 262k  alibabacloud.co…
114  Inkling (975B-A41B)                       68±1   api $1.73/M +local   ~156GB                   1M  deepinfra.com ↗
115  Nemotron 3.5 Bolt 74B A9B                 68±2†  local                ~157GB                 262k  how to run ›
116  GPT-5.4 nano                              68±1   api $0.46/M                                 400k  openai.com ↗
117  Claude Sonnet 4.5                         68±1   api $6.00/M                                 200k  anthropic.com ↗
118  GLM-5V-Turbo                              68±2   api $1.90/M                                 200k  siliconflow.com…
119  LongCat-Flash-Thinking (5…                68±1†  comparison only                             128k
120  GLM-4.7                                   68±1   api $1.00/M +local    ~58GB                 205k  z.ai ↗
121  Qwen3.5 27B                               68±0   api $0.84/M +local    ~18GB   ~29 tok/s     262k  deepinfra.com ↗
122  Gemini 2.5 Pro Experiment…                67±2   comparison only
123  Grok 4 (0709)                             67±1   comparison only
124  MiMo-V2-Omni                              67±2   comparison only                             262k
125  Nemotron 3.5 Super VL 120…                67±1   local                ~254GB                   1M  how to run ›
126  Spark-X2.6 4B                             67±1†  local                ~5.2GB                   1M  llama.cpp ›
127  DeepSeek V3.2                             67±1   api $0.29/M +local   ~110GB                 128k  deepinfra.com ↗
128  Step 3.5 Flash (196B-A11B)                67±1   api $0.15/M +local   ~118GB   ~18 tok/s     256k  stepfun.ai ↗
129  GPT-5.2-Codex                             67±2   comparison only
130  Qwen3.6 35B-A3B                           67±1   api $0.31/M +local    ~21GB   ~63 tok/s     262k  deepinfra.com ↗
131  Qwen3-Coder-Next (80B-A3B)                67±2   api $0.60/M +local    ~25GB   ~62 tok/s     262k  alibabacloud.co…
132  GPT-5 mini                                67±1   api $0.69/M                                 400k  openai.com ↗
133  MiniMax-M2.7                              67±1   api $0.53/M +local    ~75GB                 205k  minimax.io ↗
134  Ornith 1.0 35B (35B-A3B)                  67±1   local                 ~23GB  ~103 tok/s     262k  LM Studio ›
135  Claude Opus 4                             67±1   comparison only
136  Gemini 2.5 Pro                            66±1   api $3.44/M                                   1M  google.dev ↗
137  Claude Opus 4.1                           66±1   comparison only
138  Hy3 preview (295B-A21B)                   66±1   local                ~629GB                       how to run ›
139  Gemma 4 31B                               66±1   api $0.19/M +local    ~24GB   ~11 tok/s     262k  deepinfra.com ↗
140  Kimi K2 Thinking                          66±1   api $1.07/M +local   ~160GB                 262k  aws.amazon.com ↗
141  Gemini 2.5 Pro Preview (0…                66±1   comparison only
142  Gemini 2.5 Pro Preview (0…                66±2   comparison only
143  K-EXAONE 2.0 (750B-A37B)                  66±1†  local                ~791GB                 262k  how to run ›
144  Gemini 3.1 Flash-Lite                     66±1   api $0.56/M                                   1M  google.dev ↗
145  Qwen3.7 Flash                             66±1   api $0.055/M                                  1M  alibabacloud.co…
146  Laguna M.1                                66±2   api price unknown…   ~135GB                 262k  huggingface.co ↗
147  DeepSeek V3.1 Terminus                    66±1   local                ~230GB                 164k  llama.cpp ›
148  DeepSeek V3.2 Exp                         66±1   local                ~726GB                       how to run ›
149  Kimi K2 Instruct (0711)                   66±1   api $1.00/M +local   ~152GB                 131k  novita.ai ↗
150  o1 (2024-12-17)                           66±1   api $26.25/M                                200k  openai.com ↗
151  GigaChat 3.5 Ultra Reason…                66±1†  local                ~461GB                 262k  how to run ›
152  o4-mini                                   66±1   api $1.93/M                                 200k  openai.com ↗
153  Qwen3 235B-A22B Thinking …                66±1   api $0.97/M +local    ~76GB                 131k  novita.ai ↗
154  Qwen3.5 35B-A3B                           66±0   api $0.35/M +local    ~21GB   ~50 tok/s     262k  deepinfra.com ↗
155  Step 3.7 Flash (198B-A11B)                66±1   api $0.44/M +local   ~104GB                 256k  stepfun.ai ↗
156  Grok 4.1 Fast (Reasoning)                 66±1   api $0.28/M                                 128k  azure.microsoft…
157  LongCat-Flash-Chat (560B-…                65±1   local                ~333GB                 128k  LM Studio ›
158  DeepSeek V3.1                             65±1   api $0.42/M +local   ~110GB                 131k  deepinfra.com ↗
159  GLM-4.6                                   65±1   api $1.00/M +local    ~58GB                 205k  z.ai ↗
160  Qwen3.6 Flash                             65±1   api $0.56/M                                   1M  alibabacloud.co…
161  Qwen3-Max (2025-09-23)                    65±1   api $2.40/M                                 262k  alibabacloud.co…
162  MiniMax-M2.5                              65±1   api $0.53/M +local    ~75GB                 205k  minimax.io ↗
163  o3-mini                                   65±1   api $1.93/M                                 200k  openai.com ↗
164  Claude Sonnet 4                           65±1   comparison only
165  MiMo-V2-Flash (309B-A15B)                 65±1   local                ~103GB                       llama.cpp ›
166  DeepSeek R1 0528                          65±1   api $0.91/M +local   ~104GB                 164k  deepinfra.com ↗
167  Claude 3.7 Sonnet                         65±1   comparison only
168  MiniMax-M2.1                              65±1   local                 ~79GB                       llama.cpp ›
169  Spark-X2.5 4B                             65±1†  local                ~3.5GB  ~114 tok/s       1M  LM Studio ›
170  Nemotron Cascade 2 30B-A3B                65±1   local                 ~20GB   ~90 tok/s     256k  LM Studio ›
171  ChatGPT-4o (2025-03-26)                   65±2   comparison only
172  MiMo-V2.6-Distill-Qwen-9B                 64±2†  local                ~7.8GB                       LM Studio ›
173  Laguna XS 2.1 (33B-A3B)                   64±2†  local                 ~21GB                 262k  LM Studio ›
174  K-EXAONE (236B-A23B)                      64±1   local                ~152GB                 262k  llama.cpp ›
175  Qwen3 235B-A22B Instruct …                64±1   api $0.20/M +local    ~73GB   ~15 tok/s     262k  deepinfra.com ↗
176  Mistral Medium 3.5 (128B)                 64±1   api $3.00/M +local    ~43GB                 262k  mistral.ai ↗
177  INTELLECT-3                               64±1   local                 ~48GB                       llama.cpp ›
178  GLM-4.5                                   64±1   api $1.00/M +local    ~58GB                 131k  z.ai ↗
179  Qwen3.5 Flash                             64±1   api $0.17/M                                   1M  alibabacloud.co…
180  Mistral Medium 3.1 (2508)                 64±2   comparison only
181  MiniMax-M2                                64±1   api $0.53/M +local    ~75GB                 205k  aws.amazon.com ↗
182  Command A+ (05-2026)                      64±1   api price unknown…    ~71GB                 128k  cohere.com ↗
183  Claude Haiku 4.5                          64±1   api $2.00/M                                 200k  anthropic.com ↗
184  Nemotron 3 Super 120B-A12B                64±1   api $0.28/M +local    ~73GB   ~20 tok/s     262k  aws.amazon.com ↗
185  Laguna XS.2                               64±1   local                 ~21GB                 262k  LM Studio ›
186  Gemma 4 26B-A4B                           64±1   api $0.14/M +local    ~18GB   ~55 tok/s     262k  deepinfra.com ↗
187  EXAONE 4.5 33B                            64±2†  local                 ~24GB                 262k  llama.cpp ›
188  Solar Pro 4                               63±1   api $0.53/M                                 524k  upstage.ai ↗
189  Kimi K2 Instruct (0905)                   63±2   local                ~298GB                       llama.cpp ›
190  Qwen3-Coder 480B-A35B Ins…                63±1   api $0.67/M +local    ~78GB                 262k  novita.ai ↗
191  Qwen3-VL 235B-A22B Thinki…                63±1   local                ~106GB                 256k  LM Studio ›
192  DeepSeek R1 (Jan '25)                     63±1   api $4.00/M +local   ~104GB                 128k  together.ai ↗
193  o1-preview                                63±1   comparison only
194  Grok 3 Beta                               63±1   comparison only
195  Grok 3 Mini Beta                          63±1   comparison only
196  Qwen3-VL 235B-A22B Instru…                63±1   local                ~128GB                 256k  LM Studio ›
197  MiniCPM5 2B                               63±1†  local                ~2.4GB                 131k  LM Studio ›
198  Nemotron-Labs-3 Puzzle 75…                63±1†  local                 ~35GB                       llama.cpp ›
199  Qwen3-Next 80B-A3B Instru…                63±1   api $0.34/M +local    ~26GB   ~55 tok/s     131k  deepinfra.com ↗
200  Nova 2 Pro (Preview)                      63±2   api $3.78/M                                   1M  aws.amazon.com ↗
201  Gemini 2.5 Flash Preview …                63±1   comparison only
202  Qwen3-Next 80B-A3B Thinki…                63±1   api $0.41/M +local    ~25GB                 131k  alibabacloud.co…
203  Granite 4.2 30B                           63±1   api $0.28/M +local    ~19GB                 131k  deepinfra.com ↗
204  GPT-4.5 Preview                           63±1   comparison only
205  Gemini 2.5 Flash Preview …                63±1   comparison only
206  GPT-4.1                                   62±1   api $3.50/M                                   1M  openai.com ↗
207  GLM-4.5-Air                               62±1   api $0.42/M +local    ~35GB   ~23 tok/s     131k  z.ai ↗
208  Trinity-Large-Thinking                    62±2   api $0.39/M +local   ~141GB                 512k  arcee.ai ↗
209  Nemotron 3.5 Lightning 30…                62±2   api $0.087/M +loc…    ~20GB   ~64 tok/s     262k  fireworks.ai ↗
210  Seed-OSS 36B Instruct                     62±1   local                 ~23GB                 524k  LM Studio ›
211  Qwen3.5 9B                                62±0   api $0.11/M +local   ~6.7GB   ~22 tok/s     262k  deepinfra.com ↗
212  MiniMax-M1 (80k)                          62±1   api $0.96/M +local   ~959GB                   1M  novita.ai ↗
213  Gemma 4 12B                               62±1   local                ~9.2GB   ~29 tok/s     262k  LM Studio ›
214  GLM-4.6V                                  62±2   api $0.45/M +local    ~50GB                 128k  z.ai ↗
215  Magistral Medium 1.2 (250…                62±2†  comparison only                             128k
216  HyperCLOVA X SEED 32B Thi…                62±2†  comparison only                             128k
217  Gemini 2.5 Flash                          62±1   api $0.85/M                                   1M  google.dev ↗
218  Gemini 2.5 Flash Preview …                62±1   comparison only
219  Gemini 2.0 Flash-Lite (00…                62±2   comparison only
220  Qwen3-VL 32B Thinking                     62±1   api $0.28/M +local    ~22GB                 256k  alibabacloud.co…
221  gpt-oss-120b                              62±1   api $0.26/M +local    ~64GB   ~56 tok/s     131k  groq.com ↗
222  GPT-5 nano                                62±1   api $0.14/M                                 400k  openai.com ↗
223  Mistral Large 3 (675B-A41…                62±1   api $0.75/M +local   ~108GB                 262k  mistral.ai ↗
224  Apriel 1.6 15B Thinker                    62±1†  local                 ~10GB                       LM Studio ›
225  Devstral 2 (2512)                         62±2   local                 ~74GB                 256k  LM Studio ›
226  Gemini 2.5 Flash-Lite Pre…                62±2   comparison only
227  A.X K1 (519B-A33B)                        61±1†  local               ~1091GB                       how to run ›
228  o1-mini                                   61±1   comparison only
229  GLM-4.5V                                  61±2   api $0.90/M +local    ~69GB                  64k  z.ai ↗
230  Devstral Small 2 24B                      61±2   local                 ~16GB                 262k  llama.cpp ›
231  MiniMax-M1 (40k)                          61±1†  comparison only
232  Llama 3.1 Nemotron Ultra …                61±1   local                 ~82GB                 128k  llama.cpp ›
233  Gemini 2.0 Pro Experiment…                61±1   comparison only
234  Grok 4 Fast                               61±1   comparison only
235  DeepSeek V3 0324                          60±1   local                ~102GB                 164k  llama.cpp ›
236  Claude 3.5 Sonnet (2024-1…                60±1   comparison only
237  GPT-4.1 mini                              60±1   api $0.70/M                                   1M  openai.com ↗
238  Qwen3 30B-A3B Thinking 25…                60±1   api $0.75/M +local    ~19GB                 262k  alibabacloud.co…
239  Gemini 2.0 Flash (001)                    60±1   comparison only
240  Qwen3 30B-A3B Instruct 25…                60±1   api $0.15/M +local    ~19GB  ~100 tok/s     262k  tokenfactory.ne…
241  ERNIE 4.5 300B-A47B                       60±1†  local                 ~97GB                 131k  llama.cpp ›
242  Qwen3.5 4B                                60±1   local                ~3.8GB                 262k  llama.cpp ›
243  Mistral Medium 3 (2505)                   60±1   comparison only
244  Mellum2.1 12B-A2.5B Think…                60±1†  local                ~8.3GB                       LM Studio ›
245  Gemma 2 9B IT SimPO                       60±1   local                ~7.6GB                       llama.cpp ›
246  Gemma 2 9B IT DPO (Prince…                60±1   local                ~7.6GB                       llama.cpp ›
247  Falcon-H1R 7B                             60±1†  local                ~5.3GB                 262k  LM Studio ›
248  Nemotron-Cascade-14B-Thin…                60±1†  local                 ~10GB                       LM Studio ›
249  Qwen3-VL 32B Instruct                     60±1   api $0.28/M +local    ~22GB                 256k  alibabacloud.co…
250  DeepSeek V3 (Dec '24)                     60±1   api $0.46/M +local   ~337GB                 131k  deepinfra.com ↗
251  Qwen3 235B-A22B (Apr 2025…                60±0   api $1.23/M +local    ~73GB                 131k  alibabacloud.co…
252  Gemini 2.0 Flash-Lite Pre…                60±2   comparison only
253  Granite 4.2 8B                            59±1   api $0.11/M +local   ~6.8GB                 131k  wandb.ai ↗
254  Mistral Small 4 (119B-A6.…                59±2   api $0.26/M +local    ~37GB                 262k  mistral.ai ↗
255  QwQ-32B                                   59±1   local                 ~21GB                 131k  LM Studio ›
256  Solar Open 100B (102B-A12…                59±1†  local                 ~41GB                 131k  llama.cpp ›
257  Qwen3-VL 30B-A3B Thinking                 59±1   api $0.75/M +local    ~20GB                 256k  alibabacloud.co…
258  Trinity-Large-Preview                     59±2   local                ~155GB                       llama.cpp ›
259  OpenReasoning-Nemotron-32B                59±2†  local                 ~21GB                       LM Studio ›
260  Spark-X2.6 1.7B                           59±1†  local                ~3.4GB                   1M  llama.cpp ›
261  EXAONE 4.0 32B                            59±1   local                 ~20GB                 131k  LM Studio ›
262  Phi-4-reasoning-plus 14B                  59±1   local                 ~10GB                       LM Studio ›
263  GLM-4.7-Flash                             58±1   api $0.0000/M +lo…    ~18GB   ~44 tok/s     200k  z.ai ↗
264  Mercury 2                                 58±2   comparison only
265  gpt-oss-20b                               58±1   api $0.13/M +local    ~13GB   ~79 tok/s     131k  groq.com ↗
266  Olmo 3.1 32B Think                        58±1   local                 ~21GB                  66k  LM Studio ›
267  DiffusionGemma 26B-A4B                    58±1†  comparison only                             262k
268  Qwen3 14B                                 58±1   api $0.61/M +local    ~10GB                  33k  alibabacloud.co…
269  Llama 3.3 Nemotron Super …                58±2   local                 ~22GB                       llama.cpp ›
270  DeepSeek R1 Distill Llama…                58±1   api $0.80/M +local    ~30GB                 131k  novita.ai ↗
271  GPT-4o (2024-08-06)                       58±1   api $4.38/M                                 128k  openai.com ↗
272  Nemotron-Cascade-8B                       58±1†  local                ~6.3GB                       LM Studio ›
273  Command A (03-2025)                       58±1   api $4.38/M +local    ~37GB                 256k  azure.microsoft…
274  Olmo 3 32B Think                          58±1   local                 ~21GB                  66k  LM Studio ›
275  GPT-4o (2024-05-13)                       58±0   api $7.50/M                                 128k  openai.com ↗
276  Phi-4-reasoning 14B                       58±1   api $0.22/M +local    ~10GB                  33k  azure.microsoft…
277  Claude 3.5 Sonnet (2024-0…                58±0   comparison only
278  Nova 2 Lite                               58±1   api $0.94/M                                   1M  aws.amazon.com ↗
279  Magistral Small 1.2                       58±1   api $0.75/M +local    ~16GB                 131k  aws.amazon.com ↗
280  GPT-4o (2024-11-20)                       58±1   api $4.38/M                                 128k  openai.com ↗
281  Qwen3-VL 30B-A3B Instruct                 58±1   api $0.35/M +local    ~20GB                 256k  alibabacloud.co…
282  Qwen3-VL 8B Thinking                      58±1   api $0.66/M +local   ~6.9GB                 256k  alibabacloud.co…
283  Qwen3 32B                                 57±0   api $0.13/M +local    ~20GB                 131k  deepinfra.com ↗
284  Qwen3 Coder 30B-A3B Instr…                57±1   api $0.12/M +local    ~19GB   ~93 tok/s     160k  novita.ai ↗
285  Gemini 2.0 Flash Thinking…                57±1   comparison only
286  Qwen2.5-Max (2025-01-25)                  57±1   comparison only
287  Qwen2.5 Coder 32B Instruct                57±1   api $0.74/M +local    ~21GB                 131k  cloudflare.com ↗
288  Gemini 2.5 Flash-Lite                     57±2   api $0.17/M                                   1M  google.dev ↗
289  Llama 4 Maverick (402B-A1…                57±1   api $0.42/M +local    ~65GB                   1M  aws.amazon.com ↗
290  DeepSeek R1 0528 Qwen3 8B                 57±1   api $0.068/M +loc…   ~6.5GB   ~21 tok/s     128k  novita.ai ↗
291  Gemini 1.5 Pro Experiment…                57±1   comparison only
292  Granite 4.2 3B                            57±1   api $0.052/M +loc…   ~3.3GB                 131k  deepinfra.com ↗
293  Gemini 1.5 Pro (002)                      57±1   comparison only
294  Llama 3.3 Nemotron Super …                57±1   local                 ~18GB                 131k  llama.cpp ›
295  Nemotron 3 Nano 30B-A3B                   57±1   api $0.087/M +loc…    ~20GB   ~90 tok/s     262k  deepinfra.com ↗
296  Athene-V2-Chat 72B                        57±1   local                 ~44GB                  33k  LM Studio ›
297  Grok 2 (1212)                             57±1   comparison only
298  Granite 4.1 30B                           57±1†  local                 ~19GB   ~25 tok/s           Ollama ›
299  Nemotron-Cascade-8B-Think…                57±2   local                ~6.3GB                       LM Studio ›
300  Gemini 2.0 Flash Experime…                57±1   comparison only
301  Qwen2.5-Omni 7B                           57±2   local                ~5.8GB                       llama.cpp ›
302  Sky-T1 32B Preview                        57±4   local                 ~21GB                       LM Studio ›
303  Ministral 3 14B Reasoning…                57±1   local                 ~10GB                 262k  llama.cpp ›
304  Qwen Plus (2025-01-25)                    57±1   api $0.60/M                                 131k  alibabacloud.co…
305  DeepSeek-V2.5 (1210)                      56±1   local                 ~82GB                       llama.cpp ›
306  QED-Nano                                  56±2   local                ~4.1GB                 262k  llama.cpp ›
307  Mistral Small 3.2 24B                     56±1   api $0.11/M +local    ~15GB                 128k  deepinfra.com ↗
308  Qwen3 4B Thinking 2507                    56±1   local                ~4.2GB   ~67 tok/s     262k  LM Studio ›
309  GPT-4 Turbo (2024-04-09)                  56±0   api $15.00/M                                128k  openai.com ↗
310  Yi-Lightning                              56±1   api price unknown                            16k  lingyiwanwu.com…
311  Gemini 1.5 Pro Experiment…                56±1   comparison only
312  Qwen3-VL 4B Thinking                      56±1   local                ~4.4GB                 256k  llama.cpp ›
313  Qwen2.5 72B Instruct                      56±1   api $0.37/M +local    ~31GB                  33k  deepinfra.com ↗
314  Qwen2.5-VL 72B Instruct                   56±1   local                 ~46GB                  33k  LM Studio ›
315  Llama 3.1 405B Instruct                   56±1   api $2.40/M +local   ~160GB                 128k  aws.amazon.com ↗
316  Mistral Large 2 (2411)                    56±1   local                 ~77GB                 128k  llama.cpp ›
317  Qwen2.5 Coder 14B Instruct                56±1   local                 ~11GB   ~18 tok/s     131k  LM Studio ›
318  DeepSeek R1 Distill Qwen …                56±1   api $1.59/M +local    ~21GB  ~7.3 tok/s     131k  cloudflare.com ↗
319  Qwen2.5 32B Instruct                      56±1   local                 ~21GB                 131k  LM Studio ›
320  Qwen3 8B                                  56±1   api $0.31/M +local   ~6.3GB   ~25 tok/s      33k  alibabacloud.co…
321  DeepSeek R1 Distill Qwen …                56±1   local                 ~11GB   ~15 tok/s     131k  LM Studio ›
322  Magistral Medium 1.0 (250…                56±1   comparison only
323  Molmo 2 8B                                56±2   local                ~6.8GB                       llama.cpp ›
324  Nemotron Nano 9B v2                       55±1   api $0.10/M +local   ~7.6GB                 131k  aws.amazon.com ↗
325  EXAONE Deep 32B                           55±2†  local                 ~22GB                  33k  Ollama ›
326  Qwen3 4B Instruct 2507                    55±1   local                ~4.2GB  ~107 tok/s     262k  LM Studio ›
327  Ministral 3 14B                           55±1   api $0.20/M +local   ~9.1GB   ~46 tok/s     262k  mistral.ai ↗
328  Qwen3 30B-A3B (Apr 2025, …                55±0   api $0.35/M +local    ~18GB                  33k  alibabacloud.co…
329  Nova Premier                              55±2†  api $5.00/M                                   1M  aws.amazon.com ↗
330  Granite 4.1 8B                            55±1   api $0.11/M +local   ~7.1GB   ~70 tok/s     131k  replicate.com ↗
331  Magistral Small 1.0 (2506)                55±1   local                 ~16GB                 128k  LM Studio ›
332  Bielik 11B v3.0 Instruct                  55±2   local                ~8.1GB                       LM Studio ›
333  Qwen2.5-Math 72B Instruct                 55±2†  local                 ~44GB                   4k  LM Studio ›
334  Llama 3.3 70B Instruct                    55±1   api $0.72/M +local    ~25GB   ~13 tok/s     128k  aws.amazon.com ↗
335  Magistral Medium 1.1 (250…                55±1†  comparison only                              40k
336  Qwen3-VL 8B Instruct                      55±1   api $0.31/M +local   ~6.9GB                 256k  alibabacloud.co…
337  Mistral Large 2 (2407)                    55±1   local                 ~45GB                 128k  llama.cpp ›
338  Falcon-H1 34B Instruct                    55±3   local                 ~23GB                 262k  llama.cpp ›
339  Llama 4 Scout (109B-A17B)                 55±1   api $0.15/M +local    ~36GB   ~19 tok/s     328k  deepinfra.com ↗
340  GPT-4 Turbo Preview (1106)                55±1   comparison only
341  Llama 3.1 Tulu 3 70B                      55±1   local                 ~43GB                 131k  LM Studio ›
342  Bielik 11B v2.6 Instruct                  55±3   local                ~8.1GB                       LM Studio ›
343  GigaChat 3.5 Ultra Instru…                55±1†  local                ~457GB                 262k  how to run ›
344  Mistral Small 3.1 24B (25…                55±1   local                 ~16GB                 128k  llama.cpp ›
345  Pixtral Large (2411)                      55±3   local                 ~51GB                       llama.cpp ›
346  Olmo 3.1 32B Instruct                     55±2   local                 ~21GB                  66k  LM Studio ›
347  Spark-X2.5 1.7B                           55±1†  local                ~1.9GB  ~166 tok/s       1M  llama.cpp ›
348  GPT-4 Turbo Preview (0125)                55±1   comparison only
349  DeepSeek-V2.5                             55±1   local                ~151GB                 164k  Ollama ›
350  OpenThinker2 32B                          55±1   local                 ~21GB                  33k  LM Studio ›
351  Command A Reasoning (08-2…                55±2   local                 ~34GB                       llama.cpp ›
352  DeepSeek-V2 Chat (0628)                   55±1   local                 ~66GB                       llama.cpp ›
353  OpenThinker 32B                           55±1†  local                 ~21GB                  33k  LM Studio ›
354  Claude 3.5 Haiku                          54±1   comparison only
355  Magistral Small 1.1 (2507)                54±1†  local                 ~16GB                  40k  LM Studio ›
356  Ministral 3 8B Reasoning …                54±1   local                ~6.5GB                 262k  LM Studio ›
357  Llama 3.1 Tulu 3 70B DPO                  54±1   local                 ~22GB                 131k  llama.cpp ›
358  Gemini 1.5 Flash Experime…                54±1   comparison only
359  Mellum2 12B-A2.5B Thinking                54±1†  local                ~8.6GB                 131k  LM Studio ›
360  Nemotron 3 Nano 4B                        54±1   local                ~2.9GB   ~52 tok/s     262k  LM Studio ›
361  GPT-4o mini (2024-07-18)                  54±0   api $0.26/M                                 128k  openai.com ↗
362  Gemini 1.5 Pro (001)                      54±1   comparison only
363  DeepSeek-Coder-V2 Instruc…                54±1   local                 ~92GB                       llama.cpp ›
364  DeepSeek-Coder-V2 Instruc…                54±1   local                ~151GB                       llama.cpp ›
365  Mistral Small 3 24B (2501)                54±1   local                 ~15GB                  32k  LM Studio ›
366  GPT-4 (0314)                              54±1   comparison only
367  Gemini 1.5 Flash (002)                    54±1   comparison only
368  Qwen Turbo (2024-11-01)                   54±2   comparison only
369  GLM-4 9B Chat 1M                          54±4   local                ~8.1GB                   1M  llama.cpp ›
370  EXAONE Deep 7.8B                          54±2†  local                ~6.5GB                  33k  llama.cpp ›
371  Claude 3 Opus                             54±0   comparison only
372  Qwen2-VL 72B Instruct                     54±1   local                 ~34GB                       llama.cpp ›
373  Hermes 3 Llama 3.1 405B                   54±1   local                ~114GB                 131k  llama.cpp ›
374  Yi-Large Preview                          54±1   comparison only
375  Llama 3.1 70B Instruct                    53±0   api $0.72/M +local    ~27GB                 128k  aws.amazon.com ↗
376  Gemma 3 27B                               53±1   api $0.10/M +local    ~19GB                 131k  deepinfra.com ↗
377  Qwen2.5-VL 32B Instruct                   53±2   local                 ~23GB                  33k  LM Studio ›
378  Phi-4 14B                                 53±1   api $0.087/M +loc…    ~10GB                  16k  deepinfra.com ↗
379  GPT-4.1 nano                              53±1   api $0.17/M                                   1M  openai.com ↗
380  GLM-4 (0520)                              53±1   comparison only
381  Bielik 11B v2.1 Instruct                  53±3   local                ~8.5GB                       llama.cpp ›
382  Qwen2.5-Math 7B Instruct                  53±2†  local                ~5.4GB                   4k  LM Studio ›
383  s1.1 32B                                  53±1   local                 ~22GB                  33k  LM Studio ›
384  Ministral 3 8B                            53±1   api $0.15/M +local   ~6.5GB   ~68 tok/s     262k  mistral.ai ↗
385  Olmo 3 7B Think                           53±1   local                ~5.8GB                  66k  LM Studio ›
386  Gemma 4 E4B                               53±1   local                ~6.4GB   ~21 tok/s     131k  LM Studio ›
387  Llama 3.1 Nemotron 70B In…                53±1   local                 ~43GB                 128k  LM Studio ›
388  Qwen3-VL 4B Instruct                      53±1   local                ~4.4GB                 256k  llama.cpp ›
389  GPT-4 (0613)                              53±1   api $37.50/M                                  8k  openai.com ↗
390  Bielik 11B v2.2 Instruct                  53±3   local                ~8.5GB                       llama.cpp ›
391  Llama 3.1 Nemotron 51B In…                53±2   local                 ~34GB                       llama.cpp ›
392  Nemotron-4 340B Instruct                  53±2   comparison only
393  ERNIE 4.5 21B-A3B                         53±1   comparison only
394  Palmyra X4 (palmyra-x-004)                53±3   comparison only
395  LFM2.5 2.6B                               53±1   local                ~2.3GB                 131k  LM Studio ›
396  Granite 4.0 H Small (32B-…                53±1   api $0.11/M +local    ~21GB                 131k  replicate.com ↗
397  Qwen2.5 Coder 7B Instruct                 53±1   local                ~5.4GB  ~3.8 tok/s     131k  LM Studio ›
398  Aya Expanse 32B                           53±2   api $0.75/M +local    ~22GB                 128k  cohere.com ↗
399  OpenCoder-8B-Instruct                     53±1   local                ~6.4GB                       llama.cpp ›
400  Gemma 3 12B                               52±1   api $0.075/M +loc…    ~10GB   ~13 tok/s     131k  deepinfra.com ↗
401  Qwen2.5 14B Instruct                      52±1   local                 ~11GB                 131k  LM Studio ›
402  LFM2.5 8B-A1B                             52±1   local                ~5.5GB  ~174 tok/s     128k  LM Studio ›
403  Yi-Large                                  52±1   comparison only
404  Llama-3-Instruct-8B-SimPO…                52±1   local                ~6.6GB                       llama.cpp ›
405  Cogito v1 Preview Llama 8B                52±4   local                ~6.2GB                 128k  LM Studio ›
406  Llama-3-Instruct-8B-SimPO                 52±1   local                ~6.6GB                       llama.cpp ›
407  Athene-70B                                52±1   local                 ~29GB                       llama.cpp ›
408  Jamba 1.5 Large                           52±1   local                ~839GB                       how to run ›
409  Qwen2 72B Instruct                        52±1   local                 ~33GB                 131k  llama.cpp ›
410  CodeQwen1.5 7B Chat                       52±1   local                ~6.4GB                  64k  llama.cpp ›
411  Command A Translate (08-2…                52±4†  api price unknown                             8k  cohere.com ↗
412  OpenCodeInterpreter-DS-33B                51±1   local                 ~22GB                       LM Studio ›
413  Flan-U-PaLM 540B                          51±1†  never released
414  Gemini 1.5 Flash (001)                    51±1   comparison only
415  Bielik 11B v2.0 Instruct                  51±3   local                ~8.5GB                       llama.cpp ›
416  LFM2 24B-A2B                              51±1   local                 ~14GB                  33k  LM Studio ›
417  Qwen3 4B                                  51±1   local                  ~4GB                  33k  LM Studio ›
418  DeepSeek-Coder 33B Instru…                51±1   local                 ~21GB                  16k  LM Studio ›
419  GLM-4 (0116)                              51±1   comparison only
420  Codestral 22B v0.1                        51±1   local                 ~15GB                  32k  LM Studio ›
421  Gemma 2 27B IT                            51±1   local                 ~19GB                   8k  LM Studio ›
422  Llama 3 70B Instruct                      51±0   local                 ~24GB                   8k  llama.cpp ›
423  Llama 3.2 90B Vision Inst…                51±1   local                 ~58GB                 128k  Ollama ›
424  WizardCoder 33B V1.1                      51±1   local                 ~22GB                  16k  llama.cpp ›
425  Bielik 11B v2.3 Instruct                  51±2   local                ~8.6GB                       llama.cpp ›
426  Flan-PaLM 540B                            51±1†  never released
427  Llama-3-8B-ProLong-512k-I…                51±4   local                 ~35GB                       how to run ›
428  Nova Pro                                  51±1   api $1.40/M                                 300k  aws.amazon.com ↗
429  OpenCodeInterpreter-DS-6.…                51±1   local                ~5.8GB                       llama.cpp ›
430  Qwen2-Math 72B Instruct                   51±1   local                 ~32GB                   4k  llama.cpp ›
431  WizardLM-2 8x22B                          51±1   local                 ~91GB                       Ollama ›
432  Mistral Small Instruct 22…                51±2   local                 ~15GB                  32k  LM Studio ›
433  OpenThinker3 7B                           51±1   local                  ~6GB                  33k  LM Studio ›
434  Granite 4.1 3B                            51±1†  local                ~3.7GB  ~131 tok/s           Ollama ›
435  Artigenz-Coder-DS-6.7B                    51±1   local                ~5.8GB                       llama.cpp ›
436  Mellum2 12B-A2.5B Instruct                51±2†  local                ~7.6GB                 131k  LM Studio ›
437  Molmo 72B (0924)                          50±2   local                ~309GB                       how to run ›
438  Yi 34B 200K (base)                        50±4   local                 ~23GB                 200k  llama.cpp ›
439  Hermes 3 Llama 3.1 70B                    50±1   local                 ~43GB                 131k  Ollama ›
440  speechless-codellama-34b-…                50±1   local                 ~23GB                       llama.cpp ›
441  OLMo 2 32B Instruct (0325)                50±1   local                 ~21GB                       LM Studio ›
442  Ministral 3 3B Reasoning …                50±1   local                ~3.4GB                 262k  LM Studio ›
443  Aya 23 35B                                50±2   local                 ~22GB                   8k  LM Studio ›
444  AceReason-Nemotron-1.0-14B                50±2†  local                 ~10GB                       LM Studio ›
445  Claude 3 Sonnet                           50±0   comparison only
446  Qwen2.5-VL 7B Instruct                    50±1   local                ~5.8GB                       llama.cpp ›
447  Mixtral 8x22B Instruct v0…                50±1   local                 ~56GB                  64k  llama.cpp ›
448  Magicoder-S-DS 6.7B                       50±1   local                ~5.8GB                       llama.cpp ›
449  EXAONE Deep 2.4B                          50±2†  local                ~3.2GB                  33k  Ollama ›
450  Pixtral 12B (2409)                        50±2   local                ~9.6GB                       llama.cpp ›
451  Nova Lite                                 50±2   api $0.10/M                                 300k  aws.amazon.com ↗
452  XwinCoder-34B                             50±1   local                 ~23GB                       llama.cpp ›
453  Qwen2.5 7B Instruct                       50±1   api $0.30/M +local   ~5.4GB   ~54 tok/s     131k  together.ai ↗
454  LFM2.5 1.2B Thinking                      50±2   local                ~1.3GB                  33k  LM Studio ›
455  Yi-Coder 9B Chat                          50±1   local                ~6.3GB                 128k  LM Studio ›
456  InternLM2.5 7B Chat                       50±2   local                ~6.1GB                       LM Studio ›
457  StarChat2 15B v0.1                        50±1   local                 ~12GB                  16k  llama.cpp ›
458  Code Millenials 34B                       50±1   local                 ~23GB                       llama.cpp ›
459  Qwen2-Math 7B Instruct                    50±2†  local                  ~6GB                   4k  LM Studio ›
460  WaveCoder-Ultra-6.7B                      50±1   local                ~5.8GB                       llama.cpp ›
461  Reka Core (2024-05-01)                    50±1   comparison only
462  GPT-4o Audio Preview (202…                49±2   comparison only
463  MegaBeam-Mistral-7B-512k                  49±4   local                ~5.9GB                       llama.cpp ›
464  Gemini 1.5 Flash-8B (001)                 49±2   comparison only
465  Phi-3.5-MoE-instruct                      49±1   local                 ~25GB                 128k  LM Studio ›
466  Qwen3-VL 2B Thinking                      49±1   local                ~2.7GB                 256k  llama.cpp ›
467  Gemma 3n E4B                              49±1   local                ~5.6GB                  32k  llama.cpp ›
468  Claude 3 Haiku                            49±0   comparison only
469  DeepSeek-Coder 7B Instruc…                49±1   local                ~5.9GB                       llama.cpp ›
470  OpenThinker2 7B                           49±2†  local                ~6.4GB                  33k  llama.cpp ›
471  DeepSeek-Coder 6.7B Instr…                49±1   local                ~8.8GB                  16k  llama.cpp ›
472  Qwen2 57B-A14B Instruct                   49±2   local                 ~35GB                  33k  LM Studio ›
473  Hermes 2 Theta Llama-3 70B                49±2   local                 ~47GB                   8k  llama.cpp ›
474  MiniCPM3-4B                               49±2   local                  ~4GB                  32k  LM Studio ›
475  Granite 4.0 H Tiny (7B-A1…                49±1   local                ~4.5GB   ~12 tok/s     131k  LM Studio ›
476  Claude 1.3                                49±1   comparison only
477  Yi-1.5 34B (base)                         49±2   local                 ~22GB                   4k  LM Studio ›
478  Bielik 4.5B v3.0 Instruct                 49±2   local                ~4.3GB                       LM Studio ›
479  Qwen2.5 Coder 3B Instruct                 49±1   local                ~2.6GB  ~9.5 tok/s      33k  LM Studio ›
480  GPT-4o mini Audio Preview…                49±2   comparison only
481  Gemma 2 9B IT                             49±1   local                ~8.9GB                   8k  LM Studio ›
482  WhiteRabbitNeo-33B-v1                     49±1   local                 ~22GB                       llama.cpp ›
483  Qwen1.5 110B Chat                         48±1   local                 ~45GB                  32k  llama.cpp ›
484  Command R Plus (08-2024)                  48±1   api $4.38/M +local    ~63GB                 128k  cohere.com ↗
485  GLM-4 9B Chat                             48±2   local                ~7.1GB                 128k  Ollama ›
486  Magicoder-S-CL-7B                         48±1   local                ~5.8GB                       llama.cpp ›
487  speechless-coder-ds-6.7b                  48±1   local                ~5.8GB                       llama.cpp ›
488  Phind CodeLlama 34B v2                    48±1   local                 ~23GB                  16k  Ollama ›
489  AceReason-Nemotron-1.1-7B                 48±2†  local                  ~6GB                       LM Studio ›
490  Jamba 1.5 Mini                            48±1   local                 ~34GB                       llama.cpp ›
491  DeepSeek R1 Distill Qwen …                48±1   local                ~5.4GB   ~35 tok/s     131k  LM Studio ›
492  U-PaLM 540B                               48±1†  never released
493  GPT-3.5 Turbo (0125)                      48±1   api $0.75/M                                  16k  openai.com ↗
494  Mistral Large (2402)                      48±1   comparison only
495  InternVL2-26B                             48±2   local                 ~55GB                       how to run ›
496  Aya Expanse 8B                            48±2   local                ~6.4GB                   8k  LM Studio ›
497  EuroLLM 9B Instruct                       48±2   local                ~6.9GB                   4k  LM Studio ›
498  Flan-UL2 20B                              48±4   comparison only
499  GPT-3.5 Turbo (1106)                      48±1   comparison only
500  Granite 4.0 H Micro 3B                    48±1   local                ~3.4GB                 131k  LM Studio ›
501  Minerva 540B                              48±1†  never released
502  Code Llama 70B Instruct                   48±1   local                 ~28GB                  16k  llama.cpp ›
503  Command R (08-2024)                       48±1   api $0.26/M +local    ~21GB                 128k  cohere.com ↗
504  OLMo 2 13B Instruct (1124)                48±1   local                ~9.6GB                   4k  LM Studio ›
505  InternLM2.5 7B Chat 1M                    48±4   local                ~6.4GB                       llama.cpp ›
506  Falcon-H1 7B Instruct                     48±3   local                  ~6GB                 262k  LM Studio ›
507  GPT-3.5 Turbo (0301)                      47±1   comparison only
508  Llama 3 70B (base)                        47±2   local                 ~43GB                       LM Studio ›
509  Tulu 2 70B                                47±2†  local                 ~28GB                       llama.cpp ›
510  CogVLM2 Llama3 Chinese Ch…                47±7†  comparison only
511  Hermes 2 Pro Llama 3 8B                   47±3   local                ~6.6GB                   8k  llama.cpp ›
512  MedGemma 4B IT                            47±2   local                ~4.1GB                       llama.cpp ›
513  Nova Micro                                47±2   api $0.061/M                                128k  aws.amazon.com ↗
514  Qwen3.5 2B                                47±1   local                ~2.2GB  ~137 tok/s     262k  llama.cpp ›
515  Claude 2.0                                47±1   comparison only
516  Yi 1.5 34B Chat                           47±1   local                 ~22GB                   4k  LM Studio ›
517  OpenChat 3.5 0106                         47±1   local                ~6.1GB                   8k  llama.cpp ›
518  GPT-3.5 Turbo (0613)                      47±1   comparison only
519  WizardCoder Python 34B V1…                47±1   local                 ~22GB                  16k  Ollama ›
520  Codex code-davinci-002 (G…                47±0   comparison only
521  Granite 4.0 Micro 3B                      47±1   local                ~3.5GB  ~6.2 tok/s     131k  LM Studio ›
522  Gemma 4 E2B                               47±1   api $0.050/M +loc…   ~4.5GB                 131k  aws.amazon.com ↗
523  Gemini 1.0 Pro (001)                      47±2   comparison only
524  DBRX Instruct                             47±1   local                 ~85GB                  32k  Ollama ›
525  Mistral Medium (2312)                     47±1   comparison only
526  Granite 34B Code Instruct…                47±1   local                 ~22GB                       Ollama ›
527  Cogito v1 Preview Llama 3B                47±4   local                ~3.4GB                 128k  LM Studio ›
528  Qwen2.5-Math 1.5B Instruct                47±2†  local                ~1.8GB                   4k  LM Studio ›
529  EXAONE 4.0 1.2B                           47±1†  local                ~2.2GB                  66k  LM Studio ›
530  InternLM2.5 20B Chat                      47±2   local                 ~14GB                  33k  llama.cpp ›
531  StarCoder2-15B-Instruct-v…                47±1   local                 ~11GB                  16k  Ollama ›
532  Flan-cont-PaLM 62B                        47±1†  never released
533  Qwen1.5 72B Chat                          47±1   local                 ~31GB                  32k  llama.cpp ›
534  speechless-starcoder2-15b                 47±1   local                 ~12GB                       llama.cpp ›
535  OpenChat 3.5 0106 Gemma                   47±2   local                ~6.9GB                   8k  llama.cpp ›
536  Granite 3.3 8B Instruct                   47±1   local                ~6.3GB                 128k  LM Studio ›
537  Phi-3 Medium 128K Instruct                47±1   local                 ~10GB                 128k  LM Studio ›
538  Qwen2-VL 7B Instruct                      47±1   local                ~5.8GB                       LM Studio ›
539  PaLM 540B                                 47±0†  never released
540  Claude 2.1                                47±1   comparison only
541  Zephyr ORPO 141B-A35B v0.1                47±2   local                 ~56GB                  66k  llama.cpp ›
542  LFM2 8B-A1B                               47±1   comparison only
543  DeepSeek R1 Distill Llama…                46±1   local                ~6.2GB                 131k  LM Studio ›
544  Phi-3-medium-4k-instruct                  46±1   local                 ~10GB                   4k  LM Studio ›
545  QwQ-32B-Preview                           46±2   local                 ~21GB                  33k  LM Studio ›
546  Mistral Small (2402)                      46±1   comparison only
547  Minerva 62B                               46±2†  never released
548  Phi-4-mini-reasoning 3.8B                 46±2   api $0.13/M +local     ~4GB                 128k  azure.microsoft…
549  DeepSeek-Coder-V2 Lite In…                46±1   local                ~9.6GB                 128k  LM Studio ›
550  Qwen2-Math 1.5B Instruct                  46±2†  local                ~2.4GB                   4k  LM Studio ›
551  Llama 3.1 8B Instruct                     46±0   api $0.22/M +local   ~6.2GB   ~47 tok/s     128k  aws.amazon.com ↗
552  Ministral 3 3B                            46±1   api $0.10/M +local   ~3.4GB  ~128 tok/s     262k  mistral.ai ↗
553  Olmo 3 7B Instruct                        46±1   local                ~5.8GB                  66k  LM Studio ›
554  GPT-3.5 text-davinci-003                  46±1   comparison only
555  Command R Plus (04-2024)                  46±1   local                 ~43GB                 128k  llama.cpp ›
556  Mistral NeMo Instruct (24…                46±1   local                ~8.8GB                 128k  LM Studio ›
557  GPT-4o Audio Preview (202…                46±2   comparison only
558  Llama 3.1 Tulu 3 8B                       46±1   local                ~6.2GB                 131k  LM Studio ›
559  Phi-3-mini-4k-instruct (J…                46±1   local                ~5.7GB                       LM Studio ›
560  Yi 1.5 9B Chat                            46±1   local                ~6.8GB                   4k  LM Studio ›
561  Qwen1.5 32B Chat                          46±1   local                 ~22GB                  32k  llama.cpp ›
562  Xwin-LM 70B v0.1                          46±1   local                 ~28GB                       llama.cpp ›
563  Qwen2 7B Instruct                         46±1   local                ~5.4GB                 131k  LM Studio ›
564  Command R7B (12-2024)                     46±1   local                ~6.2GB                 128k  LM Studio ›
565  Eurus-2-7B-PRIME                          45±2   local                ~6.4GB                   4k  llama.cpp ›
566  Granite 20B Code Instruct…                45±1   local                 ~14GB                       Ollama ›
567  Dolphin 2.6 Mixtral 8x7B                  45±1   local                 ~29GB                       llama.cpp ›
568  Gemma 3 4B                                45±1   api $0.063/M +loc…   ~3.8GB   ~74 tok/s     131k  deepinfra.com ↗
569  Granite 3.0 8B Instruct                   45±1   local                ~6.6GB                   4k  llama.cpp ›
570  LLaVA-OneVision Qwen2 72B…                45±3   local                ~155GB                       how to run ›
571  Granite 8B Code Instruct …                45±1   local                ~6.6GB                       llama.cpp ›
572  Falcon3 7B Instruct                       45±2   local                ~5.9GB                  32k  LM Studio ›
573  Phi-4-mini 3.8B                           45±1   api $0.13/M +local     ~4GB                 128k  azure.microsoft…
574  Ministral 8B (2410)                       45±1   local                ~6.2GB                 128k  LM Studio ›
575  Code Llama 70B Python                     45±1   local                 ~28GB                  16k  llama.cpp ›
576  Code Tulu 2 34B                           45±2†  local                 ~72GB                       how to run ›
577  Granite 3.2 8B Instruct                   45±1   local                ~6.6GB                 131k  llama.cpp ›
578  OpenThinker 7B                            45±2†  local                  ~6GB                  33k  LM Studio ›
579  Falcon3 10B Instruct                      45±2   local                ~7.6GB   ~13 tok/s      32k  LM Studio ›
580  Yi 34B Chat                               45±1   local                 ~23GB                   4k  llama.cpp ›
581  Hermes 2 Theta Llama 3 8B                 45±2   local                ~6.6GB                   8k  llama.cpp ›
582  Llama 3.1 8B (base)                       45±3   local                ~6.2GB                       LM Studio ›
583  Gemma 3n E2B IT                           45±2   local                ~4.1GB                  32k  llama.cpp ›
584  Code Llama 70B (base)                     45±1   local                 ~28GB                  16k  llama.cpp ›
585  Phi-3.5-mini-instruct                     45±1   local                ~5.7GB                 128k  LM Studio ›
586  Qwen2.5-VL 3B Instruct                    45±1   local                ~2.8GB                       llama.cpp ›
587  Qwen3 1.7B                                45±1   local                ~2.6GB   ~96 tok/s      33k  LM Studio ›
588  Qwen3-VL 2B Instruct                      45±1   local                ~2.7GB                 256k  llama.cpp ›
589  LFM2.5 1.2B Instruct                      45±2   local                ~1.3GB                  33k  LM Studio ›
590  Claude Instant 1.1                        45±2   comparison only
591  Granite 3.1 8B Instruct                   44±1   local                ~6.7GB                 128k  llama.cpp ›
592  Reka Flash 21B (2024-02-2…                44±1   comparison only
593  GPT-3.5 text-davinci-002                  44±0   comparison only
594  Flan-PaLM 62B                             44±1†  never released
595  Qwen2.5 3B Instruct                       44±1   local                ~2.6GB   ~61 tok/s      33k  LM Studio ›
596  CogVLM2 Llama3 Chat 19B                   44±3   local                 ~43GB                       how to run ›
597  Llama 3.2 11B Vision Inst…                44±2   local                ~8.9GB                 128k  Ollama ›
598  LFM2 2.6B                                 44±1   local                  ~2GB                  33k  LM Studio ›
599  Tulu 2 DPO 70B                            44±1   local                 ~32GB                       llama.cpp ›
600  Phi-3-small-8k-instruct                   44±2   local                 ~17GB                       how to run ›
601  MiniCPM-V 2.6                             44±2   local                ~5.8GB                       llama.cpp ›
602  CodeGemma 7B IT (v1.0)                    44±1   local                ~7.1GB                       llama.cpp ›
603  Yi-1.5 9B (base)                          44±2   local                ~6.8GB                   4k  LM Studio ›
604  Claude Instant 1.2                        44±1   comparison only
605  Qwen2-Audio 7B Instruct                   44±3   local                ~6.5GB                       llama.cpp ›
606  DeepSeek-Coder 1.3B Instr…                44±1   local                ~2.9GB                  16k  Ollama ›
607  Aya 23 8B                                 44±3   local                ~6.2GB                   8k  LM Studio ›
608  Qwen2.5 Coder 1.5B Instru…                44±1   local                ~1.8GB                  33k  LM Studio ›
609  WizardLM 70B V1.0                         44±1   local                 ~32GB                       llama.cpp ›
610  Mathstral 7B v0.1                         44±1   local                ~5.6GB                  32k  LM Studio ›
611  SmolLM3 3B                                44±1   local                ~2.9GB                  66k  LM Studio ›
612  Hermes 3 Llama 3.1 8B                     44±1   local                ~6.6GB                 128k  llama.cpp ›
613  Llama 3 8B Instruct                       44±0   local                ~6.6GB                   8k  llama.cpp ›
614  Command R (03-2024)                       44±1   local                 ~33GB                 128k  llama.cpp ›
615  Aya Vision 32B                            44±3   api price unknown…    ~71GB                  16k  cohere.com ↗
616  WizardCoder Python 13B V1…                43±2   local                 ~15GB                  16k  llama.cpp ›
617  OpenChat 3.5                              43±1   local                ~6.1GB                   8k  llama.cpp ›
618  Granite 34B Code Base (8K)                43±1   local                 ~24GB                       llama.cpp ›
619  speechless-starcoder2-7b                  43±1   local                ~6.1GB                       llama.cpp ›
620  Falcon2 11B (base)                        43±3   local                ~8.2GB                   8k  Ollama ›
621  Snowflake Arctic Instruct                 43±2   local               ~1007GB                       how to run ›
622  OLMo 2 7B Instruct (1124)                 43±1   local                ~5.8GB                   4k  LM Studio ›
623  WizardCoder-15B-V1.0                      43±1   local                 ~12GB                       llama.cpp ›
624  Ministral 3B (2410)                       43±1   comparison only
625  Phi-3-vision-128k-instruct                43±2   local                 ~10GB                       how to run ›
626  cont-PaLM 62B (PaLM 62B t…                43±1†  never released
627  DeepSeek LLM 67B Chat                     43±1   local                 ~31GB                   4k  llama.cpp ›
628  Qwen1.5 14B Chat                          43±1   local                 ~11GB                  32k  Ollama ›
629  Llama 2 70B (base)                        43±1   local                 ~32GB                   4k  llama.cpp ›
630  Mixtral 8x7B v0.1 (base)                  43±1   local                 ~29GB                  32k  llama.cpp ›
631  Code Llama 34B Python                     43±1   local                 ~23GB                  16k  Ollama ›
632  DeepSeek-Coder 33B Base                   43±1   local                 ~22GB                  16k  llama.cpp ›
633  speechless-coding-7b-16k-…                43±1   local                 ~16GB                       how to run ›
634  InternVL2-4B                              43±2   local                 ~10GB                       how to run ›
635  InternLM2 Chat 20B                        43±1   local                 ~14GB                       llama.cpp ›
636  CodeQwen1.5 7B (base)                     42±1   local                ~6.4GB                  66k  llama.cpp ›
637  Nous Hermes 2 Mistral 7B …                42±3   local                ~6.1GB                  33k  llama.cpp ›
638  Mixtral 8x7B Instruct v0.1                42±0   local                 ~28GB                  32k  LM Studio ›
639  U-PaLM 62B                                42±2†  never released
640  Granite 4.0 1B                            42±1   local                ~2.4GB                 128k  LM Studio ›
641  OpenHermes-2.5-Code-290k-…                42±1   local                ~9.8GB                       llama.cpp ›
642  Granite 4.0 H 1B                          42±1   local                ~2.3GB                 131k  LM Studio ›
643  Nous Hermes 2 Mixtral 8x7…                42±2   local                 ~30GB                  33k  llama.cpp ›
644  Deita 7B v1.0                             42±2   local                 ~32GB                       how to run ›
645  Vicuna 13B v1.1                           42±2   comparison only
646  Molmo 7B-D (0924)                         42±1   local                 ~35GB                       how to run ›
647  OpenHermes 2.5 Mistral 7B                 42±1   local                ~5.9GB                       llama.cpp ›
648  Code Llama 34B Instruct                   42±1   local                 ~22GB                  16k  LM Studio ›
649  North Micro Vision Instru…                42±2†  local                ~3.8GB                 128k  how to run ›
650  Starling-LM 7B beta                       42±1   local                  ~6GB                   8k  LM Studio ›
651  Code Llama 34B (base)                     42±1   local                 ~23GB                  16k  Ollama ›
652  Vicuna 33B v1.3                           41±1   local                 ~23GB                   2k  Ollama ›
653  Phi-3-mini-128k-instruct …                41±2   local                ~9.5GB                       how to run ›
654  Bielik 1.5B v3.0 Instruct                 41±3   local                ~2.4GB                       LM Studio ›
655  Starling-LM 7B alpha                      41±1   local                ~6.1GB                   8k  llama.cpp ›
656  Code Tulu 2 13B                           41±2†  local                 ~29GB                       how to run ›
657  Mistral 7B Instruct v0.3                  41±1   local                ~5.6GB                  32k  LM Studio ›
658  LLaVA-v1.6-34B                            41±2   local                 ~24GB                   4k  Ollama ›
659  Granite 3.3 2B Instruct                   41±1†  local                  ~3GB                 128k  LM Studio ›
660  Llama3-OpenBioLLM-8B                      41±2   local                ~6.6GB                       llama.cpp ›
661  DeepSeek-Coder 6.7B Base                  41±1   local                ~8.8GB                  16k  llama.cpp ›
662  LFM2 1.2B                                 41±1   local                ~1.3GB                  33k  LM Studio ›
663  Granite 3.0 2B Instruct                   41±1   local                ~3.2GB                   4k  llama.cpp ›
664  Llama 2 70B Chat                          41±1   local                 ~32GB                   4k  llama.cpp ›
665  Granite 8B Code Base (4K)                 41±1   local                ~6.6GB                       llama.cpp ›
666  StarCoder2 15B                            41±1   local                 ~11GB                  16k  LM Studio ›
667  Llama 3.2 3B Instruct                     40±1   api $0.12/M +local   ~3.3GB  ~139 tok/s     131k  cloudflare.com ↗
668  Falcon-H1 3B Instruct                     40±3   local                ~3.4GB                 131k  LM Studio ›
669  Phi-2 (2.7B)                              40±1   local                ~4.7GB                   2k  LM Studio ›
670  speechless-code-mistral-7…                40±1   local                 ~17GB                       how to run ›
671  Llama-3-Instruct-8B-SimPO…                40±1   local                ~6.6GB                       llama.cpp ›
672  Qwen-14B-Chat                             40±1   local                 ~11GB                       llama.cpp ›
673  Code Llama 13B Instruct                   40±1   local                 ~15GB                  16k  llama.cpp ›
674  Tulu 2 13B                                40±2   local                ~9.8GB                       llama.cpp ›
675  Falcon-180B-Chat                          40±2   local                ~115GB                   2k  Ollama ›
676  MistralHermes-CodePro-7B-…                40±1   local                ~6.1GB                       llama.cpp ›
677  LLaMA 65B                                 40±1   comparison only
678  Phi-3-mini-4k-instruct (A…                40±2   local                  ~6GB                       llama.cpp ›
679  CodeGemma 7B (v1.0)                       40±1   local                ~7.1GB                       llama.cpp ›
680  Code Llama 13B Python                     40±1   local                ~9.8GB                  16k  llama.cpp ›
681  Apertus 8B Instruct (2509)                40±3   local                ~6.3GB                  66k  LM Studio ›
682  DeepSeek-V2 Lite Chat (16…                40±1   local                 ~11GB                  32k  LM Studio ›
683  Granite 3B Code Instruct …                40±1   local                ~3.7GB                       llama.cpp ›
684  Tulu 2 DPO 13B                            39±1   local                ~9.8GB                       llama.cpp ›
685  BioMistral-7B                             39±3   local                ~6.1GB                       llama.cpp ›
686  PaLM 62B                                  39±1†  never released
687  SOLAR 10.7B Instruct v1.0                 39±1   local                ~8.3GB                   4k  llama.cpp ›
688  Code Tulu 2 7B                            39±2†  local                 ~16GB                       how to run ›
689  Gemma 2 2B IT                             39±1   local                ~3.2GB                   8k  LM Studio ›
690  Yi-1.5 6B (base)                          39±3   local                ~5.1GB                   4k  LM Studio ›
691  Flan-T5 XXL                               39±1   local                 ~49GB                       how to run ›
692  Dolphin 2.2.1 Mistral 7B                  39±2   local                ~5.9GB                       llama.cpp ›
693  Gemma 1.1 7B IT                           39±1   local                ~7.1GB                   8k  llama.cpp ›
694  Phi-3.5-vision-instruct                   39±2   local                 ~10GB                       how to run ›
695  Granite 20B Code Base (8K)                39±1   local                 ~15GB                       llama.cpp ›
696  Granite 3.1 2B Instruct                   39±1   local                ~3.1GB                 128k  llama.cpp ›
697  Code Llama 7B Python                      39±1   local                ~5.8GB                  16k  llama.cpp ›
698  Qwen1.5 7B Chat                           39±1   local                ~9.7GB                  32k  llama.cpp ›
699  Granite 3.2 2B Instruct                   39±1   local                  ~3GB                 131k  LM Studio ›
700  Code Llama 13B (base)                     38±1   local                ~9.2GB                  16k  LM Studio ›
701  Falcon3 3B Instruct                       38±3   local                ~3.4GB                  32k  LM Studio ›
702  Qwen2.5 Coder 0.5B Instru…                38±1   local                  ~1GB                  33k  LM Studio ›
703  Vicuna 13B v1.5                           38±1   local                ~9.8GB                   4k  llama.cpp ›
704  Zephyr 7B alpha                           38±1   local                ~6.1GB                       llama.cpp ›
705  Yi 1.5 6B Chat                            38±2   local                ~4.4GB                   4k  LM Studio ›
706  WizardLM 13B V1.2                         38±1   local                ~9.8GB                       llama.cpp ›
707  Qwen2-VL 2B Instruct                      38±1   local                ~2.1GB                  33k  LM Studio ›
708  Qwen2.5 1.5B Instruct                     38±1   local                ~1.8GB   ~98 tok/s      33k  LM Studio ›
709  Mistral 7B Instruct v0.2                  38±1   local                ~5.8GB                  32k  LM Studio ›
710  Code Llama 7B Instruct                    38±1   local                ~5.5GB                  16k  LM Studio ›
711  Tulu 2 7B                                 38±2   local                ~5.8GB                       llama.cpp ›
712  Qwen3.5 0.8B                              38±1   local                ~1.4GB   ~94 tok/s     262k  llama.cpp ›
713  MPT-30B-Chat                              38±2   comparison only
714  LFM2 700M                                 38±1   local                  ~1GB                  33k  LM Studio ›
715  LLaMA 33B                                 38±1   comparison only
716  EXAONE 3.5 2.4B Instruct                  38±2   local                  ~3GB                  33k  LM Studio ›
717  xDAN-L1-Chat-RL-v1                        37±1   local                ~6.1GB                       llama.cpp ›
718  Flan-PaLM 8B                              37±1†  never released
719  Mistral 7B v0.1 (base)                    37±1   local                ~5.8GB                   8k  LM Studio ›
720  Llama 3 8B (base)                         37±1   local                ~6.6GB                       llama.cpp ›
721  Flan-T5 XL                                37±1   local                 ~14GB                       how to run ›
722  Gemma 7B (base)                           37±1   local                ~7.1GB                   8k  llama.cpp ›
723  Tulu 2 DPO 7B                             37±1   local                ~5.8GB                       llama.cpp ›
724  Vicuna 13B v1.3                           37±2   local                 ~29GB                   2k  how to run ›
725  Granite 3.0 3B-A800M Inst…                37±1   local                ~3.7GB                   4k  llama.cpp ›
726  Granite 3.1 3B-A800M Inst…                37±2†  local                ~3.6GB   ~23 tok/s     131k  llama.cpp ›
727  DeepSeek R1 Distill Qwen …                37±2   local                ~1.9GB                 131k  LM Studio ›
728  StarCoder2 7B                             37±1   local                ~5.4GB                  16k  LM Studio ›
729  Vicuna 7B v1.1                            37±2   comparison only
730  DeepSeek LLM 7B Chat                      37±2†  local                ~5.7GB                       Ollama ›
731  Falcon 40B (base)                         36±1   local                 ~27GB                   2k  Ollama ›
732  StarCoder 15.5B                           36±1   local                 ~11GB                       Ollama ›
733  Eurus-2-7B-SFT                            36±3†  local                ~6.4GB                       llama.cpp ›
734  Nous-Hermes-13b                           36±2   local                ~9.8GB                   2k  llama.cpp ›
735  Qwen3 0.6B                                36±1   local                ~1.9GB  ~182 tok/s      33k  LM Studio ›
736  PaLM 2 Chat (chat-bison@0…                36±2   comparison only
737  Code Llama 7B (base)                      36±1   local                ~5.5GB                  16k  LM Studio ›
738  Llama 2 13B (base)                        36±1   local                ~9.3GB                   4k  Ollama ›
739  Llama 2 13B Chat                          36±1   local                 ~15GB                   4k  llama.cpp ›
740  Zephyr 7B beta                            35±1   local                ~6.1GB                       llama.cpp ›
741  Guanaco 33B                               35±1   local                 ~70GB                       how to run ›
742  StarCoder2 3B                             35±1   local                ~3.4GB                  16k  llama.cpp ›
743  StarCoderBase 15.5B                       35±1   local                 ~12GB                       llama.cpp ›
744  Vicuna 7B v1.5                            35±1   local                ~5.8GB                   4k  llama.cpp ›
745  Granite 3B Code Base (2K)                 35±1   local                ~3.7GB                       llama.cpp ›
746  ChatGLM3 6B 128K                          35±4   local                ~5.8GB                 131k  llama.cpp ›
747  Minerva 8B                                35±2†  never released
748  OLMo 2 1B Instruct (0425)                 35±1   local                ~2.4GB                   4k  llama.cpp ›
749  Vicuna 7B v1.3                            35±2   local                ~5.8GB                   2k  llama.cpp ›
750  Stable Code 3B                            35±1   local                ~4.8GB                  16k  llama.cpp ›
751  Orca 2 13B                                35±3   local                ~9.8GB                   4k  llama.cpp ›
752  T0 11B                                    35±3   comparison only
753  DeepSeek-Coder 1.3B Base                  34±1   local                ~2.4GB                  16k  Ollama ›
754  Qwen1.5 4B Chat                           34±2   local                ~4.1GB                  32k  llama.cpp ›
755  Gemma 7B IT                               34±1   local                ~7.1GB                   8k  llama.cpp ›
756  Mistral 7B Instruct v0.1                  34±1   local                ~5.9GB                   8k  llama.cpp ›
757  GPT-3 text-davinci-001                    34±1   comparison only
758  LaMDA 137B (pre-trained, …                34±1†  never released
759  CodeGemma 2B (v1.0)                       34±1   local                ~3.2GB                       llama.cpp ›
760  Qwen2 1.5B Instruct                       34±1   local                ~1.8GB                  32k  LM Studio ›
761  Falcon-H1 1.5B Instruct                   33±4   local                ~2.4GB                 131k  LM Studio ›
762  Ghost 7B Alpha                            33±2   local                ~6.1GB                       llama.cpp ›
763  Gemma 3 1B                                33±1   local                ~1.7GB   ~98 tok/s      32k  LM Studio ›
764  SmolLM2 1.7B Instruct                     33±1   local                  ~3GB                   8k  LM Studio ›
765  Qwen-7B (base)                            33±1   local                ~6.6GB                  33k  llama.cpp ›
766  LFM2 350M                                 33±2   local                ~1.7GB                  33k  LM Studio ›
767  OPT-175B                                  33±1   comparison only
768  StarCoderBase 7B                          33±1   local                  ~6GB                       Ollama ›
769  BLOOMZ 176B                               33±2   comparison only
770  Phi-1.5 (1.3B)                            33±1   local                ~2.4GB                   2k  llama.cpp ›
771  Codex code-davinci-001                    33±1   comparison only
772  Llama 3.2 1B Instruct                     33±1   api $0.020/M +loc…   ~1.6GB   ~28 tok/s     131k  novita.ai ↗
773  LLaMA 13B                                 32±1   comparison only
774  Qwen-7B-Chat                              32±1   local                ~6.6GB                  33k  llama.cpp ›
775  Llama 2 7B Chat                           32±1   local                ~8.8GB                   4k  llama.cpp ›
776  OLMo 7B Instruct                          32±2   local                 ~16GB                       how to run ›
777  Llama 2 7B (base)                         32±1   local                ~8.5GB                   4k  Ollama ›
778  Koala 13B                                 32±1   comparison only
779  Flan-T5 Large                             32±1   local                ~4.8GB                       how to run ›
780  GPT-3 davinci (API base m…                32±1   comparison only
781  Falcon 40B Instruct                       31±2   local                 ~27GB                       Ollama ›
782  Granite 3.1 1B-A400M Inst…                31±2†  local                ~2.3GB   ~20 tok/s     131k  llama.cpp ›
783  Gemma 2B (base)                           31±1   local                ~3.2GB                   8k  llama.cpp ›
784  Gemma 1.1 2B IT                           31±1   local                ~3.2GB                   8k  llama.cpp ›
785  Falcon 7B (base)                          31±1   local                ~5.9GB                   2k  Ollama ›
786  Alpaca 7B                                 31±1   comparison only
787  Baichuan2-7B-Base                         30±1   local                 ~17GB                       how to run ›
788  LLaMA 7B                                  30±1   comparison only
789  NexusRaven V2 13B                         30±3   local                ~9.3GB                  16k  Ollama ›
790  MPT-7B (base)                             30±1   comparison only
791  ChatGLM3-6B                               30±2   local                ~5.8GB                       llama.cpp ›
792  Qwen2.5 0.5B Instruct                     30±2   local                  ~1GB                  33k  LM Studio ›
793  OLMo 7B                                   30±1†  local                 ~30GB                   2k  how to run ›
794  StableLM-3B-4E1T                          30±1   local                ~3.3GB                   4k  llama.cpp ›
795  StarCoderBase 3B                          30±1   local                ~3.4GB                       Ollama ›
796  OpenLLaMA 7B v2                           30±1   local                ~9.1GB                       llama.cpp ›
797  StableLM-Base-Alpha 7B v2                 30±1   local                 ~30GB                   4k  how to run ›
798  Granite 3.0 1B-A400M Inst…                30±1   local                ~2.3GB                   4k  llama.cpp ›
799  OPT-66B                                   29±1   local                ~141GB                   2k  how to run ›
800  MPT-7B-Chat                               29±2   comparison only
801  GPT4All-13B-Snoozy                        29±2   local                 ~56GB                       how to run ›
802  Alpaca 13B                                29±2   comparison only
803  EuroLLM 1.7B Instruct                     29±3   local                ~2.4GB                   4k  LM Studio ›
804  Granite 4.0 H 350M                        29±1†  local                ~1.7GB                  33k  LM Studio ›
805  BLOOMZ 7.1B                               29±2   comparison only
806  BLOOM 176B                                29±1   local                ~372GB                   2k  how to run ›
807  Gemma 2B IT                               29±1   local                ~3.1GB                   8k  llama.cpp ›
808  Granite 4.0 350M                          28±1   local                ~1.7GB                  32k  LM Studio ›
809  OPT-30B                                   28±1   local                 ~64GB                   2k  how to run ›
810  UL2 20B                                   28±3†  comparison only
811  Qwen2 0.5B Instruct                       28±2   local                  ~1GB                  32k  LM Studio ›
812  GPT-NeoX-20B                              28±1   local                 ~14GB                   2k  LM Studio ›
813  RedPajama-INCITE 7B Base                  28±1   local                 ~16GB                   2k  how to run ›
814  ChatGLM2-6B                               28±2   local                 ~15GB                       how to run ›
815  RWKV-4-Raven 14B                          27±2   comparison only
816  LaMDA 68B (pre-trained)                   27±1†  never released
817  BLOOMZ 3B                                 27±2   comparison only
818  Falcon3 1B Instruct                       26±4   local                ~2.4GB                   8k  LM Studio ›
819  Qwen1.5 1.8B Chat                         26±2   local                ~2.7GB                  33k  Ollama ›
820  Tk-Instruct 11B (def)                     26±4   comparison only
821  OPT-13B (13 billion param…                26±1   local                 ~29GB                   2k  how to run ›
822  PaLM 8B                                   26±1†  never released
823  Falcon 7B Instruct                        26±2   local                ~5.9GB                       Ollama ›
824  OpenAssistant SFT-4 Pythi…                25±1   local                ~9.5GB                       llama.cpp ›
825  Flan-T5 Base                              25±1   local                ~2.5GB                       how to run ›
826  RedPajama-INCITE Base 3B …                25±3   local                ~3.4GB                   2k  llama.cpp ›
827  GPT-3 curie (API base mod…                25±1   comparison only
828  Pythia 12B                                25±1   local                ~9.5GB                   2k  llama.cpp ›
829  GPT-J 6B                                  25±1   local                 ~14GB                   2k  how to run ›
830  OpenLLaMA 3B v2                           25±1   local                ~4.2GB                       llama.cpp ›
831  ChatGLM-6B                                25±1   local                 ~16GB                       how to run ›
832  StableLM-Base-Alpha 3B v2                 24±1   local                 ~13GB                   4k  how to run ›
833  OPT-6.7B                                  24±1   local                 ~16GB                   2k  how to run ›
834  T0 3B                                     23±4   comparison only
835  Qwen1.5 0.5B Chat                         23±3   local                ~1.7GB                  33k  LM Studio ›
836  BLOOMZ 1.7B                               23±3   comparison only
837  Pythia 6.9B                               23±1   local                ~6.1GB                   2k  llama.cpp ›
838  T0++ (T0pp) 11B                           23±3   comparison only
839  Phi-1 (1.3B)                              22±4   local                ~2.4GB                   2k  llama.cpp ›
840  Dolly v2 12B                              22±1   comparison only
841  SmolLM2 360M Instruct                     22±3   local                  ~1GB                   8k  LM Studio ›
842  FastChat-T5 3B                            21±2   local                ~8.5GB                       how to run ›
843  OLMo 1B                                   21±2†  local                ~2.2GB                   2k  llama.cpp ›
844  BLOOM 7.1B                                21±1   local                ~7.1GB                   2k  llama.cpp ›
845  Pythia 2.8B                               20±1   local                ~3.4GB                   2k  llama.cpp ›
846  Pythia 2.8B (deduped)                     20±1   local                ~3.4GB                   2k  llama.cpp ›
847  Falcon-RW 1B                              19±2   local                ~4.3GB                   2k  how to run ›
848  OPT-2.7B                                  19±1   local                ~7.1GB                   2k  how to run ›
849  GPT-Neo 2.7B                              18±1   local                 ~13GB                   2k  how to run ›
850  StableLM-Tuned-Alpha 7B                   18±2   local                ~6.9GB                       llama.cpp ›
851  BLOOMZ 1.1B                               18±3   comparison only
852  T5 Large                                  17±2   local                ~4.6GB                   1k  how to run ›
853  Gemma 3 270M IT                           16±4   local                ~1.1GB                  32k  LM Studio ›
854  Flan-T5 Small                             16±3   local                ~1.8GB                       how to run ›
855  BLOOM 3B                                  16±1   local                  ~4GB                   2k  llama.cpp ›
856  GPT-3 babbage (API base m…                15±1   comparison only
857  BLOOMZ 560M                               14±4   comparison only
858  OPT-1.3B                                  14±1   local                ~4.3GB                   2k  how to run ›
859  T5 Base                                   14±3   local                ~2.4GB                   1k  how to run ›
860  Pythia 1.4B                               14±1   local                ~2.4GB                   2k  llama.cpp ›
861  Pythia 1B                                 12±1   local                ~2.2GB                   2k  llama.cpp ›
862  LaMDA 8B (pre-trained)                    12±2†  never released
863  GPT-3 text-curie-001                      12±1   comparison only
864  GPT-Neo 1.3B                              12±2   local                ~7.1GB                   2k  how to run ›
865  T5 Small                                  12±3   local                ~1.8GB                   1k  how to run ›
866  BLOOM 1.7B                                11±1   local                ~3.1GB                   2k  llama.cpp ›
867  Zyte-1B                                   11±2   local                ~2.2GB                       llama.cpp ›
868  LaMDA 2B (pre-trained)                    10±2†  never released
869  StableLM-Base-Alpha 7B                     8±1   local                 ~35GB                   4k  how to run ›
870  Pythia 410M                                8±2   local                ~1.8GB                   2k  llama.cpp ›
871  GPT-3 ada (API base model)                 8±1   comparison only
872  BLOOM 1.1B                                 7±1   local                ~2.6GB                   2k  llama.cpp ›
873  GPT-2 XL (1.5B)                            7±1   local                ~2.8GB   ~75 tok/s       1k  llama.cpp ›
874  GPT-3 text-babbage-001                     4±2   comparison only
875  GPT-3 text-ada-001                         1±3   comparison only
876  OPT-350M                                   1±1   local                ~2.2GB                   2k  how to run ›
877  LaMDA 422M (pre-trained)                   1±3†  never released
878  StableLM-Base-Alpha 3B                     1±2   local                 ~17GB                   4k  how to run ›
879  BLOOM 560M                                 0±1   local                ~2.1GB                   2k  llama.cpp ›
880  Pythia 160M                               -2±2   local                ~1.6GB                   2k  llama.cpp ›
881  GPT-2 Large (774M)                        -3±1   local                  ~2GB  ~137 tok/s       1k  llama.cpp ›
882  OPT-125M                                  -3±1   local                ~1.8GB                   2k  how to run ›
883  GPT-Neo 125M                              -3±2   local                ~2.1GB                   2k  how to run ›
884  GPT-2 Medium (355M)                       -5±1   local                ~1.8GB                   1k  llama.cpp ›
885  GPT-2 Small (124M)                       -13±2   local                ~1.6GB                   1k  LM Studio ›
886  Pythia 70M                               -13±2   local                ~1.6GB                   2k  llama.cpp ›
  —  Grok Build 0.1              no reviewed results  api $1.25/M                                 256k  x.ai ↗
  —  K2 Horizon 7B                    not scored yet  local                  ~8GB                 524k  llama.cpp ›
  —  LFM2.5 24B-A2B               not yet calibrated  local                 ~17GB                 131k  llama.cpp ›
  —  LFM3 1.7B                    not yet calibrated  local                ~2.6GB                 262k  llama.cpp ›
  —  Mistral Large 4 (October …  no reviewed results  api price unknown…  ~2102GB                       mistral.ai ↗
\+ 308 models with fewer than 3 results aren't ranked here · [show them](https://whatmodel.sh/?thin=1) \* new or thinly tested: ranked on too few benchmark results · † no independently run results verified · ~RAM is estimated; full context may need more memory · 891 of 1230 catalogue models listed here · [sources and licences](pages/method.md#sources)
Models without a score (3) Raw results, insufficient overlap for an overall score: [Recursive Flint](pages/model/recursive-flint.md) · [LFM3 VL 2B](pages/model/lfm3-vl-2b.md) No reviewed benchmark results yet: Ling 3.1 Flash 1019
## About this repo whatmodel is an open-source AI leaderboard database. The data, scoring and ranking engine, and benchmark tools are available here. This README and [pages/](pages) are generated from the same data and code with `npm run pages`. An interactive version of the database can be found at [whatmodel.sh](https://whatmodel.sh). Every model has its own page showing what it's good at, how each test result compares with other models, and how to run it: A whatmodel.sh model page: ranks by task, each test compared with other models, and commands to run it | Path | Contents | |---|---| | `data/` | Models, benchmark results, prices, measured speeds and hardware. Every number links to its source. | | `data/extracts/` | Share-alike source extracts, published separately as their licences require | | `lib/` | The engine: scores (`score.ts`), memory fit and ranking (`fit.ts`), page data (`views.ts`), terminal output (`format.ts`), markdown pages (`markdown.ts`) | | `pages/` | The other leaderboards, the method and one page per model, generated | | `bench.sh`, `bench.py` | Interactive benchmark launcher and runner; see [BENCHMARKING.md](BENCHMARKING.md) | | `scripts/` | Checks, import, export, page generation and measurement scripts | | `licenses/` | Full licence notices for every source | | `docs/` | Source audit, validation and coverage reports | ### From your terminal ```sh curl "whatmodel.sh/?ram=32&gpu=apple" curl "whatmodel.sh/image?ram=64&gpu=card&vram=24&format=json" ``` | Parameter | Meaning | |---|---| | `ram`, `vram` | GB, or raw bytes / kB / MiB as the OS reports them | | `gpu` | `apple`, `card` (NVIDIA, AMD or Intel graphics card) or `none` | | `mac` | bytes, optionally followed by a newline and the chip name; implies Apple Silicon | | `nv` | `nvidia-smi --query-gpu=name,memory.total --format=csv,noheader` output | | `hw` | exact chip or card id from `data/hardware.json` | | `max` | highest price in the category's unit (LLMs: $ per 1M tokens, blended 3:1 in:out); `0` = local only | | `sort`, `dir` | `score`, `where`, `speed`, `ram` or `context`; `asc` or `desc` | | `set` | optional model-set filter; omitted = all sets, without changing the overall score scale | | `score` | `set` uses only the selected set’s evaluations; omitted = overall scores, with uncalibrated scores/ranks reported as null | | `all=1`, `n=20`, `format=json`, `color=1`, `chart=1` | show models that don't fit, row limit (text: 10, JSON: 40), JSON, ANSI colour, charts | | `width=120`, `help=1` | wider terminal table (default: 80 columns), concise command help | The same output runs from this repo, with no server: ```sh npm install npm run board -- "ram=32&gpu=apple" npm run board -- image "ram=64&gpu=card&vram=24" ``` ### How scores work Each category's score comes from a one-factor latent model fitted to the benchmark results, within sets of models that share enough benchmarks to be compared. It lives in `lib/score.ts` and is explained in [pages/method.md](pages/method.md). 50 is an average model, and ± is the uncertainty. `npm run check` reports how well the fit predicts results it hasn't seen. Sponsors never change rankings or scores. Sponsored spots on whatmodel.sh are always labelled, and you can check the ranking against the code here. ### Use the data - Read the JSON in `data/` directly, or run `npm run export` to write cleaned snapshots, CSV tables (scores, models, results, speeds and bench runs) and a SHA-256 manifest to `dist/data/`. They're the same files whatmodel.sh serves at [whatmodel.sh/data/manifest.json](https://whatmodel.sh/data/manifest.json). - The data is licensed [CC BY-SA 4.0](DATA-LICENSE.md): credit whatmodel.sh and share adaptations under the same licence. Each source's own licence also applies. `data/sources.json` lists them and `licenses/` has the full notices. ### The bench script The bench measures how fast models run on your machine. It finds the models and AI tools you have and the whatmodel.sh models that fit your memory; you tick what to test, confirm the plan, then review the measurements. It installs or downloads nothing without asking, and offers to set up Python if it's missing. Works on macOS and Linux; on Windows, run it in WSL. ```sh curl -fsSL https://whatmodel.sh/bench.sh | sh ``` Results stay local until you choose to open a prefilled GitHub issue. Review it and submit it yourself in the browser. API and agent tests may incur provider charges. See [BENCHMARKING.md](BENCHMARKING.md) for supported runners, measurement protocols and what the public report contains. Submitted results are released under CC0 1.0 and reviewed before they're added. ### Contributing Corrections and new results are welcome, and you don't need to write code. See [CONTRIBUTING.md](CONTRIBUTING.md). ### Contributors Thanks to everyone who has contributed: - [@sto0ka](https://github.com/sto0ka): bench results ([#8](https://github.com/jakemanger/whatmodel/issues/8)) - [@webdevtodayjason](https://github.com/webdevtodayjason): data ([#12](https://github.com/jakemanger/whatmodel/issues/12)) - [@Leo6432](https://github.com/Leo6432): data ([#13](https://github.com/jakemanger/whatmodel/issues/13)) ### Licences Code: [MIT](LICENSE). Data: [CC BY-SA 4.0](DATA-LICENSE.md). Bench results: CC0 1.0. Copyright 2026 Merlinsbeard Pty Ltd.