The open AI model leaderboard. Every model is ranked by one score built from 37,490 published benchmark results, with its price, the memory it needs and the command to run it.
Filter by your computer or budget at whatmodel.sh, or read the same leaderboard below. About this repo
# model score where RAM speed context get it 1 GPT-6 Astra 85±1 api $20.00/M 1.1M openai.com ↗ 2 Claude Opus 5.5 85±1 api $8.00/M 1M anthropic.com ↗ 3 GPT-6.1 Terra 84±1 api $2.00/M openai.com ↗ 4 Gemini 4 Carbon 83±1 limited preview 5 GPT-6.1 Sol 83±1 api $4.00/M 1.1M openai.com ↗ 6 Claude Fable 5.1 82±1 api $20.00/M 1M anthropic.com ↗ 7 Muse Wonder Full 82±1 Muse Code only 1M research.meta.a… 8 Claude Sonnet 5.5 82±1 api $4.00/M 1M claude.com ↗ 9 Gemini 4 Argon 81±1 api $4.00/M 1M google.dev ↗ 10 Claude Opus 5 81±1 api $10.00/M 1M anthropic.com ↗ 11 GPT-6 Sol 80±1 api $4.00/M 1.1M openai.com ↗ 12 GPT-5.5 Pro 80±1 api $67.50/M 1.1M openai.com ↗ 13 GPT-5.6 Sol 80±1 api $8.00/M 1.1M openai.com ↗ 14 Claude Fable 5 79±1 api $20.00/M 1M anthropic.com ↗ 15 Claude Mythos Preview (li… 79±1† limited preview 1M 16 GPT-5.4 Pro 79±1 api $67.50/M 1.1M openai.com ↗ 17 Muse Wonder 78±1 api $8.00/M 1M dev.meta.ai ↗ 18 GPT-5.5 78±0 api $11.25/M 1.1M openai.com ↗ 19 MiMo-V2.6-Pro 77±1 api $0.54/M +local ~443GB 1M mimo.mi.com ↗ 20 DeepSeek V4.1 Flash 1017 77±1 api $0.26/M 1M deepseek.com ↗ 21 Hy4 preview (770B-A49B) 77±1 api $1.25/M +local ~248GB 1M tencent.com ↗ 22 GPT-5.6 Terra 77±1 api $4.50/M 1.1M openai.com ↗ 23 Qwen3.8 Max (2.4T-A95B) 76±1 api $3.00/M +local ~380GB 262k deepinfra.com ↗ 24 Claude Opus 4.8 76±0 api $10.00/M 1M anthropic.com ↗ 25 GPT-5.4 76±1 api $5.63/M 1.1M openai.com ↗ 26 Muse Spark 1.3 76±1 api $2.00/M 1M dev.meta.ai ↗ 27 MiMo-V2.6-Flash (309B-A15… 76±1 api $0.17/M +local ~136GB 1M mimo.mi.com ↗ 28 Gemini 3.8 Flash 76±1 api $1.50/M 1M google.dev ↗ 29 DeepSeek V4.1 Flash 76±1 local ~512GB ~12 tok/s 1M how to run › 30 Kimi K3 75±1 api $6.00/M +local ~884GB 1M moonshot.ai ↗ 31 GPT-5.2 Pro 75±1 api $57.75/M 400k openai.com ↗ 32 Claude Haiku 5.5 75±1 api $0.20/M 1M claude.com ↗ 33 GPT-6 Luna 75±1 api $0.20/M 1.1M openai.com ↗ 34 GPT-5.6 Luna 75±1 api $0.45/M 1.1M openai.com ↗ 35 Grok 4.6 75±1 api $3.00/M 500k x.ai ↗ 36 Gemini 3.7 Flash 75±1 api $1.50/M 1M google.dev ↗ 37 DeepSeek V4 Pro (0813) 75±1 api $1.63/M +local ~1010GB 1M deepinfra.com ↗ 38 GLM-5.3 75±1 api $2.15/M +local ~239GB 1M z.ai ↗ 39 Qwen3.8 Max (0902) 74±1 api $3.00/M 1M alibabacloud.co… 40 Muse Spark Open 74±1 api $2.00/M +local ~190GB 1M fireworks.ai ↗ 41 DeepSeek V3.2 Speciale 74±3† comparison only 42 Muse Spark 74±2 comparison only 43 Gemini 3.1 Pro (Preview) 74±0 api $4.50/M 1M google.dev ↗ 44 Claude Opus 4.7 74±1 api $10.00/M 1M anthropic.com ↗ 45 Grok 4.5 74±1 api $3.00/M 500k x.ai ↗ 46 Qwen3.8-Omni-Flash 74±1† api $0.23/M 1M alibabacloud.co… 47 DeepSeek V4 Flash Vision … 74±2 local ~104GB 1M llama.cpp › 48 Claude Sonnet 5 73±1 api $4.00/M 1M anthropic.com ↗ 49 Qwen3.8-Flash-Next 73±1 local ~59GB ~27 tok/s 262k llama.cpp › 50 Claude Opus 4.6 73±1 api $10.00/M 1M anthropic.com ↗ 51 Muse Spark 1.1 73±1 api $2.00/M 1M dev.meta.ai ↗ 52 Grok 4.7 73±1 api $3.00/M 500k x.ai ↗ 53 Muse Spark 1.2 73±1 api $2.00/M 1M dev.meta.ai ↗ 54 Step 5 Preview 73±1 comparison only 55 GPT-5.3-Codex 73±1 api $4.81/M 400k openai.com ↗ 56 Gemini 3.5 Flash 73±1 api $3.38/M 1M google.dev ↗ 57 Qwen3.7 Max 73±1 api $3.75/M 1M deepinfra.com ↗ 58 DeepSeek V4 Flash (0731) 72±1 api $0.11/M +local ~92GB 1M deepinfra.com ↗ 59 GLM-5.3-Flash 72±1 api $0.24/M +local ~103GB 1M z.ai ↗ 60 GPT-5.2 72±1 api $4.81/M 400k openai.com ↗ 61 Gemini 3.6 Flash 72±1 api $1.50/M 1M google.dev ↗ 62 GLM-5.2 72±1 api $2.15/M +local ~121GB 1M z.ai ↗ 63 Grok 4.20 Multi-Agent (03… 72±2 api $1.56/M 1M x.ai ↗ 64 Dola Seed 2.0 Pro 72±2 comparison only 65 Hunyuan Hy3 (295B-A21B) 72±1 api $0.23/M +local ~94GB 256k deepinfra.com ↗ 66 Qwen3.8 27B 72±1 api $1.60/M +local ~18GB ~6.7 tok/s 262k groq.com ↗ 67 LongCat 2.0 (1.6T-A48B) 72±2 api $1.30/M +local ~2155GB 1M longcat.chat ↗ 68 Kimi K2.6 72±1 api $1.71/M +local ~317GB 262k moonshot.ai ↗ 69 GPT-5 Pro 72±1 api $41.25/M 400k openai.com ↗ 70 Gemini 3 Pro (Preview) 71±1 comparison only 1M 71 GPT-5 71±1 api $3.44/M 400k openai.com ↗ 72 Qwen3.6 Max Preview 71±1 api $2.92/M 256k alibabacloud.co… 73 Mistral Large 4 (public p… 71±1 comparison only 1M 74 Claude Sonnet 4.6 71±1 api $6.00/M 1M anthropic.com ↗ 75 Gemini 3 Flash (Preview) 71±1 api $1.13/M 1M google.dev ↗ 76 DeepSeek V4 Pro (Preview,… 71±1 local ~604GB llama.cpp › 77 Claude Opus 4.5 71±1 api $10.00/M 200k anthropic.com ↗ 78 Qwen3.7 Plus 71±1 api $0.70/M 1M alibabacloud.co… 79 Kimi K2.7 Code 71±1 api $1.71/M +local ~359GB 262k kimi.ai ↗ 80 North Small Translate 1.0 71±5† api price unknown 16k cohere.com ↗ 81 Solar Open 2 (250B-A15B) 71±1† local ~527GB 1M how to run › 82 DeepSeek V4 Flash (Previe… 70±1 local ~103GB llama.cpp › 83 Grok 4.20 (0309 reasoning) 70±1 api $1.56/M 1M x.ai ↗ 84 Beam 1.0 501B A23B 70±1 api price unknown 1M reflection.ai ↗ 85 GPT-5.4 mini 70±1 api $1.69/M 400k openai.com ↗ 86 Ling 3.0 Flash (124B-A5B) 70±2† api $0.090/M +loc… ~71GB 131k deepinfra.com ↗ 87 GPT-5.1 70±1 api $3.44/M 400k openai.com ↗ 88 GLM-5.1 70±0 api $2.15/M +local ~119GB 200k z.ai ↗ 89 o3-pro 70±2 api $35.00/M 200k openai.com ↗ 90 Qwen3.5 397B-A17B 69±0 api $1.09/M +local ~65GB 262k deepinfra.com ↗ 91 Gemini 2.5 Pro Preview (0… 69±2 comparison only 92 KAT-Coder-V2.5-Dev (35B-A… 69±2† local ~21GB 262k LM Studio › 93 Ornith 1.5 35B-A3B 69±1† local ~21GB ~80 tok/s 262k LM Studio › 94 Grok 4.3 69±1 api $1.56/M 1M x.ai ↗ 95 MiniMax-M3 69±1 api $0.48/M +local ~131GB 1M deepinfra.com ↗ 96 Qwen3.6 Plus 69±1 api $1.13/M 1M together.ai ↗ 97 Kimi K2.5 69±1 api $1.20/M +local ~160GB 262k aws.amazon.com ↗ 98 MiMo-V2-Pro 69±1 comparison only 99 Qwen3-Max (2026-01-23) 69±1† comparison only 100 GLM-5 69±1 api $1.55/M +local ~119GB 205k z.ai ↗ 101 MiMo-V2.5-Pro (1T-A42B) 69±1 api $0.65/M +local ~163GB 1M novita.ai ↗ 102 Muse Glimmer 30B 69±1 api $0.64/M +local ~18GB ~27 tok/s 131k fireworks.ai ↗ 103 o3 68±1 api $3.50/M 200k openai.com ↗ 104 Nemotron 3 Ultra 550B-A55B 68±1 api $1.35/M +local ~89GB 1M together.ai ↗ 105 Inkling Small (266B-A12B) 68±1 api $0.64/M +local ~86GB 1M deepinfra.com ↗ 106 Qwen3.6 27B 68±1 api $1.20/M +local ~18GB ~16 tok/s 262k groq.com ↗ 107 Ring-2.6-1T 68±2† comparison only 108 A.X K2 (688B-A33B) 68±1† local ~1454GB 262k how to run › 109 MiMo-V2.5 (310B-A15B) 68±1 api $0.21/M +local ~100GB 1M novita.ai ↗ 110 GPT-5.5 Instant 68±1 comparison only 111 Qwen3.5 Plus 68±2 api $0.90/M 1M alibabacloud.co… 112 Gemini 3.5 Flash-Lite 68±1 api $0.85/M 1M google.dev ↗ 113 Qwen3.5 122B-A10B 68±1 api $1.10/M +local ~71GB 262k alibabacloud.co… 114 Inkling (975B-A41B) 68±1 api $1.73/M +local ~156GB 1M deepinfra.com ↗ 115 Nemotron 3.5 Bolt 74B A9B 68±2† local ~157GB 262k how to run › 116 GPT-5.4 nano 68±1 api $0.46/M 400k openai.com ↗ 117 Claude Sonnet 4.5 68±1 api $6.00/M 200k anthropic.com ↗ 118 GLM-5V-Turbo 68±2 api $1.90/M 200k siliconflow.com… 119 LongCat-Flash-Thinking (5… 68±1† comparison only 128k 120 GLM-4.7 68±1 api $1.00/M +local ~58GB 205k z.ai ↗ 121 Qwen3.5 27B 68±0 api $0.84/M +local ~18GB ~29 tok/s 262k deepinfra.com ↗ 122 Gemini 2.5 Pro Experiment… 67±2 comparison only 123 Grok 4 (0709) 67±1 comparison only 124 MiMo-V2-Omni 67±2 comparison only 262k 125 Nemotron 3.5 Super VL 120… 67±1 local ~254GB 1M how to run › 126 Spark-X2.6 4B 67±1† local ~5.2GB 1M llama.cpp › 127 DeepSeek V3.2 67±1 api $0.29/M +local ~110GB 128k deepinfra.com ↗ 128 Step 3.5 Flash (196B-A11B) 67±1 api $0.15/M +local ~118GB ~18 tok/s 256k stepfun.ai ↗ 129 GPT-5.2-Codex 67±2 comparison only 130 Qwen3.6 35B-A3B 67±1 api $0.31/M +local ~21GB ~63 tok/s 262k deepinfra.com ↗ 131 Qwen3-Coder-Next (80B-A3B) 67±2 api $0.60/M +local ~25GB ~62 tok/s 262k alibabacloud.co… 132 GPT-5 mini 67±1 api $0.69/M 400k openai.com ↗ 133 MiniMax-M2.7 67±1 api $0.53/M +local ~75GB 205k minimax.io ↗ 134 Ornith 1.0 35B (35B-A3B) 67±1 local ~23GB ~103 tok/s 262k LM Studio › 135 Claude Opus 4 67±1 comparison only 136 Gemini 2.5 Pro 66±1 api $3.44/M 1M google.dev ↗ 137 Claude Opus 4.1 66±1 comparison only 138 Hy3 preview (295B-A21B) 66±1 local ~629GB how to run › 139 Gemma 4 31B 66±1 api $0.19/M +local ~24GB ~11 tok/s 262k deepinfra.com ↗ 140 Kimi K2 Thinking 66±1 api $1.07/M +local ~160GB 262k aws.amazon.com ↗ 141 Gemini 2.5 Pro Preview (0… 66±1 comparison only 142 Gemini 2.5 Pro Preview (0… 66±2 comparison only 143 K-EXAONE 2.0 (750B-A37B) 66±1† local ~791GB 262k how to run › 144 Gemini 3.1 Flash-Lite 66±1 api $0.56/M 1M google.dev ↗ 145 Qwen3.7 Flash 66±1 api $0.055/M 1M alibabacloud.co… 146 Laguna M.1 66±2 api price unknown… ~135GB 262k huggingface.co ↗ 147 DeepSeek V3.1 Terminus 66±1 local ~230GB 164k llama.cpp › 148 DeepSeek V3.2 Exp 66±1 local ~726GB how to run › 149 Kimi K2 Instruct (0711) 66±1 api $1.00/M +local ~152GB 131k novita.ai ↗ 150 o1 (2024-12-17) 66±1 api $26.25/M 200k openai.com ↗ 151 GigaChat 3.5 Ultra Reason… 66±1† local ~461GB 262k how to run › 152 o4-mini 66±1 api $1.93/M 200k openai.com ↗ 153 Qwen3 235B-A22B Thinking … 66±1 api $0.97/M +local ~76GB 131k novita.ai ↗ 154 Qwen3.5 35B-A3B 66±0 api $0.35/M +local ~21GB ~50 tok/s 262k deepinfra.com ↗ 155 Step 3.7 Flash (198B-A11B) 66±1 api $0.44/M +local ~104GB 256k stepfun.ai ↗ 156 Grok 4.1 Fast (Reasoning) 66±1 api $0.28/M 128k azure.microsoft… 157 LongCat-Flash-Chat (560B-… 65±1 local ~333GB 128k LM Studio › 158 DeepSeek V3.1 65±1 api $0.42/M +local ~110GB 131k deepinfra.com ↗ 159 GLM-4.6 65±1 api $1.00/M +local ~58GB 205k z.ai ↗ 160 Qwen3.6 Flash 65±1 api $0.56/M 1M alibabacloud.co… 161 Qwen3-Max (2025-09-23) 65±1 api $2.40/M 262k alibabacloud.co… 162 MiniMax-M2.5 65±1 api $0.53/M +local ~75GB 205k minimax.io ↗ 163 o3-mini 65±1 api $1.93/M 200k openai.com ↗ 164 Claude Sonnet 4 65±1 comparison only 165 MiMo-V2-Flash (309B-A15B) 65±1 local ~103GB llama.cpp › 166 DeepSeek R1 0528 65±1 api $0.91/M +local ~104GB 164k deepinfra.com ↗ 167 Claude 3.7 Sonnet 65±1 comparison only 168 MiniMax-M2.1 65±1 local ~79GB llama.cpp › 169 Spark-X2.5 4B 65±1† local ~3.5GB ~114 tok/s 1M LM Studio › 170 Nemotron Cascade 2 30B-A3B 65±1 local ~20GB ~90 tok/s 256k LM Studio › 171 ChatGPT-4o (2025-03-26) 65±2 comparison only 172 MiMo-V2.6-Distill-Qwen-9B 64±2† local ~7.8GB LM Studio › 173 Laguna XS 2.1 (33B-A3B) 64±2† local ~21GB 262k LM Studio › 174 K-EXAONE (236B-A23B) 64±1 local ~152GB 262k llama.cpp › 175 Qwen3 235B-A22B Instruct … 64±1 api $0.20/M +local ~73GB ~15 tok/s 262k deepinfra.com ↗ 176 Mistral Medium 3.5 (128B) 64±1 api $3.00/M +local ~43GB 262k mistral.ai ↗ 177 INTELLECT-3 64±1 local ~48GB llama.cpp › 178 GLM-4.5 64±1 api $1.00/M +local ~58GB 131k z.ai ↗ 179 Qwen3.5 Flash 64±1 api $0.17/M 1M alibabacloud.co… 180 Mistral Medium 3.1 (2508) 64±2 comparison only 181 MiniMax-M2 64±1 api $0.53/M +local ~75GB 205k aws.amazon.com ↗ 182 Command A+ (05-2026) 64±1 api price unknown… ~71GB 128k cohere.com ↗ 183 Claude Haiku 4.5 64±1 api $2.00/M 200k anthropic.com ↗ 184 Nemotron 3 Super 120B-A12B 64±1 api $0.28/M +local ~73GB ~20 tok/s 262k aws.amazon.com ↗ 185 Laguna XS.2 64±1 local ~21GB 262k LM Studio › 186 Gemma 4 26B-A4B 64±1 api $0.14/M +local ~18GB ~55 tok/s 262k deepinfra.com ↗ 187 EXAONE 4.5 33B 64±2† local ~24GB 262k llama.cpp › 188 Solar Pro 4 63±1 api $0.53/M 524k upstage.ai ↗ 189 Kimi K2 Instruct (0905) 63±2 local ~298GB llama.cpp › 190 Qwen3-Coder 480B-A35B Ins… 63±1 api $0.67/M +local ~78GB 262k novita.ai ↗ 191 Qwen3-VL 235B-A22B Thinki… 63±1 local ~106GB 256k LM Studio › 192 DeepSeek R1 (Jan '25) 63±1 api $4.00/M +local ~104GB 128k together.ai ↗ 193 o1-preview 63±1 comparison only 194 Grok 3 Beta 63±1 comparison only 195 Grok 3 Mini Beta 63±1 comparison only 196 Qwen3-VL 235B-A22B Instru… 63±1 local ~128GB 256k LM Studio › 197 MiniCPM5 2B 63±1† local ~2.4GB 131k LM Studio › 198 Nemotron-Labs-3 Puzzle 75… 63±1† local ~35GB llama.cpp › 199 Qwen3-Next 80B-A3B Instru… 63±1 api $0.34/M +local ~26GB ~55 tok/s 131k deepinfra.com ↗ 200 Nova 2 Pro (Preview) 63±2 api $3.78/M 1M aws.amazon.com ↗ 201 Gemini 2.5 Flash Preview … 63±1 comparison only 202 Qwen3-Next 80B-A3B Thinki… 63±1 api $0.41/M +local ~25GB 131k alibabacloud.co… 203 Granite 4.2 30B 63±1 api $0.28/M +local ~19GB 131k deepinfra.com ↗ 204 GPT-4.5 Preview 63±1 comparison only 205 Gemini 2.5 Flash Preview … 63±1 comparison only 206 GPT-4.1 62±1 api $3.50/M 1M openai.com ↗ 207 GLM-4.5-Air 62±1 api $0.42/M +local ~35GB ~23 tok/s 131k z.ai ↗ 208 Trinity-Large-Thinking 62±2 api $0.39/M +local ~141GB 512k arcee.ai ↗ 209 Nemotron 3.5 Lightning 30… 62±2 api $0.087/M +loc… ~20GB ~64 tok/s 262k fireworks.ai ↗ 210 Seed-OSS 36B Instruct 62±1 local ~23GB 524k LM Studio › 211 Qwen3.5 9B 62±0 api $0.11/M +local ~6.7GB ~22 tok/s 262k deepinfra.com ↗ 212 MiniMax-M1 (80k) 62±1 api $0.96/M +local ~959GB 1M novita.ai ↗ 213 Gemma 4 12B 62±1 local ~9.2GB ~29 tok/s 262k LM Studio › 214 GLM-4.6V 62±2 api $0.45/M +local ~50GB 128k z.ai ↗ 215 Magistral Medium 1.2 (250… 62±2† comparison only 128k 216 HyperCLOVA X SEED 32B Thi… 62±2† comparison only 128k 217 Gemini 2.5 Flash 62±1 api $0.85/M 1M google.dev ↗ 218 Gemini 2.5 Flash Preview … 62±1 comparison only 219 Gemini 2.0 Flash-Lite (00… 62±2 comparison only 220 Qwen3-VL 32B Thinking 62±1 api $0.28/M +local ~22GB 256k alibabacloud.co… 221 gpt-oss-120b 62±1 api $0.26/M +local ~64GB ~56 tok/s 131k groq.com ↗ 222 GPT-5 nano 62±1 api $0.14/M 400k openai.com ↗ 223 Mistral Large 3 (675B-A41… 62±1 api $0.75/M +local ~108GB 262k mistral.ai ↗ 224 Apriel 1.6 15B Thinker 62±1† local ~10GB LM Studio › 225 Devstral 2 (2512) 62±2 local ~74GB 256k LM Studio › 226 Gemini 2.5 Flash-Lite Pre… 62±2 comparison only 227 A.X K1 (519B-A33B) 61±1† local ~1091GB how to run › 228 o1-mini 61±1 comparison only 229 GLM-4.5V 61±2 api $0.90/M +local ~69GB 64k z.ai ↗ 230 Devstral Small 2 24B 61±2 local ~16GB 262k llama.cpp › 231 MiniMax-M1 (40k) 61±1† comparison only 232 Llama 3.1 Nemotron Ultra … 61±1 local ~82GB 128k llama.cpp › 233 Gemini 2.0 Pro Experiment… 61±1 comparison only 234 Grok 4 Fast 61±1 comparison only 235 DeepSeek V3 0324 60±1 local ~102GB 164k llama.cpp › 236 Claude 3.5 Sonnet (2024-1… 60±1 comparison only 237 GPT-4.1 mini 60±1 api $0.70/M 1M openai.com ↗ 238 Qwen3 30B-A3B Thinking 25… 60±1 api $0.75/M +local ~19GB 262k alibabacloud.co… 239 Gemini 2.0 Flash (001) 60±1 comparison only 240 Qwen3 30B-A3B Instruct 25… 60±1 api $0.15/M +local ~19GB ~100 tok/s 262k tokenfactory.ne… 241 ERNIE 4.5 300B-A47B 60±1† local ~97GB 131k llama.cpp › 242 Qwen3.5 4B 60±1 local ~3.8GB 262k llama.cpp › 243 Mistral Medium 3 (2505) 60±1 comparison only 244 Mellum2.1 12B-A2.5B Think… 60±1† local ~8.3GB LM Studio › 245 Gemma 2 9B IT SimPO 60±1 local ~7.6GB llama.cpp › 246 Gemma 2 9B IT DPO (Prince… 60±1 local ~7.6GB llama.cpp › 247 Falcon-H1R 7B 60±1† local ~5.3GB 262k LM Studio › 248 Nemotron-Cascade-14B-Thin… 60±1† local ~10GB LM Studio › 249 Qwen3-VL 32B Instruct 60±1 api $0.28/M +local ~22GB 256k alibabacloud.co… 250 DeepSeek V3 (Dec '24) 60±1 api $0.46/M +local ~337GB 131k deepinfra.com ↗ 251 Qwen3 235B-A22B (Apr 2025… 60±0 api $1.23/M +local ~73GB 131k alibabacloud.co… 252 Gemini 2.0 Flash-Lite Pre… 60±2 comparison only 253 Granite 4.2 8B 59±1 api $0.11/M +local ~6.8GB 131k wandb.ai ↗ 254 Mistral Small 4 (119B-A6.… 59±2 api $0.26/M +local ~37GB 262k mistral.ai ↗ 255 QwQ-32B 59±1 local ~21GB 131k LM Studio › 256 Solar Open 100B (102B-A12… 59±1† local ~41GB 131k llama.cpp › 257 Qwen3-VL 30B-A3B Thinking 59±1 api $0.75/M +local ~20GB 256k alibabacloud.co… 258 Trinity-Large-Preview 59±2 local ~155GB llama.cpp › 259 OpenReasoning-Nemotron-32B 59±2† local ~21GB LM Studio › 260 Spark-X2.6 1.7B 59±1† local ~3.4GB 1M llama.cpp › 261 EXAONE 4.0 32B 59±1 local ~20GB 131k LM Studio › 262 Phi-4-reasoning-plus 14B 59±1 local ~10GB LM Studio › 263 GLM-4.7-Flash 58±1 api $0.0000/M +lo… ~18GB ~44 tok/s 200k z.ai ↗ 264 Mercury 2 58±2 comparison only 265 gpt-oss-20b 58±1 api $0.13/M +local ~13GB ~79 tok/s 131k groq.com ↗ 266 Olmo 3.1 32B Think 58±1 local ~21GB 66k LM Studio › 267 DiffusionGemma 26B-A4B 58±1† comparison only 262k 268 Qwen3 14B 58±1 api $0.61/M +local ~10GB 33k alibabacloud.co… 269 Llama 3.3 Nemotron Super … 58±2 local ~22GB llama.cpp › 270 DeepSeek R1 Distill Llama… 58±1 api $0.80/M +local ~30GB 131k novita.ai ↗ 271 GPT-4o (2024-08-06) 58±1 api $4.38/M 128k openai.com ↗ 272 Nemotron-Cascade-8B 58±1† local ~6.3GB LM Studio › 273 Command A (03-2025) 58±1 api $4.38/M +local ~37GB 256k azure.microsoft… 274 Olmo 3 32B Think 58±1 local ~21GB 66k LM Studio › 275 GPT-4o (2024-05-13) 58±0 api $7.50/M 128k openai.com ↗ 276 Phi-4-reasoning 14B 58±1 api $0.22/M +local ~10GB 33k azure.microsoft… 277 Claude 3.5 Sonnet (2024-0… 58±0 comparison only 278 Nova 2 Lite 58±1 api $0.94/M 1M aws.amazon.com ↗ 279 Magistral Small 1.2 58±1 api $0.75/M +local ~16GB 131k aws.amazon.com ↗ 280 GPT-4o (2024-11-20) 58±1 api $4.38/M 128k openai.com ↗ 281 Qwen3-VL 30B-A3B Instruct 58±1 api $0.35/M +local ~20GB 256k alibabacloud.co… 282 Qwen3-VL 8B Thinking 58±1 api $0.66/M +local ~6.9GB 256k alibabacloud.co… 283 Qwen3 32B 57±0 api $0.13/M +local ~20GB 131k deepinfra.com ↗ 284 Qwen3 Coder 30B-A3B Instr… 57±1 api $0.12/M +local ~19GB ~93 tok/s 160k novita.ai ↗ 285 Gemini 2.0 Flash Thinking… 57±1 comparison only 286 Qwen2.5-Max (2025-01-25) 57±1 comparison only 287 Qwen2.5 Coder 32B Instruct 57±1 api $0.74/M +local ~21GB 131k cloudflare.com ↗ 288 Gemini 2.5 Flash-Lite 57±2 api $0.17/M 1M google.dev ↗ 289 Llama 4 Maverick (402B-A1… 57±1 api $0.42/M +local ~65GB 1M aws.amazon.com ↗ 290 DeepSeek R1 0528 Qwen3 8B 57±1 api $0.068/M +loc… ~6.5GB ~21 tok/s 128k novita.ai ↗ 291 Gemini 1.5 Pro Experiment… 57±1 comparison only 292 Granite 4.2 3B 57±1 api $0.052/M +loc… ~3.3GB 131k deepinfra.com ↗ 293 Gemini 1.5 Pro (002) 57±1 comparison only 294 Llama 3.3 Nemotron Super … 57±1 local ~18GB 131k llama.cpp › 295 Nemotron 3 Nano 30B-A3B 57±1 api $0.087/M +loc… ~20GB ~90 tok/s 262k deepinfra.com ↗ 296 Athene-V2-Chat 72B 57±1 local ~44GB 33k LM Studio › 297 Grok 2 (1212) 57±1 comparison only 298 Granite 4.1 30B 57±1† local ~19GB ~25 tok/s Ollama › 299 Nemotron-Cascade-8B-Think… 57±2 local ~6.3GB LM Studio › 300 Gemini 2.0 Flash Experime… 57±1 comparison only 301 Qwen2.5-Omni 7B 57±2 local ~5.8GB llama.cpp › 302 Sky-T1 32B Preview 57±4 local ~21GB LM Studio › 303 Ministral 3 14B Reasoning… 57±1 local ~10GB 262k llama.cpp › 304 Qwen Plus (2025-01-25) 57±1 api $0.60/M 131k alibabacloud.co… 305 DeepSeek-V2.5 (1210) 56±1 local ~82GB llama.cpp › 306 QED-Nano 56±2 local ~4.1GB 262k llama.cpp › 307 Mistral Small 3.2 24B 56±1 api $0.11/M +local ~15GB 128k deepinfra.com ↗ 308 Qwen3 4B Thinking 2507 56±1 local ~4.2GB ~67 tok/s 262k LM Studio › 309 GPT-4 Turbo (2024-04-09) 56±0 api $15.00/M 128k openai.com ↗ 310 Yi-Lightning 56±1 api price unknown 16k lingyiwanwu.com… 311 Gemini 1.5 Pro Experiment… 56±1 comparison only 312 Qwen3-VL 4B Thinking 56±1 local ~4.4GB 256k llama.cpp › 313 Qwen2.5 72B Instruct 56±1 api $0.37/M +local ~31GB 33k deepinfra.com ↗ 314 Qwen2.5-VL 72B Instruct 56±1 local ~46GB 33k LM Studio › 315 Llama 3.1 405B Instruct 56±1 api $2.40/M +local ~160GB 128k aws.amazon.com ↗ 316 Mistral Large 2 (2411) 56±1 local ~77GB 128k llama.cpp › 317 Qwen2.5 Coder 14B Instruct 56±1 local ~11GB ~18 tok/s 131k LM Studio › 318 DeepSeek R1 Distill Qwen … 56±1 api $1.59/M +local ~21GB ~7.3 tok/s 131k cloudflare.com ↗ 319 Qwen2.5 32B Instruct 56±1 local ~21GB 131k LM Studio › 320 Qwen3 8B 56±1 api $0.31/M +local ~6.3GB ~25 tok/s 33k alibabacloud.co… 321 DeepSeek R1 Distill Qwen … 56±1 local ~11GB ~15 tok/s 131k LM Studio › 322 Magistral Medium 1.0 (250… 56±1 comparison only 323 Molmo 2 8B 56±2 local ~6.8GB llama.cpp › 324 Nemotron Nano 9B v2 55±1 api $0.10/M +local ~7.6GB 131k aws.amazon.com ↗ 325 EXAONE Deep 32B 55±2† local ~22GB 33k Ollama › 326 Qwen3 4B Instruct 2507 55±1 local ~4.2GB ~107 tok/s 262k LM Studio › 327 Ministral 3 14B 55±1 api $0.20/M +local ~9.1GB ~46 tok/s 262k mistral.ai ↗ 328 Qwen3 30B-A3B (Apr 2025, … 55±0 api $0.35/M +local ~18GB 33k alibabacloud.co… 329 Nova Premier 55±2† api $5.00/M 1M aws.amazon.com ↗ 330 Granite 4.1 8B 55±1 api $0.11/M +local ~7.1GB ~70 tok/s 131k replicate.com ↗ 331 Magistral Small 1.0 (2506) 55±1 local ~16GB 128k LM Studio › 332 Bielik 11B v3.0 Instruct 55±2 local ~8.1GB LM Studio › 333 Qwen2.5-Math 72B Instruct 55±2† local ~44GB 4k LM Studio › 334 Llama 3.3 70B Instruct 55±1 api $0.72/M +local ~25GB ~13 tok/s 128k aws.amazon.com ↗ 335 Magistral Medium 1.1 (250… 55±1† comparison only 40k 336 Qwen3-VL 8B Instruct 55±1 api $0.31/M +local ~6.9GB 256k alibabacloud.co… 337 Mistral Large 2 (2407) 55±1 local ~45GB 128k llama.cpp › 338 Falcon-H1 34B Instruct 55±3 local ~23GB 262k llama.cpp › 339 Llama 4 Scout (109B-A17B) 55±1 api $0.15/M +local ~36GB ~19 tok/s 328k deepinfra.com ↗ 340 GPT-4 Turbo Preview (1106) 55±1 comparison only 341 Llama 3.1 Tulu 3 70B 55±1 local ~43GB 131k LM Studio › 342 Bielik 11B v2.6 Instruct 55±3 local ~8.1GB LM Studio › 343 GigaChat 3.5 Ultra Instru… 55±1† local ~457GB 262k how to run › 344 Mistral Small 3.1 24B (25… 55±1 local ~16GB 128k llama.cpp › 345 Pixtral Large (2411) 55±3 local ~51GB llama.cpp › 346 Olmo 3.1 32B Instruct 55±2 local ~21GB 66k LM Studio › 347 Spark-X2.5 1.7B 55±1† local ~1.9GB ~166 tok/s 1M llama.cpp › 348 GPT-4 Turbo Preview (0125) 55±1 comparison only 349 DeepSeek-V2.5 55±1 local ~151GB 164k Ollama › 350 OpenThinker2 32B 55±1 local ~21GB 33k LM Studio › 351 Command A Reasoning (08-2… 55±2 local ~34GB llama.cpp › 352 DeepSeek-V2 Chat (0628) 55±1 local ~66GB llama.cpp › 353 OpenThinker 32B 55±1† local ~21GB 33k LM Studio › 354 Claude 3.5 Haiku 54±1 comparison only 355 Magistral Small 1.1 (2507) 54±1† local ~16GB 40k LM Studio › 356 Ministral 3 8B Reasoning … 54±1 local ~6.5GB 262k LM Studio › 357 Llama 3.1 Tulu 3 70B DPO 54±1 local ~22GB 131k llama.cpp › 358 Gemini 1.5 Flash Experime… 54±1 comparison only 359 Mellum2 12B-A2.5B Thinking 54±1† local ~8.6GB 131k LM Studio › 360 Nemotron 3 Nano 4B 54±1 local ~2.9GB ~52 tok/s 262k LM Studio › 361 GPT-4o mini (2024-07-18) 54±0 api $0.26/M 128k openai.com ↗ 362 Gemini 1.5 Pro (001) 54±1 comparison only 363 DeepSeek-Coder-V2 Instruc… 54±1 local ~92GB llama.cpp › 364 DeepSeek-Coder-V2 Instruc… 54±1 local ~151GB llama.cpp › 365 Mistral Small 3 24B (2501) 54±1 local ~15GB 32k LM Studio › 366 GPT-4 (0314) 54±1 comparison only 367 Gemini 1.5 Flash (002) 54±1 comparison only 368 Qwen Turbo (2024-11-01) 54±2 comparison only 369 GLM-4 9B Chat 1M 54±4 local ~8.1GB 1M llama.cpp › 370 EXAONE Deep 7.8B 54±2† local ~6.5GB 33k llama.cpp › 371 Claude 3 Opus 54±0 comparison only 372 Qwen2-VL 72B Instruct 54±1 local ~34GB llama.cpp › 373 Hermes 3 Llama 3.1 405B 54±1 local ~114GB 131k llama.cpp › 374 Yi-Large Preview 54±1 comparison only 375 Llama 3.1 70B Instruct 53±0 api $0.72/M +local ~27GB 128k aws.amazon.com ↗ 376 Gemma 3 27B 53±1 api $0.10/M +local ~19GB 131k deepinfra.com ↗ 377 Qwen2.5-VL 32B Instruct 53±2 local ~23GB 33k LM Studio › 378 Phi-4 14B 53±1 api $0.087/M +loc… ~10GB 16k deepinfra.com ↗ 379 GPT-4.1 nano 53±1 api $0.17/M 1M openai.com ↗ 380 GLM-4 (0520) 53±1 comparison only 381 Bielik 11B v2.1 Instruct 53±3 local ~8.5GB llama.cpp › 382 Qwen2.5-Math 7B Instruct 53±2† local ~5.4GB 4k LM Studio › 383 s1.1 32B 53±1 local ~22GB 33k LM Studio › 384 Ministral 3 8B 53±1 api $0.15/M +local ~6.5GB ~68 tok/s 262k mistral.ai ↗ 385 Olmo 3 7B Think 53±1 local ~5.8GB 66k LM Studio › 386 Gemma 4 E4B 53±1 local ~6.4GB ~21 tok/s 131k LM Studio › 387 Llama 3.1 Nemotron 70B In… 53±1 local ~43GB 128k LM Studio › 388 Qwen3-VL 4B Instruct 53±1 local ~4.4GB 256k llama.cpp › 389 GPT-4 (0613) 53±1 api $37.50/M 8k openai.com ↗ 390 Bielik 11B v2.2 Instruct 53±3 local ~8.5GB llama.cpp › 391 Llama 3.1 Nemotron 51B In… 53±2 local ~34GB llama.cpp › 392 Nemotron-4 340B Instruct 53±2 comparison only 393 ERNIE 4.5 21B-A3B 53±1 comparison only 394 Palmyra X4 (palmyra-x-004) 53±3 comparison only 395 LFM2.5 2.6B 53±1 local ~2.3GB 131k LM Studio › 396 Granite 4.0 H Small (32B-… 53±1 api $0.11/M +local ~21GB 131k replicate.com ↗ 397 Qwen2.5 Coder 7B Instruct 53±1 local ~5.4GB ~3.8 tok/s 131k LM Studio › 398 Aya Expanse 32B 53±2 api $0.75/M +local ~22GB 128k cohere.com ↗ 399 OpenCoder-8B-Instruct 53±1 local ~6.4GB llama.cpp › 400 Gemma 3 12B 52±1 api $0.075/M +loc… ~10GB ~13 tok/s 131k deepinfra.com ↗ 401 Qwen2.5 14B Instruct 52±1 local ~11GB 131k LM Studio › 402 LFM2.5 8B-A1B 52±1 local ~5.5GB ~174 tok/s 128k LM Studio › 403 Yi-Large 52±1 comparison only 404 Llama-3-Instruct-8B-SimPO… 52±1 local ~6.6GB llama.cpp › 405 Cogito v1 Preview Llama 8B 52±4 local ~6.2GB 128k LM Studio › 406 Llama-3-Instruct-8B-SimPO 52±1 local ~6.6GB llama.cpp › 407 Athene-70B 52±1 local ~29GB llama.cpp › 408 Jamba 1.5 Large 52±1 local ~839GB how to run › 409 Qwen2 72B Instruct 52±1 local ~33GB 131k llama.cpp › 410 CodeQwen1.5 7B Chat 52±1 local ~6.4GB 64k llama.cpp › 411 Command A Translate (08-2… 52±4† api price unknown 8k cohere.com ↗ 412 OpenCodeInterpreter-DS-33B 51±1 local ~22GB LM Studio › 413 Flan-U-PaLM 540B 51±1† never released 414 Gemini 1.5 Flash (001) 51±1 comparison only 415 Bielik 11B v2.0 Instruct 51±3 local ~8.5GB llama.cpp › 416 LFM2 24B-A2B 51±1 local ~14GB 33k LM Studio › 417 Qwen3 4B 51±1 local ~4GB 33k LM Studio › 418 DeepSeek-Coder 33B Instru… 51±1 local ~21GB 16k LM Studio › 419 GLM-4 (0116) 51±1 comparison only 420 Codestral 22B v0.1 51±1 local ~15GB 32k LM Studio › 421 Gemma 2 27B IT 51±1 local ~19GB 8k LM Studio › 422 Llama 3 70B Instruct 51±0 local ~24GB 8k llama.cpp › 423 Llama 3.2 90B Vision Inst… 51±1 local ~58GB 128k Ollama › 424 WizardCoder 33B V1.1 51±1 local ~22GB 16k llama.cpp › 425 Bielik 11B v2.3 Instruct 51±2 local ~8.6GB llama.cpp › 426 Flan-PaLM 540B 51±1† never released 427 Llama-3-8B-ProLong-512k-I… 51±4 local ~35GB how to run › 428 Nova Pro 51±1 api $1.40/M 300k aws.amazon.com ↗ 429 OpenCodeInterpreter-DS-6.… 51±1 local ~5.8GB llama.cpp › 430 Qwen2-Math 72B Instruct 51±1 local ~32GB 4k llama.cpp › 431 WizardLM-2 8x22B 51±1 local ~91GB Ollama › 432 Mistral Small Instruct 22… 51±2 local ~15GB 32k LM Studio › 433 OpenThinker3 7B 51±1 local ~6GB 33k LM Studio › 434 Granite 4.1 3B 51±1† local ~3.7GB ~131 tok/s Ollama › 435 Artigenz-Coder-DS-6.7B 51±1 local ~5.8GB llama.cpp › 436 Mellum2 12B-A2.5B Instruct 51±2† local ~7.6GB 131k LM Studio › 437 Molmo 72B (0924) 50±2 local ~309GB how to run › 438 Yi 34B 200K (base) 50±4 local ~23GB 200k llama.cpp › 439 Hermes 3 Llama 3.1 70B 50±1 local ~43GB 131k Ollama › 440 speechless-codellama-34b-… 50±1 local ~23GB llama.cpp › 441 OLMo 2 32B Instruct (0325) 50±1 local ~21GB LM Studio › 442 Ministral 3 3B Reasoning … 50±1 local ~3.4GB 262k LM Studio › 443 Aya 23 35B 50±2 local ~22GB 8k LM Studio › 444 AceReason-Nemotron-1.0-14B 50±2† local ~10GB LM Studio › 445 Claude 3 Sonnet 50±0 comparison only 446 Qwen2.5-VL 7B Instruct 50±1 local ~5.8GB llama.cpp › 447 Mixtral 8x22B Instruct v0… 50±1 local ~56GB 64k llama.cpp › 448 Magicoder-S-DS 6.7B 50±1 local ~5.8GB llama.cpp › 449 EXAONE Deep 2.4B 50±2† local ~3.2GB 33k Ollama › 450 Pixtral 12B (2409) 50±2 local ~9.6GB llama.cpp › 451 Nova Lite 50±2 api $0.10/M 300k aws.amazon.com ↗ 452 XwinCoder-34B 50±1 local ~23GB llama.cpp › 453 Qwen2.5 7B Instruct 50±1 api $0.30/M +local ~5.4GB ~54 tok/s 131k together.ai ↗ 454 LFM2.5 1.2B Thinking 50±2 local ~1.3GB 33k LM Studio › 455 Yi-Coder 9B Chat 50±1 local ~6.3GB 128k LM Studio › 456 InternLM2.5 7B Chat 50±2 local ~6.1GB LM Studio › 457 StarChat2 15B v0.1 50±1 local ~12GB 16k llama.cpp › 458 Code Millenials 34B 50±1 local ~23GB llama.cpp › 459 Qwen2-Math 7B Instruct 50±2† local ~6GB 4k LM Studio › 460 WaveCoder-Ultra-6.7B 50±1 local ~5.8GB llama.cpp › 461 Reka Core (2024-05-01) 50±1 comparison only 462 GPT-4o Audio Preview (202… 49±2 comparison only 463 MegaBeam-Mistral-7B-512k 49±4 local ~5.9GB llama.cpp › 464 Gemini 1.5 Flash-8B (001) 49±2 comparison only 465 Phi-3.5-MoE-instruct 49±1 local ~25GB 128k LM Studio › 466 Qwen3-VL 2B Thinking 49±1 local ~2.7GB 256k llama.cpp › 467 Gemma 3n E4B 49±1 local ~5.6GB 32k llama.cpp › 468 Claude 3 Haiku 49±0 comparison only 469 DeepSeek-Coder 7B Instruc… 49±1 local ~5.9GB llama.cpp › 470 OpenThinker2 7B 49±2† local ~6.4GB 33k llama.cpp › 471 DeepSeek-Coder 6.7B Instr… 49±1 local ~8.8GB 16k llama.cpp › 472 Qwen2 57B-A14B Instruct 49±2 local ~35GB 33k LM Studio › 473 Hermes 2 Theta Llama-3 70B 49±2 local ~47GB 8k llama.cpp › 474 MiniCPM3-4B 49±2 local ~4GB 32k LM Studio › 475 Granite 4.0 H Tiny (7B-A1… 49±1 local ~4.5GB ~12 tok/s 131k LM Studio › 476 Claude 1.3 49±1 comparison only 477 Yi-1.5 34B (base) 49±2 local ~22GB 4k LM Studio › 478 Bielik 4.5B v3.0 Instruct 49±2 local ~4.3GB LM Studio › 479 Qwen2.5 Coder 3B Instruct 49±1 local ~2.6GB ~9.5 tok/s 33k LM Studio › 480 GPT-4o mini Audio Preview… 49±2 comparison only 481 Gemma 2 9B IT 49±1 local ~8.9GB 8k LM Studio › 482 WhiteRabbitNeo-33B-v1 49±1 local ~22GB llama.cpp › 483 Qwen1.5 110B Chat 48±1 local ~45GB 32k llama.cpp › 484 Command R Plus (08-2024) 48±1 api $4.38/M +local ~63GB 128k cohere.com ↗ 485 GLM-4 9B Chat 48±2 local ~7.1GB 128k Ollama › 486 Magicoder-S-CL-7B 48±1 local ~5.8GB llama.cpp › 487 speechless-coder-ds-6.7b 48±1 local ~5.8GB llama.cpp › 488 Phind CodeLlama 34B v2 48±1 local ~23GB 16k Ollama › 489 AceReason-Nemotron-1.1-7B 48±2† local ~6GB LM Studio › 490 Jamba 1.5 Mini 48±1 local ~34GB llama.cpp › 491 DeepSeek R1 Distill Qwen … 48±1 local ~5.4GB ~35 tok/s 131k LM Studio › 492 U-PaLM 540B 48±1† never released 493 GPT-3.5 Turbo (0125) 48±1 api $0.75/M 16k openai.com ↗ 494 Mistral Large (2402) 48±1 comparison only 495 InternVL2-26B 48±2 local ~55GB how to run › 496 Aya Expanse 8B 48±2 local ~6.4GB 8k LM Studio › 497 EuroLLM 9B Instruct 48±2 local ~6.9GB 4k LM Studio › 498 Flan-UL2 20B 48±4 comparison only 499 GPT-3.5 Turbo (1106) 48±1 comparison only 500 Granite 4.0 H Micro 3B 48±1 local ~3.4GB 131k LM Studio › 501 Minerva 540B 48±1† never released 502 Code Llama 70B Instruct 48±1 local ~28GB 16k llama.cpp › 503 Command R (08-2024) 48±1 api $0.26/M +local ~21GB 128k cohere.com ↗ 504 OLMo 2 13B Instruct (1124) 48±1 local ~9.6GB 4k LM Studio › 505 InternLM2.5 7B Chat 1M 48±4 local ~6.4GB llama.cpp › 506 Falcon-H1 7B Instruct 48±3 local ~6GB 262k LM Studio › 507 GPT-3.5 Turbo (0301) 47±1 comparison only 508 Llama 3 70B (base) 47±2 local ~43GB LM Studio › 509 Tulu 2 70B 47±2† local ~28GB llama.cpp › 510 CogVLM2 Llama3 Chinese Ch… 47±7† comparison only 511 Hermes 2 Pro Llama 3 8B 47±3 local ~6.6GB 8k llama.cpp › 512 MedGemma 4B IT 47±2 local ~4.1GB llama.cpp › 513 Nova Micro 47±2 api $0.061/M 128k aws.amazon.com ↗ 514 Qwen3.5 2B 47±1 local ~2.2GB ~137 tok/s 262k llama.cpp › 515 Claude 2.0 47±1 comparison only 516 Yi 1.5 34B Chat 47±1 local ~22GB 4k LM Studio › 517 OpenChat 3.5 0106 47±1 local ~6.1GB 8k llama.cpp › 518 GPT-3.5 Turbo (0613) 47±1 comparison only 519 WizardCoder Python 34B V1… 47±1 local ~22GB 16k Ollama › 520 Codex code-davinci-002 (G… 47±0 comparison only 521 Granite 4.0 Micro 3B 47±1 local ~3.5GB ~6.2 tok/s 131k LM Studio › 522 Gemma 4 E2B 47±1 api $0.050/M +loc… ~4.5GB 131k aws.amazon.com ↗ 523 Gemini 1.0 Pro (001) 47±2 comparison only 524 DBRX Instruct 47±1 local ~85GB 32k Ollama › 525 Mistral Medium (2312) 47±1 comparison only 526 Granite 34B Code Instruct… 47±1 local ~22GB Ollama › 527 Cogito v1 Preview Llama 3B 47±4 local ~3.4GB 128k LM Studio › 528 Qwen2.5-Math 1.5B Instruct 47±2† local ~1.8GB 4k LM Studio › 529 EXAONE 4.0 1.2B 47±1† local ~2.2GB 66k LM Studio › 530 InternLM2.5 20B Chat 47±2 local ~14GB 33k llama.cpp › 531 StarCoder2-15B-Instruct-v… 47±1 local ~11GB 16k Ollama › 532 Flan-cont-PaLM 62B 47±1† never released 533 Qwen1.5 72B Chat 47±1 local ~31GB 32k llama.cpp › 534 speechless-starcoder2-15b 47±1 local ~12GB llama.cpp › 535 OpenChat 3.5 0106 Gemma 47±2 local ~6.9GB 8k llama.cpp › 536 Granite 3.3 8B Instruct 47±1 local ~6.3GB 128k LM Studio › 537 Phi-3 Medium 128K Instruct 47±1 local ~10GB 128k LM Studio › 538 Qwen2-VL 7B Instruct 47±1 local ~5.8GB LM Studio › 539 PaLM 540B 47±0† never released 540 Claude 2.1 47±1 comparison only 541 Zephyr ORPO 141B-A35B v0.1 47±2 local ~56GB 66k llama.cpp › 542 LFM2 8B-A1B 47±1 comparison only 543 DeepSeek R1 Distill Llama… 46±1 local ~6.2GB 131k LM Studio › 544 Phi-3-medium-4k-instruct 46±1 local ~10GB 4k LM Studio › 545 QwQ-32B-Preview 46±2 local ~21GB 33k LM Studio › 546 Mistral Small (2402) 46±1 comparison only 547 Minerva 62B 46±2† never released 548 Phi-4-mini-reasoning 3.8B 46±2 api $0.13/M +local ~4GB 128k azure.microsoft… 549 DeepSeek-Coder-V2 Lite In… 46±1 local ~9.6GB 128k LM Studio › 550 Qwen2-Math 1.5B Instruct 46±2† local ~2.4GB 4k LM Studio › 551 Llama 3.1 8B Instruct 46±0 api $0.22/M +local ~6.2GB ~47 tok/s 128k aws.amazon.com ↗ 552 Ministral 3 3B 46±1 api $0.10/M +local ~3.4GB ~128 tok/s 262k mistral.ai ↗ 553 Olmo 3 7B Instruct 46±1 local ~5.8GB 66k LM Studio › 554 GPT-3.5 text-davinci-003 46±1 comparison only 555 Command R Plus (04-2024) 46±1 local ~43GB 128k llama.cpp › 556 Mistral NeMo Instruct (24… 46±1 local ~8.8GB 128k LM Studio › 557 GPT-4o Audio Preview (202… 46±2 comparison only 558 Llama 3.1 Tulu 3 8B 46±1 local ~6.2GB 131k LM Studio › 559 Phi-3-mini-4k-instruct (J… 46±1 local ~5.7GB LM Studio › 560 Yi 1.5 9B Chat 46±1 local ~6.8GB 4k LM Studio › 561 Qwen1.5 32B Chat 46±1 local ~22GB 32k llama.cpp › 562 Xwin-LM 70B v0.1 46±1 local ~28GB llama.cpp › 563 Qwen2 7B Instruct 46±1 local ~5.4GB 131k LM Studio › 564 Command R7B (12-2024) 46±1 local ~6.2GB 128k LM Studio › 565 Eurus-2-7B-PRIME 45±2 local ~6.4GB 4k llama.cpp › 566 Granite 20B Code Instruct… 45±1 local ~14GB Ollama › 567 Dolphin 2.6 Mixtral 8x7B 45±1 local ~29GB llama.cpp › 568 Gemma 3 4B 45±1 api $0.063/M +loc… ~3.8GB ~74 tok/s 131k deepinfra.com ↗ 569 Granite 3.0 8B Instruct 45±1 local ~6.6GB 4k llama.cpp › 570 LLaVA-OneVision Qwen2 72B… 45±3 local ~155GB how to run › 571 Granite 8B Code Instruct … 45±1 local ~6.6GB llama.cpp › 572 Falcon3 7B Instruct 45±2 local ~5.9GB 32k LM Studio › 573 Phi-4-mini 3.8B 45±1 api $0.13/M +local ~4GB 128k azure.microsoft… 574 Ministral 8B (2410) 45±1 local ~6.2GB 128k LM Studio › 575 Code Llama 70B Python 45±1 local ~28GB 16k llama.cpp › 576 Code Tulu 2 34B 45±2† local ~72GB how to run › 577 Granite 3.2 8B Instruct 45±1 local ~6.6GB 131k llama.cpp › 578 OpenThinker 7B 45±2† local ~6GB 33k LM Studio › 579 Falcon3 10B Instruct 45±2 local ~7.6GB ~13 tok/s 32k LM Studio › 580 Yi 34B Chat 45±1 local ~23GB 4k llama.cpp › 581 Hermes 2 Theta Llama 3 8B 45±2 local ~6.6GB 8k llama.cpp › 582 Llama 3.1 8B (base) 45±3 local ~6.2GB LM Studio › 583 Gemma 3n E2B IT 45±2 local ~4.1GB 32k llama.cpp › 584 Code Llama 70B (base) 45±1 local ~28GB 16k llama.cpp › 585 Phi-3.5-mini-instruct 45±1 local ~5.7GB 128k LM Studio › 586 Qwen2.5-VL 3B Instruct 45±1 local ~2.8GB llama.cpp › 587 Qwen3 1.7B 45±1 local ~2.6GB ~96 tok/s 33k LM Studio › 588 Qwen3-VL 2B Instruct 45±1 local ~2.7GB 256k llama.cpp › 589 LFM2.5 1.2B Instruct 45±2 local ~1.3GB 33k LM Studio › 590 Claude Instant 1.1 45±2 comparison only 591 Granite 3.1 8B Instruct 44±1 local ~6.7GB 128k llama.cpp › 592 Reka Flash 21B (2024-02-2… 44±1 comparison only 593 GPT-3.5 text-davinci-002 44±0 comparison only 594 Flan-PaLM 62B 44±1† never released 595 Qwen2.5 3B Instruct 44±1 local ~2.6GB ~61 tok/s 33k LM Studio › 596 CogVLM2 Llama3 Chat 19B 44±3 local ~43GB how to run › 597 Llama 3.2 11B Vision Inst… 44±2 local ~8.9GB 128k Ollama › 598 LFM2 2.6B 44±1 local ~2GB 33k LM Studio › 599 Tulu 2 DPO 70B 44±1 local ~32GB llama.cpp › 600 Phi-3-small-8k-instruct 44±2 local ~17GB how to run › 601 MiniCPM-V 2.6 44±2 local ~5.8GB llama.cpp › 602 CodeGemma 7B IT (v1.0) 44±1 local ~7.1GB llama.cpp › 603 Yi-1.5 9B (base) 44±2 local ~6.8GB 4k LM Studio › 604 Claude Instant 1.2 44±1 comparison only 605 Qwen2-Audio 7B Instruct 44±3 local ~6.5GB llama.cpp › 606 DeepSeek-Coder 1.3B Instr… 44±1 local ~2.9GB 16k Ollama › 607 Aya 23 8B 44±3 local ~6.2GB 8k LM Studio › 608 Qwen2.5 Coder 1.5B Instru… 44±1 local ~1.8GB 33k LM Studio › 609 WizardLM 70B V1.0 44±1 local ~32GB llama.cpp › 610 Mathstral 7B v0.1 44±1 local ~5.6GB 32k LM Studio › 611 SmolLM3 3B 44±1 local ~2.9GB 66k LM Studio › 612 Hermes 3 Llama 3.1 8B 44±1 local ~6.6GB 128k llama.cpp › 613 Llama 3 8B Instruct 44±0 local ~6.6GB 8k llama.cpp › 614 Command R (03-2024) 44±1 local ~33GB 128k llama.cpp › 615 Aya Vision 32B 44±3 api price unknown… ~71GB 16k cohere.com ↗ 616 WizardCoder Python 13B V1… 43±2 local ~15GB 16k llama.cpp › 617 OpenChat 3.5 43±1 local ~6.1GB 8k llama.cpp › 618 Granite 34B Code Base (8K) 43±1 local ~24GB llama.cpp › 619 speechless-starcoder2-7b 43±1 local ~6.1GB llama.cpp › 620 Falcon2 11B (base) 43±3 local ~8.2GB 8k Ollama › 621 Snowflake Arctic Instruct 43±2 local ~1007GB how to run › 622 OLMo 2 7B Instruct (1124) 43±1 local ~5.8GB 4k LM Studio › 623 WizardCoder-15B-V1.0 43±1 local ~12GB llama.cpp › 624 Ministral 3B (2410) 43±1 comparison only 625 Phi-3-vision-128k-instruct 43±2 local ~10GB how to run › 626 cont-PaLM 62B (PaLM 62B t… 43±1† never released 627 DeepSeek LLM 67B Chat 43±1 local ~31GB 4k llama.cpp › 628 Qwen1.5 14B Chat 43±1 local ~11GB 32k Ollama › 629 Llama 2 70B (base) 43±1 local ~32GB 4k llama.cpp › 630 Mixtral 8x7B v0.1 (base) 43±1 local ~29GB 32k llama.cpp › 631 Code Llama 34B Python 43±1 local ~23GB 16k Ollama › 632 DeepSeek-Coder 33B Base 43±1 local ~22GB 16k llama.cpp › 633 speechless-coding-7b-16k-… 43±1 local ~16GB how to run › 634 InternVL2-4B 43±2 local ~10GB how to run › 635 InternLM2 Chat 20B 43±1 local ~14GB llama.cpp › 636 CodeQwen1.5 7B (base) 42±1 local ~6.4GB 66k llama.cpp › 637 Nous Hermes 2 Mistral 7B … 42±3 local ~6.1GB 33k llama.cpp › 638 Mixtral 8x7B Instruct v0.1 42±0 local ~28GB 32k LM Studio › 639 U-PaLM 62B 42±2† never released 640 Granite 4.0 1B 42±1 local ~2.4GB 128k LM Studio › 641 OpenHermes-2.5-Code-290k-… 42±1 local ~9.8GB llama.cpp › 642 Granite 4.0 H 1B 42±1 local ~2.3GB 131k LM Studio › 643 Nous Hermes 2 Mixtral 8x7… 42±2 local ~30GB 33k llama.cpp › 644 Deita 7B v1.0 42±2 local ~32GB how to run › 645 Vicuna 13B v1.1 42±2 comparison only 646 Molmo 7B-D (0924) 42±1 local ~35GB how to run › 647 OpenHermes 2.5 Mistral 7B 42±1 local ~5.9GB llama.cpp › 648 Code Llama 34B Instruct 42±1 local ~22GB 16k LM Studio › 649 North Micro Vision Instru… 42±2† local ~3.8GB 128k how to run › 650 Starling-LM 7B beta 42±1 local ~6GB 8k LM Studio › 651 Code Llama 34B (base) 42±1 local ~23GB 16k Ollama › 652 Vicuna 33B v1.3 41±1 local ~23GB 2k Ollama › 653 Phi-3-mini-128k-instruct … 41±2 local ~9.5GB how to run › 654 Bielik 1.5B v3.0 Instruct 41±3 local ~2.4GB LM Studio › 655 Starling-LM 7B alpha 41±1 local ~6.1GB 8k llama.cpp › 656 Code Tulu 2 13B 41±2† local ~29GB how to run › 657 Mistral 7B Instruct v0.3 41±1 local ~5.6GB 32k LM Studio › 658 LLaVA-v1.6-34B 41±2 local ~24GB 4k Ollama › 659 Granite 3.3 2B Instruct 41±1† local ~3GB 128k LM Studio › 660 Llama3-OpenBioLLM-8B 41±2 local ~6.6GB llama.cpp › 661 DeepSeek-Coder 6.7B Base 41±1 local ~8.8GB 16k llama.cpp › 662 LFM2 1.2B 41±1 local ~1.3GB 33k LM Studio › 663 Granite 3.0 2B Instruct 41±1 local ~3.2GB 4k llama.cpp › 664 Llama 2 70B Chat 41±1 local ~32GB 4k llama.cpp › 665 Granite 8B Code Base (4K) 41±1 local ~6.6GB llama.cpp › 666 StarCoder2 15B 41±1 local ~11GB 16k LM Studio › 667 Llama 3.2 3B Instruct 40±1 api $0.12/M +local ~3.3GB ~139 tok/s 131k cloudflare.com ↗ 668 Falcon-H1 3B Instruct 40±3 local ~3.4GB 131k LM Studio › 669 Phi-2 (2.7B) 40±1 local ~4.7GB 2k LM Studio › 670 speechless-code-mistral-7… 40±1 local ~17GB how to run › 671 Llama-3-Instruct-8B-SimPO… 40±1 local ~6.6GB llama.cpp › 672 Qwen-14B-Chat 40±1 local ~11GB llama.cpp › 673 Code Llama 13B Instruct 40±1 local ~15GB 16k llama.cpp › 674 Tulu 2 13B 40±2 local ~9.8GB llama.cpp › 675 Falcon-180B-Chat 40±2 local ~115GB 2k Ollama › 676 MistralHermes-CodePro-7B-… 40±1 local ~6.1GB llama.cpp › 677 LLaMA 65B 40±1 comparison only 678 Phi-3-mini-4k-instruct (A… 40±2 local ~6GB llama.cpp › 679 CodeGemma 7B (v1.0) 40±1 local ~7.1GB llama.cpp › 680 Code Llama 13B Python 40±1 local ~9.8GB 16k llama.cpp › 681 Apertus 8B Instruct (2509) 40±3 local ~6.3GB 66k LM Studio › 682 DeepSeek-V2 Lite Chat (16… 40±1 local ~11GB 32k LM Studio › 683 Granite 3B Code Instruct … 40±1 local ~3.7GB llama.cpp › 684 Tulu 2 DPO 13B 39±1 local ~9.8GB llama.cpp › 685 BioMistral-7B 39±3 local ~6.1GB llama.cpp › 686 PaLM 62B 39±1† never released 687 SOLAR 10.7B Instruct v1.0 39±1 local ~8.3GB 4k llama.cpp › 688 Code Tulu 2 7B 39±2† local ~16GB how to run › 689 Gemma 2 2B IT 39±1 local ~3.2GB 8k LM Studio › 690 Yi-1.5 6B (base) 39±3 local ~5.1GB 4k LM Studio › 691 Flan-T5 XXL 39±1 local ~49GB how to run › 692 Dolphin 2.2.1 Mistral 7B 39±2 local ~5.9GB llama.cpp › 693 Gemma 1.1 7B IT 39±1 local ~7.1GB 8k llama.cpp › 694 Phi-3.5-vision-instruct 39±2 local ~10GB how to run › 695 Granite 20B Code Base (8K) 39±1 local ~15GB llama.cpp › 696 Granite 3.1 2B Instruct 39±1 local ~3.1GB 128k llama.cpp › 697 Code Llama 7B Python 39±1 local ~5.8GB 16k llama.cpp › 698 Qwen1.5 7B Chat 39±1 local ~9.7GB 32k llama.cpp › 699 Granite 3.2 2B Instruct 39±1 local ~3GB 131k LM Studio › 700 Code Llama 13B (base) 38±1 local ~9.2GB 16k LM Studio › 701 Falcon3 3B Instruct 38±3 local ~3.4GB 32k LM Studio › 702 Qwen2.5 Coder 0.5B Instru… 38±1 local ~1GB 33k LM Studio › 703 Vicuna 13B v1.5 38±1 local ~9.8GB 4k llama.cpp › 704 Zephyr 7B alpha 38±1 local ~6.1GB llama.cpp › 705 Yi 1.5 6B Chat 38±2 local ~4.4GB 4k LM Studio › 706 WizardLM 13B V1.2 38±1 local ~9.8GB llama.cpp › 707 Qwen2-VL 2B Instruct 38±1 local ~2.1GB 33k LM Studio › 708 Qwen2.5 1.5B Instruct 38±1 local ~1.8GB ~98 tok/s 33k LM Studio › 709 Mistral 7B Instruct v0.2 38±1 local ~5.8GB 32k LM Studio › 710 Code Llama 7B Instruct 38±1 local ~5.5GB 16k LM Studio › 711 Tulu 2 7B 38±2 local ~5.8GB llama.cpp › 712 Qwen3.5 0.8B 38±1 local ~1.4GB ~94 tok/s 262k llama.cpp › 713 MPT-30B-Chat 38±2 comparison only 714 LFM2 700M 38±1 local ~1GB 33k LM Studio › 715 LLaMA 33B 38±1 comparison only 716 EXAONE 3.5 2.4B Instruct 38±2 local ~3GB 33k LM Studio › 717 xDAN-L1-Chat-RL-v1 37±1 local ~6.1GB llama.cpp › 718 Flan-PaLM 8B 37±1† never released 719 Mistral 7B v0.1 (base) 37±1 local ~5.8GB 8k LM Studio › 720 Llama 3 8B (base) 37±1 local ~6.6GB llama.cpp › 721 Flan-T5 XL 37±1 local ~14GB how to run › 722 Gemma 7B (base) 37±1 local ~7.1GB 8k llama.cpp › 723 Tulu 2 DPO 7B 37±1 local ~5.8GB llama.cpp › 724 Vicuna 13B v1.3 37±2 local ~29GB 2k how to run › 725 Granite 3.0 3B-A800M Inst… 37±1 local ~3.7GB 4k llama.cpp › 726 Granite 3.1 3B-A800M Inst… 37±2† local ~3.6GB ~23 tok/s 131k llama.cpp › 727 DeepSeek R1 Distill Qwen … 37±2 local ~1.9GB 131k LM Studio › 728 StarCoder2 7B 37±1 local ~5.4GB 16k LM Studio › 729 Vicuna 7B v1.1 37±2 comparison only 730 DeepSeek LLM 7B Chat 37±2† local ~5.7GB Ollama › 731 Falcon 40B (base) 36±1 local ~27GB 2k Ollama › 732 StarCoder 15.5B 36±1 local ~11GB Ollama › 733 Eurus-2-7B-SFT 36±3† local ~6.4GB llama.cpp › 734 Nous-Hermes-13b 36±2 local ~9.8GB 2k llama.cpp › 735 Qwen3 0.6B 36±1 local ~1.9GB ~182 tok/s 33k LM Studio › 736 PaLM 2 Chat (chat-bison@0… 36±2 comparison only 737 Code Llama 7B (base) 36±1 local ~5.5GB 16k LM Studio › 738 Llama 2 13B (base) 36±1 local ~9.3GB 4k Ollama › 739 Llama 2 13B Chat 36±1 local ~15GB 4k llama.cpp › 740 Zephyr 7B beta 35±1 local ~6.1GB llama.cpp › 741 Guanaco 33B 35±1 local ~70GB how to run › 742 StarCoder2 3B 35±1 local ~3.4GB 16k llama.cpp › 743 StarCoderBase 15.5B 35±1 local ~12GB llama.cpp › 744 Vicuna 7B v1.5 35±1 local ~5.8GB 4k llama.cpp › 745 Granite 3B Code Base (2K) 35±1 local ~3.7GB llama.cpp › 746 ChatGLM3 6B 128K 35±4 local ~5.8GB 131k llama.cpp › 747 Minerva 8B 35±2† never released 748 OLMo 2 1B Instruct (0425) 35±1 local ~2.4GB 4k llama.cpp › 749 Vicuna 7B v1.3 35±2 local ~5.8GB 2k llama.cpp › 750 Stable Code 3B 35±1 local ~4.8GB 16k llama.cpp › 751 Orca 2 13B 35±3 local ~9.8GB 4k llama.cpp › 752 T0 11B 35±3 comparison only 753 DeepSeek-Coder 1.3B Base 34±1 local ~2.4GB 16k Ollama › 754 Qwen1.5 4B Chat 34±2 local ~4.1GB 32k llama.cpp › 755 Gemma 7B IT 34±1 local ~7.1GB 8k llama.cpp › 756 Mistral 7B Instruct v0.1 34±1 local ~5.9GB 8k llama.cpp › 757 GPT-3 text-davinci-001 34±1 comparison only 758 LaMDA 137B (pre-trained, … 34±1† never released 759 CodeGemma 2B (v1.0) 34±1 local ~3.2GB llama.cpp › 760 Qwen2 1.5B Instruct 34±1 local ~1.8GB 32k LM Studio › 761 Falcon-H1 1.5B Instruct 33±4 local ~2.4GB 131k LM Studio › 762 Ghost 7B Alpha 33±2 local ~6.1GB llama.cpp › 763 Gemma 3 1B 33±1 local ~1.7GB ~98 tok/s 32k LM Studio › 764 SmolLM2 1.7B Instruct 33±1 local ~3GB 8k LM Studio › 765 Qwen-7B (base) 33±1 local ~6.6GB 33k llama.cpp › 766 LFM2 350M 33±2 local ~1.7GB 33k LM Studio › 767 OPT-175B 33±1 comparison only 768 StarCoderBase 7B 33±1 local ~6GB Ollama › 769 BLOOMZ 176B 33±2 comparison only 770 Phi-1.5 (1.3B) 33±1 local ~2.4GB 2k llama.cpp › 771 Codex code-davinci-001 33±1 comparison only 772 Llama 3.2 1B Instruct 33±1 api $0.020/M +loc… ~1.6GB ~28 tok/s 131k novita.ai ↗ 773 LLaMA 13B 32±1 comparison only 774 Qwen-7B-Chat 32±1 local ~6.6GB 33k llama.cpp › 775 Llama 2 7B Chat 32±1 local ~8.8GB 4k llama.cpp › 776 OLMo 7B Instruct 32±2 local ~16GB how to run › 777 Llama 2 7B (base) 32±1 local ~8.5GB 4k Ollama › 778 Koala 13B 32±1 comparison only 779 Flan-T5 Large 32±1 local ~4.8GB how to run › 780 GPT-3 davinci (API base m… 32±1 comparison only 781 Falcon 40B Instruct 31±2 local ~27GB Ollama › 782 Granite 3.1 1B-A400M Inst… 31±2† local ~2.3GB ~20 tok/s 131k llama.cpp › 783 Gemma 2B (base) 31±1 local ~3.2GB 8k llama.cpp › 784 Gemma 1.1 2B IT 31±1 local ~3.2GB 8k llama.cpp › 785 Falcon 7B (base) 31±1 local ~5.9GB 2k Ollama › 786 Alpaca 7B 31±1 comparison only 787 Baichuan2-7B-Base 30±1 local ~17GB how to run › 788 LLaMA 7B 30±1 comparison only 789 NexusRaven V2 13B 30±3 local ~9.3GB 16k Ollama › 790 MPT-7B (base) 30±1 comparison only 791 ChatGLM3-6B 30±2 local ~5.8GB llama.cpp › 792 Qwen2.5 0.5B Instruct 30±2 local ~1GB 33k LM Studio › 793 OLMo 7B 30±1† local ~30GB 2k how to run › 794 StableLM-3B-4E1T 30±1 local ~3.3GB 4k llama.cpp › 795 StarCoderBase 3B 30±1 local ~3.4GB Ollama › 796 OpenLLaMA 7B v2 30±1 local ~9.1GB llama.cpp › 797 StableLM-Base-Alpha 7B v2 30±1 local ~30GB 4k how to run › 798 Granite 3.0 1B-A400M Inst… 30±1 local ~2.3GB 4k llama.cpp › 799 OPT-66B 29±1 local ~141GB 2k how to run › 800 MPT-7B-Chat 29±2 comparison only 801 GPT4All-13B-Snoozy 29±2 local ~56GB how to run › 802 Alpaca 13B 29±2 comparison only 803 EuroLLM 1.7B Instruct 29±3 local ~2.4GB 4k LM Studio › 804 Granite 4.0 H 350M 29±1† local ~1.7GB 33k LM Studio › 805 BLOOMZ 7.1B 29±2 comparison only 806 BLOOM 176B 29±1 local ~372GB 2k how to run › 807 Gemma 2B IT 29±1 local ~3.1GB 8k llama.cpp › 808 Granite 4.0 350M 28±1 local ~1.7GB 32k LM Studio › 809 OPT-30B 28±1 local ~64GB 2k how to run › 810 UL2 20B 28±3† comparison only 811 Qwen2 0.5B Instruct 28±2 local ~1GB 32k LM Studio › 812 GPT-NeoX-20B 28±1 local ~14GB 2k LM Studio › 813 RedPajama-INCITE 7B Base 28±1 local ~16GB 2k how to run › 814 ChatGLM2-6B 28±2 local ~15GB how to run › 815 RWKV-4-Raven 14B 27±2 comparison only 816 LaMDA 68B (pre-trained) 27±1† never released 817 BLOOMZ 3B 27±2 comparison only 818 Falcon3 1B Instruct 26±4 local ~2.4GB 8k LM Studio › 819 Qwen1.5 1.8B Chat 26±2 local ~2.7GB 33k Ollama › 820 Tk-Instruct 11B (def) 26±4 comparison only 821 OPT-13B (13 billion param… 26±1 local ~29GB 2k how to run › 822 PaLM 8B 26±1† never released 823 Falcon 7B Instruct 26±2 local ~5.9GB Ollama › 824 OpenAssistant SFT-4 Pythi… 25±1 local ~9.5GB llama.cpp › 825 Flan-T5 Base 25±1 local ~2.5GB how to run › 826 RedPajama-INCITE Base 3B … 25±3 local ~3.4GB 2k llama.cpp › 827 GPT-3 curie (API base mod… 25±1 comparison only 828 Pythia 12B 25±1 local ~9.5GB 2k llama.cpp › 829 GPT-J 6B 25±1 local ~14GB 2k how to run › 830 OpenLLaMA 3B v2 25±1 local ~4.2GB llama.cpp › 831 ChatGLM-6B 25±1 local ~16GB how to run › 832 StableLM-Base-Alpha 3B v2 24±1 local ~13GB 4k how to run › 833 OPT-6.7B 24±1 local ~16GB 2k how to run › 834 T0 3B 23±4 comparison only 835 Qwen1.5 0.5B Chat 23±3 local ~1.7GB 33k LM Studio › 836 BLOOMZ 1.7B 23±3 comparison only 837 Pythia 6.9B 23±1 local ~6.1GB 2k llama.cpp › 838 T0++ (T0pp) 11B 23±3 comparison only 839 Phi-1 (1.3B) 22±4 local ~2.4GB 2k llama.cpp › 840 Dolly v2 12B 22±1 comparison only 841 SmolLM2 360M Instruct 22±3 local ~1GB 8k LM Studio › 842 FastChat-T5 3B 21±2 local ~8.5GB how to run › 843 OLMo 1B 21±2† local ~2.2GB 2k llama.cpp › 844 BLOOM 7.1B 21±1 local ~7.1GB 2k llama.cpp › 845 Pythia 2.8B 20±1 local ~3.4GB 2k llama.cpp › 846 Pythia 2.8B (deduped) 20±1 local ~3.4GB 2k llama.cpp › 847 Falcon-RW 1B 19±2 local ~4.3GB 2k how to run › 848 OPT-2.7B 19±1 local ~7.1GB 2k how to run › 849 GPT-Neo 2.7B 18±1 local ~13GB 2k how to run › 850 StableLM-Tuned-Alpha 7B 18±2 local ~6.9GB llama.cpp › 851 BLOOMZ 1.1B 18±3 comparison only 852 T5 Large 17±2 local ~4.6GB 1k how to run › 853 Gemma 3 270M IT 16±4 local ~1.1GB 32k LM Studio › 854 Flan-T5 Small 16±3 local ~1.8GB how to run › 855 BLOOM 3B 16±1 local ~4GB 2k llama.cpp › 856 GPT-3 babbage (API base m… 15±1 comparison only 857 BLOOMZ 560M 14±4 comparison only 858 OPT-1.3B 14±1 local ~4.3GB 2k how to run › 859 T5 Base 14±3 local ~2.4GB 1k how to run › 860 Pythia 1.4B 14±1 local ~2.4GB 2k llama.cpp › 861 Pythia 1B 12±1 local ~2.2GB 2k llama.cpp › 862 LaMDA 8B (pre-trained) 12±2† never released 863 GPT-3 text-curie-001 12±1 comparison only 864 GPT-Neo 1.3B 12±2 local ~7.1GB 2k how to run › 865 T5 Small 12±3 local ~1.8GB 1k how to run › 866 BLOOM 1.7B 11±1 local ~3.1GB 2k llama.cpp › 867 Zyte-1B 11±2 local ~2.2GB llama.cpp › 868 LaMDA 2B (pre-trained) 10±2† never released 869 StableLM-Base-Alpha 7B 8±1 local ~35GB 4k how to run › 870 Pythia 410M 8±2 local ~1.8GB 2k llama.cpp › 871 GPT-3 ada (API base model) 8±1 comparison only 872 BLOOM 1.1B 7±1 local ~2.6GB 2k llama.cpp › 873 GPT-2 XL (1.5B) 7±1 local ~2.8GB ~75 tok/s 1k llama.cpp › 874 GPT-3 text-babbage-001 4±2 comparison only 875 GPT-3 text-ada-001 1±3 comparison only 876 OPT-350M 1±1 local ~2.2GB 2k how to run › 877 LaMDA 422M (pre-trained) 1±3† never released 878 StableLM-Base-Alpha 3B 1±2 local ~17GB 4k how to run › 879 BLOOM 560M 0±1 local ~2.1GB 2k llama.cpp › 880 Pythia 160M -2±2 local ~1.6GB 2k llama.cpp › 881 GPT-2 Large (774M) -3±1 local ~2GB ~137 tok/s 1k llama.cpp › 882 OPT-125M -3±1 local ~1.8GB 2k how to run › 883 GPT-Neo 125M -3±2 local ~2.1GB 2k how to run › 884 GPT-2 Medium (355M) -5±1 local ~1.8GB 1k llama.cpp › 885 GPT-2 Small (124M) -13±2 local ~1.6GB 1k LM Studio › 886 Pythia 70M -13±2 local ~1.6GB 2k llama.cpp › — Grok Build 0.1 no reviewed results api $1.25/M 256k x.ai ↗ — K2 Horizon 7B not scored yet local ~8GB 524k llama.cpp › — LFM2.5 24B-A2B not yet calibrated local ~17GB 131k llama.cpp › — LFM3 1.7B not yet calibrated local ~2.6GB 262k llama.cpp › — Mistral Large 4 (October … no reviewed results api price unknown… ~2102GB mistral.ai ↗\+ 308 models with fewer than 3 results aren't ranked here · [show them](https://whatmodel.sh/?thin=1) \* new or thinly tested: ranked on too few benchmark results · † no independently run results verified · ~RAM is estimated; full context may need more memory · 891 of 1230 catalogue models listed here · [sources and licences](pages/method.md#sources)
