[whatmodel.sh](../../README.md) / Grok 3 Mini Beta
# Grok 3 Mini Beta
SpaceXAI (xAI) · released 2025-04 · proprietary
**score 63.2** ±1.0 · comparison only: no current run option verified · from 10 benchmark results across 8 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks Grok 3 Mini Beta among every model on that task or test, worst to best.
task vs the others rank counts tests
agent tasks ▁▁▂●█▄▅▄▄▃▁▁ #284 of 354* 9.4% 2
coding ▁▁▁▃▄▆█●▅▄▃▁ #161 of 539* 35% 2
chat & writing ▁▁▁▃▅▄▇█●▇▇▃ #177 of 474* 11% 1
math ▁▁▃▆██●█▃▁▁▁ #183 of 530 21% 3
web search ▂▁▂▆▅█▅▄▁▂●▁ #4 of 96* 7.2% 1
agent tasks · #284 of 354 · 9.4% of its score
Beats [o3-mini](o3-mini.md) here, though they rank higher overall. Trails [Granite 4.0 1B](granite-4-0-1b.md), [SmolLM3 3B](smollm3-3b.md), [Qwen3-VL 2B Instruct](qwen3-vl-2b-instruct.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Finance Agent Benchmark v1 (537 q… 30.9% █·▃▃·█▅▅▅●▃▅ beats 15/18 very hard · avg 5.5% 7.2% sharp
BFCL v3 53.0% ▁▁▁▁▁▃▅●▅▄▁▁ beats 51/114 medium · avg 51% 2.1% blunt · at its level
coding · #161 of 539 · 35% of its score
Beats [Qwen3.5 Plus](qwen3-5-plus.md), [Qwen3-Coder-Next (80B-A3B)](qwen3-coder-next.md), [Gemini 2.5 Pro](gemini-2-5-pro.md) here, though they rank higher overall. Trails [Llama 3.1 Nemotron Ultra 253B v1](llama-3-1-nemotron-ultra-253b.md), [Gemma 4 12B](gemma-4-12b.md), [Seed-OSS 36B Instruct](seed-oss-36b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Aider polyglot (225 exercises, tw… 49.3% ▂·▂▃▅▂▃●▆▄▂▂ beats 26/49 very hard · avg 7.6% 28% sharp · at its level
LiveCodeBench official (Aug 1, 20… 66.7% ▃▃▅▃··▃▅●▅▅▃ beats 10/15 hard · avg 24% 7.1% sharp · at its level
chat & writing · #177 of 474 · 11% of its score
Beats [INTELLECT-3](intellect-3.md), [MiniMax-M2](minimax-m2.md), [Nemotron 3 Super 120B-A12B](nemotron-3-super-120b-a12b.md) here, though they rank higher overall. Trails [LFM2.5 1.2B Thinking](lfm2-5-1-2b-thinking.md), [LFM2.5 8B-A1B](lfm2-5-8b-a1b.md), [LFM2.5 2.6B](lfm2-5-2-6b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
LMArena (text) 1363.7 ▁▁▁▂▃▃▃▆●▇█▃ beats 206/385 avg 1260 11% blunt
math · #183 of 530 · 21% of its score
Beats [MiMo-V2.5 (310B-A15B)](mimo-v2-5.md), [MiniMax-M2.7](minimax-m2-7.md), [MiniMax-M2.1](minimax-m2-1.md) here, though they rank higher overall. Trails [Olmo 3 7B Think](olmo-3-7b-think.md), [Nemotron Nano 9B v2](nemotron-nano-9b-v2.md), [Qwen3-VL 4B Thinking](qwen3-vl-4b-thinking.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
MATH level 5 88.1% ▂▂▅▆▄█▆▃●▂▃▄ beats 75/92 hard · avg 28% 11% sharp
OTIS mock AIME 2024–2025 77.8% ▃▃▄▃▃▃▇●█▃▂▅ beats 111/197 very hard · avg 7.2% 8.2% sharp · at its level · noisy
THINK-Bench final-answer accuracy… 91.8% ▄█·▄····▄●·█ beats 5/7 easy · avg 76% 1.3% typical
web search · #4 of 96 · 7.2% of its score
Beats [GPT-6 Astra](gpt-6-astra.md), [Claude Opus 5.5](claude-opus-5-5.md), [GPT-6.1 Sol](gpt-6-1-sol.md) here, though they rank higher overall.
test result vs the others in its run difficulty counts why
Finance Agent Benchmark v1 (537 q… 30.9% █·▃▃·█▅▅▅●▃▅ beats 15/18 very hard · avg 5.5% 7.2% sharp
other tests (2)
test result vs the others in its run difficulty counts why
GPQA Diamond 75.5% ▁▁▁▁▂▄▆▄●▇█▅ beats 113/211 hard · avg 39% 17% sharp · at its level
EQ-Bench 3 (emotional intelligenc… 1146.8 ▁·▂▁▄●▅▃█▄▁▁ beats 19/62 avg 1034 6.5% typical
source results share of the score
Epoch AI 3 37% ▇▇▇▇
Aider polyglot benchmark runs 1 28% ▇▇▇
LMArena leaderboard dataset 1 11% ▇
Finance Agent Benchmark 1 7% ▇
LiveCodeBench official website results 1 7% ▇
EQ-Bench 3 canonical leaderboard results 1 6% ▇
Berkeley Function Calling Leaderboard r… 1 2% ▇
THINK-Bench: Evaluating Thinking Effici… 1 1% ▇
prior: pull toward the middle 0% ▇
weighted average = 63.2
Licences: Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Aider polyglot benchmark runs ([Apache-2.0](../../licenses/aider-polyglot-runs-Apache-2.0.txt)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Finance Agent Benchmark ([CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/)) · LiveCodeBench official website results ([CC-BY-SA-4.0](../../licenses/lcb-sharealike-NOTICE.txt)) · EQ-Bench 3 canonical leaderboard results ([MIT](../../licenses/eqbench3-MIT.txt)) · Berkeley Function Calling Leaderboard result archive ([Apache-2.0](../../licenses/bfcl-result-archive-v4-Apache-2.0.txt)) · THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models ([CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/))
## How to run it
No verified API or local download yet.
[interactive version](https://whatmodel.sh/model/grok-3-mini-beta) · [JSON](https://whatmodel.sh/api?format=json&all=1)