[whatmodel.sh](../../README.md) / Grok 2 (1212) # Grok 2 (1212) SpaceXAI (xAI) · released 2024-12 · proprietary **score 56.9** ±0.9 · comparison only: no current run option verified · from 7 benchmark results across 2 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Grok 2 (1212) among every model on that task or test, worst to best. 
task    vs the others          rank  counts  tests
coding  ▁▁▁▃▄▆█●▅▄▃▁   #230 of 539*     15%      1
math    ▁▁▃▆█●▅█▃▁▁▁    #272 of 530     32%      3
coding · #230 of 539 · 15% of its score Beats [Gemini 2.5 Flash](gemini-2-5-flash.md), [Qwen3 30B-A3B Instruct 2507](qwen3-30b-a3b-instruct-2507.md), [Qwen3.5 4B](qwen3-5-4b.md) here, though they rank higher overall. Trails [QwQ-32B-Preview](qwq-32b-preview.md), [DeepSeek-Coder-V2 Instruct (0724)](deepseek-coder-v2-0724.md), [Ministral 3 8B Reasoning 2512](ministral-3-8b-reasoning.md) here, though they rank lower overall. 
test                               result  vs the others in its run  difficulty        counts  why
CRUXEval (ZeroEval, 800 problems)   75.3%  ▁▂▆▃▆█●▃▂·▁▁ beats 38/47  medium · avg 57%     15%  sharp
math · #272 of 530 · 32% of its score Beats [GPT-4o (2024-08-06)](gpt-4o-2024-08-06.md), [Command A (03-2025)](command-a.md), [GPT-4o (2024-05-13)](gpt-4o-2024-05-13.md) here, though they rank higher overall. Trails [Gemma 7B (base)](gemma-7b-base.md), [Phi-2 (2.7B)](phi-2.md), [Granite 8B Code Base (4K)](granite-8b-code-base-4k.md) here, though they rank lower overall. 
test                                result  vs the others in its run   difficulty            counts  why
MATH level 5                         63.5%  ▂▂▅▆▄█●▃▅▂▃▄ beats 54/92   hard · avg 28%           16%  sharp · at its level
MATH Level 5 (ZeroEval, 721 probl…   60.9%  ▁▁▁▆█▂▇▇●··▂ beats 35/38   hard · avg 30%           10%  sharp · at its level
OTIS mock AIME 2024–2025             11.5%  ▃▃▄●▃▃▇▇█▃▂▅ beats 51/197  very hard · avg 7.2%    5.0%  sharp · at its level · noisy
other tests (3) 
test                                result  vs the others in its run   difficulty      counts  why
MMLU-Redux (ZeroEval, 2,778 quest…   87.4%  ▁·▁▁▄▄▄▅█●▂▁ beats 49/53   easy · avg 75%     24%  typical
ZebraLogic (ZeroEval, 1,000 puzzl…   27.7%  ▁▁▃▆█●▁▁·▁▁▁ beats 44/57   hard · avg 15%     16%  sharp · at its level
GPQA Diamond                         53.8%  ▁▁▁▁▂▄▆●▅▇█▅ beats 75/211  hard · avg 39%     12%  sharp · at its level
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                               results  share of the score
WildEval ZeroEval published results        4   66% ▇▇▇▇▇▇▇▇
Epoch AI                                   3   34% ▇▇▇▇
prior: pull toward the middle                   0% ▇
weighted average                              = 56.9
Licences: WildEval ZeroEval published results ([Apache-2.0](../../licenses/zeroeval-published-results-Apache-2.0.txt)) · Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/grok-2-1212) · [JSON](https://whatmodel.sh/api?format=json&all=1)