[whatmodel.sh](../../README.md) / GPT-4 Turbo Preview (0125)
# GPT-4 Turbo Preview (0125)
OpenAI · released 2024-01 · proprietary
**score 54.6** ±0.6 · comparison only: no current run option verified · from 16 benchmark results across 9 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks GPT-4 Turbo Preview (0125) among every model on that task or test, worst to best.
task vs the others rank counts tests
coding ▁▁▁▃▄▆●▇▅▄▃▁ #265 of 539 19% 3
chat & writing ▁▁▁▃▅▄▇●▇▇▇▃ #247 of 474 18% 3
math ▁▁▃▆●█▅█▃▁▁▁ #362 of 530 13% 3
coding · #265 of 539 · 19% of its score
Beats [Qwen3.5 4B](qwen3-5-4b.md), [Qwen3-VL 32B Instruct](qwen3-vl-32b-instruct.md), [Solar Open 100B (102B-A12B)](solar-open-100b.md) here, though they rank higher overall. Trails [QwQ-32B-Preview](qwq-32b-preview.md), [Ministral 3 3B Reasoning 2512](ministral-3-3b-reasoning.md), [s1.1 32B](s1-1-32b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
HumanEval 83.5% ▁█▄▅▇█·▄▇▅▄● beats 42/42 easy · avg 75% 10% sharp
Aider code editing (133 Exercism … 66.2% ▁·▁▂▄▁▆▄●▆▂▂ beats 41/62 medium · avg 51% 7.6% sharp · at its level
HumanEval (simple-evals) (maker) 86.6% ●█▆▆▂··▂···▂ beats 1/15 easy · avg 83% 1.4% typical
chat & writing · #247 of 474 · 18% of its score
Beats [Gemma 2 9B IT SimPO](gemma-2-9b-simpo.md), [Granite 4.2 8B](granite-4-2-8b.md), [Mistral Small 4 (119B-A6.5B)](mistral-small-4.md) here, though they rank higher overall. Trails [LFM2.5 1.2B Instruct](lfm2-5-1-2b-instruct.md), [Granite 4.0 H Micro 3B](granite-4-0-h-micro.md), [Gemma 3n E4B](gemma-3n-e4b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena-Hard (v0.1, GPT-4-1106 judg… 78.0% ▂▁▁▅█▅▄▃▃●▃▁ beats 51/60 medium · avg 47% 9.4% sharp · at its level
LMArena (text) 1313.3 ▁▁▁▂▃▃▃●▆▇█▃ beats 142/385 avg 1260 4.2% blunt
Polyrating rating (bias-aware re-… 1255.0 ▂▁▂▁▃▇█▆▇▄●▂ beats 90/95 avg 1187 3.9% typical
math · #362 of 530 · 13% of its score
Beats [Molmo 2 8B](molmo-2-8b.md) here, though they rank higher overall. Trails [DeepSeek R1 Distill Qwen 1.5B](deepseek-r1-distill-qwen-1-5b.md), [Gemma 7B (base)](gemma-7b-base.md), [Mistral 7B v0.1 (base)](mistral-7b-v0-1.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
MATH level 5 35.4% ▂▂▅▆●█▆▃▅▂▃▄ beats 27/92 hard · avg 28% 9.4% sharp · at its level
MATH (simple-evals, original test… 64.5% ●····▄··▄··█ beats 1/5 medium · avg 62% 1.7% at its level
MGSM (simple-evals) (maker) 85.1% ▁····●▅▁█▁▃▁ beats 1/16 easy · avg 80% 1.7% typical
other tests (7)
test result vs the others in its run difficulty counts why
LiveBench 2024-07-26 48.9% ▁▁▁▂▂▃▂█▆▃●▃ beats 52/61 medium · avg 38% 18% at its level
EvoEval (overall) 65.1% ▂▂▃▄▄█▁▄▅▃▁● beats 41/42 medium · avg 52% 11% at its level
GPQA Diamond (simple-evals) (make… 41.4% ●▃▃█·▃▃▅▃▃▃▅ beats 1/16 hard · avg 39% 6.5% sharp · at its level
GPQA Diamond 42.3% ▁▁▁▁▂▄●▄▅▇█▅ beats 45/211 hard · avg 39% 6.1% sharp · at its level
WildBench v2 WB-Score (task macro) 52.2775 WB-Score ▁·▁▁·▃█▄▇▆●▆ beats 42/52 avg 43.019 WB-Score 4.5% sharp
MMLU (simple-evals, zero-shot CoT… 85.4% ▂▂·●▄▄▂·█▂·▂ beats 4/16 easy · avg 79% 3.3% typical
DROP F1, 3-shot (simple-evals) (m… 81.5% ▂▂▄▆●█·▂···▄ beats 7/16 easy · avg 78% 0.4% blunt
source results share of the score
Top Leaderboard Ranking = Top Coding Pr… 2 22% ▇▇▇
LiveBench model judgments 1 18% ▇▇
Epoch AI 2 16% ▇▇
OpenAI simple-evals README benchmark re… 6 15% ▇▇
Arena-Hard-Auto v0.1 leaderboard 1 9% ▇
Aider code editing benchmark runs 1 8% ▇
WildBench v2 leaderboard data 1 4% ▇
LMArena leaderboard dataset 1 4% ▇
Polyrating: A Cost-Effective and Bias-A… 1 4% ▇
prior: pull toward the middle 0% ▇
weighted average = 54.6
Licences: Top Leaderboard Ranking = Top Coding Proficiency ([CC BY 4.0](../../licenses/paper-2403.19114v1-CC-BY-4.0.txt)) · LiveBench model judgments ([Apache-2.0 (stated in the LiveBench datasheet)](https://www.apache.org/licenses/LICENSE-2.0)) · Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · OpenAI simple-evals README benchmark results ([MIT](../../licenses/openai-simple-evals-MIT.txt)) · Arena-Hard-Auto v0.1 leaderboard ([Apache-2.0](../../licenses/arena-hard-auto-v0-1-Apache-2.0.txt)) · Aider code editing benchmark runs ([Apache-2.0](../../licenses/aider-polyglot-runs-Apache-2.0.txt)) · WildBench v2 leaderboard data ([Apache-2.0](https://github.com/allenai/WildBench/blob/d6b8dcaf377d173d031980f97c16e1a82618c03d/LICENSE)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation ([CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/))
## How to run it
No verified API or local download yet.
[interactive version](https://whatmodel.sh/model/gpt-4-0125-preview) · [JSON](https://whatmodel.sh/api?format=json&all=1)