[whatmodel.sh](../../README.md) / GPT-4 Turbo Preview (1106)
# GPT-4 Turbo Preview (1106)
OpenAI · released 2023-11 · proprietary
**score 54.8** ±0.6 · comparison only: no current run option verified · from 21 benchmark results across 11 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks GPT-4 Turbo Preview (1106) among every model on that task or test, worst to best.
task vs the others rank counts tests
coding ▁▁▁▃▄▆●▇▅▄▃▁ #264 of 539 41% 6
chat & writing ▁▁▁▃▅▄▇●▇▇▇▃ #255 of 474 22% 5
math ▁▁▃▆●█▅█▃▁▁▁ #350 of 530 10% 3
coding · #264 of 539 · 41% of its score
Beats [Qwen3.5 4B](qwen3-5-4b.md), [Qwen3-VL 32B Instruct](qwen3-vl-32b-instruct.md), [Solar Open 100B (102B-A12B)](solar-open-100b.md) here, though they rank higher overall. Trails [QwQ-32B-Preview](qwq-32b-preview.md), [Ministral 3 3B Reasoning 2512](ministral-3-3b-reasoning.md), [s1.1 32B](s1-1-32b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
HumanEval 85.4% ▁·▁▁▃▄▆▅█●▁▁ beats 90/99 easy · avg 76% 12% sharp
HumanEval+ 81.7% ▁·▁▁▁▃▄▄▄█●▁ beats 92/99 easy · avg 70% 12% sharp
LiveCodeBench official (Jan 1–Nov… 35.7% ▁▁·▁▂▄▆●▅▂·▂ beats 20/31 hard · avg 23% 7.4% sharp · at its level
Aider code editing (133 Exercism … 65.4% ▁·▁▂▄▁▆▄●▆▂▂ beats 38/62 medium · avg 51% 5.7% sharp · at its level
MBPP+ 73.3% ▁···▁▁▂▅▇█●▂ beats 69/75 easy · avg 66% 3.0% at its level
HumanEval (simple-evals) (maker) 83.7% ●█▆▆▂··▂···▂ beats 0/15 easy · avg 83% 1.1% typical
chat & writing · #255 of 474 · 22% of its score
Beats [Gemma 2 9B IT SimPO](gemma-2-9b-simpo.md), [Granite 4.2 8B](granite-4-2-8b.md), [Mistral Small 4 (119B-A6.5B)](mistral-small-4.md) here, though they rank higher overall. Trails [LFM2.5 1.2B Instruct](lfm2-5-1-2b-instruct.md), [Granite 4.0 H Micro 3B](granite-4-0-h-micro.md), [Gemma 3n E4B](gemma-3n-e4b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
AlpacaEval 2 length-controlled 50.0% ▁▂▂▃▆▆█▆▄●▁▁ beats 105/122 medium · avg 35% 14% sharp · at its level
LMArena (text) 1312.9 ▁▁▁▂▃▃▃●▆▇█▃ beats 141/385 avg 1260 3.2% blunt
Polyrating rating (bias-aware re-… 1265.0 ▂▁▂▁▃▇█▆▇▄▂● beats 92/95 avg 1187 2.9% typical
MT-Bench (GPT-4 single-answer gra… 9.3200 MT-Bench score (1-10) ▆▂▂▆▆▄██▂▄▄● beats 28/28 avg 8.539 MT-Bench scor… 2.2% sharp · noisy
AlpacaEval 1.0 win rate (vs text-… 97.7% ▂▂·▆·▇▃▆█▆▄● beats 45/45 very easy · avg 94% 0.1% sharp · maxed out · noisy
math · #350 of 530 · 10% of its score
Beats [Molmo 2 8B](molmo-2-8b.md) here, though they rank higher overall. Trails [DeepSeek R1 Distill Qwen 1.5B](deepseek-r1-distill-qwen-1-5b.md), [Gemma 7B (base)](gemma-7b-base.md), [Mistral 7B v0.1 (base)](mistral-7b-v0-1.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
MATH level 5 40.0% ▂▂▅▆●█▆▃▅▂▃▄ beats 32/92 hard · avg 28% 7.1% sharp · at its level
MATH (simple-evals, original test… 64.3% ●····▄··▄··█ beats 0/5 medium · avg 62% 1.3% at its level
MGSM (simple-evals) (maker) 87.1% ▁····▁●▁█▁▃▁ beats 5/16 easy · avg 80% 1.2% typical
other tests (7)
test result vs the others in its run difficulty counts why
LiveBench 2024-07-26 52.0% ▁▁▁▂▂▃▂█▆▃●▃ beats 54/61 medium · avg 38% 14% at its level
GPQA Diamond (simple-evals) (make… 42.5% ●▃▃█·▃▃▅▃▃▃▅ beats 2/16 hard · avg 39% 5.0% sharp · at its level
GPQA Diamond 42.4% ▁▁▁▁▂▄●▄▅▇█▅ beats 46/211 hard · avg 39% 4.7% sharp · at its level
MMLU (simple-evals, zero-shot CoT… 84.7% ▂▂·●▄▄▂·█▂·▂ beats 2/16 easy · avg 79% 2.4% typical
RULER 64k 87.0% ▁▁·▁·▂▃▄█●·▁ beats 20/22 easy · avg 82% 0.5% typical
DROP F1, 3-shot (simple-evals) (m… 83.2% ▂▂▄▆▆●·▂···▄ beats 10/16 easy · avg 78% 0.3% blunt
RULER 128k 81.2% ▄··▂▄▂▆██●▄▂ beats 17/21 easy · avg 67% 0.2% at its level · noisy
source results share of the score
EvalPlus / EvalPerf published evaluatio… 3 27% ▇▇▇
AlpacaEval 1.0 and 2.0 leaderboards 2 14% ▇▇
LiveBench model judgments 1 14% ▇▇
Epoch AI 2 12% ▇
OpenAI simple-evals README benchmark re… 6 11% ▇
LiveCodeBench official website results 1 7% ▇
Aider code editing benchmark runs 1 6% ▇
LMArena leaderboard dataset 1 3% ▇
Polyrating: A Cost-Effective and Bias-A… 1 3% ▇
LMSYS Chatbot Arena leaderboard Space: … 1 2% ▇
NVIDIA RULER repository README results … 2 1% ▇
prior: pull toward the middle 0% ▇
weighted average = 54.8
Licences: EvalPlus / EvalPerf published evaluation runs ([Apache-2.0](../../licenses/evalplus-published-runs-Apache-2.0.txt)) · AlpacaEval 1.0 and 2.0 leaderboards ([Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)) · LiveBench model judgments ([Apache-2.0 (stated in the LiveBench datasheet)](https://www.apache.org/licenses/LICENSE-2.0)) · Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · OpenAI simple-evals README benchmark results ([MIT](../../licenses/openai-simple-evals-MIT.txt)) · LiveCodeBench official website results ([CC-BY-SA-4.0](../../licenses/lcb-sharealike-NOTICE.txt)) · Aider code editing benchmark runs ([Apache-2.0](../../licenses/aider-polyglot-runs-Apache-2.0.txt)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation ([CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/)) · LMSYS Chatbot Arena leaderboard Space: MT-Bench column of the published leaderboard table ([Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)) · NVIDIA RULER repository README results table ([Apache-2.0](https://github.com/NVIDIA/RULER/blob/c3f5e3b4f87f97e048793bb510a3a6b19a46bf3a/LICENSE))
## How to run it
No verified API or local download yet.
[interactive version](https://whatmodel.sh/model/gpt-4-1106-preview) · [JSON](https://whatmodel.sh/api?format=json&all=1)