[whatmodel.sh](../../README.md) / GPT-3.5 Turbo (0301)
# GPT-3.5 Turbo (0301)
OpenAI · released 2023-03 · proprietary
**score 47.4** ±0.5 · comparison only: no current run option verified · from 68 benchmark results across 30 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks GPT-3.5 Turbo (0301) among every model on that task or test, worst to best.
task vs the others rank counts tests
coding ▁▁▁▃▄●█▇▅▄▃▁ #352 of 539 33% 5
chat & writing ▁▁▁▃●▄▇█▇▇▇▃ #391 of 474 14% 3
math ▁▁▃▆█●▅█▃▁▁▁ #235 of 530 8.0% 3
coding · #352 of 539 · 33% of its score
Beats [Qwen3-VL 32B Instruct](qwen3-vl-32b-instruct.md), [Solar Open 100B (102B-A12B)](solar-open-100b.md), [Qwen3-VL 30B-A3B Instruct](qwen3-vl-30b-a3b-instruct.md) here, though they rank higher overall. Trails [DeepSeek LLM 67B Chat](deepseek-llm-67b-chat.md), [WizardLM 70B V1.0](wizardlm-70b-v1-0.md), [Yi 1.5 9B Chat](yi-1-5-9b-chat.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
HumanEval 73.2% ▁·▁▁▃▄▆▅●▃▁▁ beats 65/99 easy · avg 76% 15% sharp · at its level
HumanEval+ 66.5% ▁·▁▁▁▃▄▄▄●▃▁ beats 63/99 easy · avg 70% 13% sharp · at its level
Aider code editing (133 Exercism … 57.9% ▁·▁▂▄▁▆●█▆▂▂ beats 27/62 medium · avg 51% 4.3% sharp · at its level
Tulu 2: CodexEval pass@10 88.4% ▃▃▃·▆▃▃█▃▂▂● beats 25/25 easy · avg 83% 1.0% sharp
MBPP 59.7% ▁▁▁▄▅█▆▅●▁▂▁ beats 77/86 easy · avg 67% — not counted yet: no other model in the …
chat & writing · #391 of 474 · 14% of its score
Beats [Gemma 4 E4B](gemma-4-e4b.md), [OpenThinker3 7B](openthinker3-7b.md), [Code Llama 70B Instruct](codellama-70b-instruct.md) here, though they rank higher overall. Trails [LFM2 350M](lfm2-350m.md), [Gemma 3 1B](gemma-3-1b.md), [Qwen3 0.6B](qwen3-0-6b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
AlpacaEval 2 length-controlled 18.1% ▁▂▂▃▆●█▆▄▄▁▁ beats 48/122 medium · avg 35% 8.1% sharp · at its level
Arena-Hard (v0.1, GPT-4-1106 judg… 18.1% ▂▁▁●█▅▄▃▃▅▃▁ beats 12/60 medium · avg 47% 5.2% sharp · at its level
AlpacaEval 1.0 win rate (vs text-… 89.4% ▂▂·▆·▇▃▆●▆▄▂ beats 30/45 very easy · avg 94% 0.2% sharp · noisy
math · #235 of 530 · 8.0% of its score
Beats [MiniMax-M2.1](minimax-m2-1.md), [DeepSeek V3 (Dec '24)](deepseek-v3.md), [Qwen3 235B-A22B (Apr 2025, hybrid)](qwen3-235b-a22b.md) here, though they rank higher overall. Trails [Mixtral 8x7B v0.1 (base)](mixtral-8x7b-v0-1.md), [Olmo 3 7B Instruct](olmo-3-7b-instruct.md), [Phi-4-mini-reasoning 3.8B](phi-4-mini-reasoning.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
GSM8K 76.0% ▆▂▅█▅▅▃●···▂ beats 23/25 easy · avg 72% 8.0% sharp · at its level · several runs
MGSM 57.2% ▂·▁▁▁▁▁▂▅●▃▂ beats 32/42 medium · avg 48% — not counted yet: no other model in the …
MATH 34.1% ▃▅▂▆▅▃▅●█▃▃▂ beats 18/30 medium · avg 61% — not counted yet: no other model in the …
other tests (40)
test result vs the others in its run difficulty counts why
AQuA-RAT 52.8% █··▁▁▁··▁▁●▁ beats 26/27 medium · avg 58% 7.1% sharp · at its level · small run · seve…
SVAMP 79.0% █▆▆▅▂▅▂▅▂▂●▃ beats 27/30 very easy · avg 85% 5.3% sharp · small run · several runs
CommonsenseQA 75.4% █·····▂▂▃▂▄● beats 33/38 easy · avg 80% 4.8% sharp · at its level · small run · seve…
New Yorker Caption Contest matchi… 63.8% █·····▃··●·▃ beats 5/6 medium · avg 71% 4.0% sharp · at its level
BIG-Bench Hard 66.1% ▁·····▂█▂●·▁ beats 22/25 easy · avg 74% 3.2% sharp · at its level
F2WTQ free-form table QA, 2-shot … 51.8% ▄···█·▄█··●▄ beats 6/7 medium · avg 56% 2.1% at its level
StrategyQA 69.2% █····▂▂▁▂▂●▂ beats 22/25 medium · avg 72% 1.6% at its level · small run · several runs
DMath (English) few-shot CoT accu… 61.0% █·▄······●·▄ beats 3/4 medium · avg 64% 1.5% at its level
OpenBookQA 80.0% ▅▁▁▁▂▂▃█▃▁●▁ beats 101/107 easy · avg 78% 1.5% at its level · small run · several runs
MMLU 67.9% ▁▁▃▃▄█▄▁●··▁ beats 24/25 medium · avg 73% 1.4% at its level
COPA 96.3% ▁·▁▁▁▅▅█▆▂▁● beats 65/67 very easy · avg 96% 1.1% several runs
clembench v1.0 clemscore (self-pl… 37.0% ▄······▄·●·▄ beats 2/4 medium · avg 38% 1.0% sharp · at its level
EQ-Bench v1 (60 questions, paper … 47.6% ▂··▄·▂▆▄●█·▂ beats 9/14 medium · avg 53% 1.0% at its level
Integer-sequence completion, unam… 77.6% ▄········▄·● beats 2/3 easy · avg 73% 1.0% at its level
BoolQ 67.7% ▁····▁▂█▆▅▆● beats 103/103 medium · avg 75% 1.0% at its level · small run · several runs
Integer-sequence explanation as P… 50.2% █······█··●█ beats 2/3 medium · avg 47% 0.9% at its level
ARC Challenge 57.2% ▄▁▁▂▁▄█▇▃▂●▂ beats 130/140 medium · avg 72% 0.8% sharp · at its level · small run
Spider dev execution accuracy, ze… 70.9% █·█▄··▄····● beats 6/6 medium · avg 54% 0.7% sharp · at its level · noisy
JEEBench total score (zero-shot, … 17.7% █··█····●··█ beats 2/3 very hard · avg 20% 0.7% typical
ZeroSCROLLS Qasper (zero-shot F1) 49.3% ▂▂··▂·▂··▂●▄ beats 6/10 medium · avg 56% 0.6% blunt · at its level
ZeroSCROLLS QuALITY (zero-shot ac… 66.6% ▃····▃·▃▃●▅▅ beats 4/10 easy · avg 81% 0.5% at its level
Social IQA 73.5% ▁·▁██▄▅▁▂▃●▁ beats 57/59 medium · avg 70% 0.5% blunt · at its level · small run · seve…
RadNLI (3-class radiology NLI), z… 45.4% ●·█········█ beats 0/2 easy · avg 65% 0.4% at its level · small run
WinoGrande 61.3% ▁▁▁▁▂▁▁▅●█▃▁ beats 71/131 medium · avg 78% 0.4% at its level · small run
Tulu 2: TyDiQA gold passage, 1-sh… 51.9% ▂··▁▃▂▂▂●▅▁▂ beats 14/25 medium · avg 59% 0.3% blunt · at its level
SelfAware unanswerable-question d… 54.1% █▄▄●·······▄ beats 4/5 medium · avg 63% 0.3% blunt · at its level
ZeroSCROLLS NarrativeQA (zero-sho… 25.1% ▃··▃·█▃·●▃·▃ beats 7/10 hard · avg 29% 0.3% blunt · at its level
PIQA 80.8% ▁▁▁▂▂▃▅█▅●▁▁ beats 114/123 easy · avg 84% 0.3% blunt · at its level · small run · seve…
Zero-shot relation extraction, va… 40.1% ●····▄····█▄ beats 1/5 medium · avg 50% 0.2% blunt · at its level
ConvRe Re2Text, normal relation, … 83.5% ▂▂▄··▂▂●▄··▂ beats 7/12 easy · avg 90% 0.2% noisy
MenatQA (all factors), exact matc… 24.4% ▂····▂··▂·●▄ beats 5/8 medium · avg 36% 0.2% blunt · at its level
HellaSwag 43.0% ▁▁▁▂▂▂▄▆●▇▄▂ beats 77/135 easy · avg 80% 0.2% at its level · noisy · small run
CAIL charge prediction, zero-shot… 46.6% █···●··█···█ beats 1/3 medium · avg 54% 0.1% blunt · at its level
ARC Easy 65.4% ▁▃▂▄▆█▅▃▁··● beats 98/100 easy · avg 85% 0.1% blunt · noisy · small run
ZeroSCROLLS MuSiQue (zero-shot F1) 27.1% ▄·●··██·▄▄▄▄ beats 2/10 medium · avg 43% 0.1% blunt · at its level
Story Cloze Test 77.3% ▃▃▃▂▅●▅▂▁··▂ beats 28/50 easy · avg 90% 0.1% blunt · noisy · small run
SciQ 60.7% ●·▁▂▂▃▆▃▇▆█▂ beats 1/51 very easy · avg 97% 0.0% blunt · maxed out · noisy · small run
TriviaQA 85.9% ▁▁▂▂▄▄▃▆▅█▅● beats 78/80 easy · avg 73% — not counted yet: no other model in the …
Natural Questions (closed book) 48.1% ▂▁▁▁▂▄▄▃▅█▅● beats 68/68 medium · avg 48% — not counted yet: no other model in the …
DROP 57.6% ▃▅█▅·▃·●▄▂▁▃ beats 28/44 medium · avg 58% — not counted yet: no other model in the …
source results share of the score
EvalPlus / EvalPerf published evaluatio… 2 28% ▇▇▇
AlpacaEval 1.0 and 2.0 leaderboards 2 8% ▇
Tulu 2 5 8% ▇
Is ChatGPT a General-Purpose Natural La… 7 7% ▇
Arena-Hard-Auto v0.1 leaderboard 1 5% ▇
It Ain't Over: A Multi-aspect Diverse M… 3 4% ▇
Aider code editing benchmark runs 1 4% ▇
Do Androids Laugh at Electric Sheep? Hu… 1 4% ▇
Vera: A General-Purpose Plausibility Es… 12 3% ▇
Unnatural Error Correction: GPT-4 Can A… 1 3% ▇
Tab-CoT: Zero-shot Tabular Chain of Tho… 3 3% ▇
Automatic Model Selection with Large La… 2 3% ▇
Investigating Table-to-Text Generation … 1 2% ▇
Examining Inter-Consistency of Large La… 5 2% ▇
Self-Knowledge Guided Retrieval Augment… 2 2% ▇
Self-Consistency of Large Language Mode… 2 2% ▇
LLMLingua: Compressing Prompts for Acce… 1 2% ▇
ZeroSCROLLS: A Zero-Shot Benchmark for … 4 2% ▇
MoT: Memory-of-Thought Enables ChatGPT … 2 1% ▇
clembench: Using Game Play to Evaluate … 1 1% ▇
EQ-Bench: An Emotional Intelligence Ben… 1 1% ▇
Battle of the Large Language Models: Do… 1 1% ▇
Have LLMs Advanced Enough? A Challengin… 1 1% ▇
Is ChatGPT a Good Causal Reasoner? A Co… 1 1% ▇
Exploring the Boundaries of GPT-4 in Ra… 1 0% ▇
Do Large Language Models Know What They… 1 0% ▇
Aligning Instruction Tasks Unlocks Larg… 1 0% ▇
An Investigation of LLMs' Inefficacy in… 1 0% ▇
MenatQA: A New Dataset for Testing the … 1 0% ▇
A Comprehensive Evaluation of Large Lan… 1 0% ▇
prior: pull toward the middle 0% ▇
weighted average = 47.4
Licences: EvalPlus / EvalPerf published evaluation runs ([Apache-2.0](../../licenses/evalplus-published-runs-Apache-2.0.txt)) · AlpacaEval 1.0 and 2.0 leaderboards ([Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)) · Tulu 2 ([CC BY 4.0](../../licenses/CC-BY-4.0.txt)) · Is ChatGPT a General-Purpose Natural Language Processing Task Solver? ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-85-CC-BY-4-0.txt)) · Arena-Hard-Auto v0.1 leaderboard ([Apache-2.0](../../licenses/arena-hard-auto-v0-1-Apache-2.0.txt)) · It Ain't Over: A Multi-aspect Diverse Math Word Problem Dataset ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-927-CC-BY-4-0.txt)) · Aider code editing benchmark runs ([Apache-2.0](../../licenses/aider-polyglot-runs-Apache-2.0.txt)) · Do Androids Laugh at Electric Sheep? Humor \`\`Understanding'' Benchmarks from The New Yorker Caption Contest ([CC BY 4.0](../../licenses/acl-2023-acl-long-41-CC-BY-4-0.txt)) · Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-81-CC-BY-4-0.txt)) · Unnatural Error Correction: GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-550-CC-BY-4-0.txt)) · Tab-CoT: Zero-shot Tabular Chain of Thought ([CC BY 4.0](../../licenses/acl-2023-findings-acl-651-CC-BY-4-0.txt)) · Automatic Model Selection with Large Language Models for Reasoning ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-55-CC-BY-4-0.txt)) · Investigating Table-to-Text Generation Capabilities of Large Language Models in Real-World Information Seeking Scenarios ([CC BY 4.0](../../licenses/acl-2023-emnlp-industry-17-CC-BY-4-0.txt)) · Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-508-CC-BY-4-0.txt)) · Self-Knowledge Guided Retrieval Augmentation for Large Language Models ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-691-CC-BY-4-0.txt)) · Self-Consistency of Large Language Models under Ambiguity ([CC BY 4.0](../../licenses/acl-2023-blackboxnlp-1-7-CC-BY-4-0.txt)) · LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-825-CC-BY-4-0.txt)) · ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-536-CC-BY-4-0.txt)) · MoT: Memory-of-Thought Enables ChatGPT to Self-Improve ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-392-CC-BY-4-0.txt)) · clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agents ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-689-CC-BY-4-0.txt)) · EQ-Bench: An Emotional Intelligence Benchmark for Large Language Models ([CC BY 4.0](../../licenses/paper-2312.06281v2-CC-BY-4.0.txt)) · Battle of the Large Language Models: Dolly vs LLaMA vs Vicuna vs Guanaco vs Bard vs ChatGPT - A Text-to-SQL Parsing Comparison ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-750-CC-BY-4-0.txt)) · Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-468-CC-BY-4-0.txt)) · Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-743-CC-BY-4-0.txt)) · Exploring the Boundaries of GPT-4 in Radiology ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-891-CC-BY-4-0.txt)) · Do Large Language Models Know What They Don't Know? ([CC BY 4.0](../../licenses/acl-2023-findings-acl-551-CC-BY-4-0.txt)) · Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors ([CC BY 4.0](../../licenses/acl-2023-findings-acl-50-CC-BY-4-0.txt)) · An Investigation of LLMs' Inefficacy in Understanding Converse Relations ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-429-CC-BY-4-0.txt)) · MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-100-CC-BY-4-0.txt)) · A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction ([CC BY 4.0](../../licenses/acl-2023-findings-emnlp-490-CC-BY-4-0.txt))
Not counted (31)
source test score why
On Sample-Efficient C… HumanEval 63.0% only model in this source's run
On Sample-Efficient C… MBPP 59.7% too few models have it yet
MoT: Memory-of-Though… AQuA-RAT 49.7% only model in this source's run
MoT: Memory-of-Though… DROP 57.6% too few models have it yet
LLMLingua: Compressin… BIG-Bench Hard 70.1% only model in this source's run
Exchange-of-Thought: … GSM8K 79.1% only model in this source's run
Exchange-of-Thought: … AQuA-RAT 55.1% only model in this source's run
Exchange-of-Thought: … SVAMP 79.5% only model in this source's run
Robust Prompt Optimiz… Social IQA 75.6% only model in this source's run
Robust Prompt Optimiz… PIQA 83.6% only model in this source's run
Robust Prompt Optimiz… OpenBookQA 80.1% only model in this source's run
A Systematic Study an… BoolQ 90.1% only model in this source's run
A Systematic Study an… COPA 94.0% only model in this source's run
A Systematic Study an… BIG-Bench Hard 69.8% only model in this source's run
A Systematic Study an… MMLU 68.9% only model in this source's run
A Systematic Study an… TriviaQA 85.9% too few models have it yet
A Systematic Study an… Natural Questions (closed boo… 48.1% too few models have it yet
A Systematic Study an… PIQA 62.1% only model in this source's run
A Systematic Study an… Social IQA 66.1% only model in this source's run
A Systematic Study an… HellaSwag 72.0% only model in this source's run
A Systematic Study an… WinoGrande 66.8% only model in this source's run
A Systematic Study an… ARC Easy 94.0% only model in this source's run
A Systematic Study an… ARC Challenge 84.6% only model in this source's run
A Systematic Study an… OpenBookQA 81.0% only model in this source's run
A Systematic Study an… MATH 34.1% too few models have it yet
A Systematic Study an… GSM8K 87.7% only model in this source's run
A Systematic Study an… MGSM 57.2% too few models have it yet
A Systematic Study an… HumanEval 61.2% only model in this source's run
A Systematic Study an… MBPP 73.8% too few models have it yet
R$^3$ Prompting: Revi… GSM8K 78.9% only model in this source's run
R$^3$ Prompting: Revi… SVAMP 79.9% only model in this source's run