[whatmodel.sh](../../README.md) / Claude Opus 4.1
# Claude Opus 4.1
Anthropic · released 2025-08 · proprietary
**score 66.3** ±0.7 · comparison only: no current run option verified · from 20 benchmark results across 8 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks Claude Opus 4.1 among every model on that task or test, worst to best.
task vs the others rank counts tests
agent tasks ▁▁▂▆█▄●▄▄▃▁▁ #135 of 354 23% 5
coding ▁▁▁▃▄▆█▇●▄▃▁ #108 of 539 27% 3
chat & writing ▁▁▁▃▅▄▇█▇▇●▃ #61 of 474* 5.8% 1
math ▁▁▃▆██●█▃▁▁▁ #174 of 530 31% 3
web search ▂▁▂▆●█▅▄▁▂▁▁ #61 of 96* 2.1% 1
agent tasks · #135 of 354 · 23% of its score
Beats [o3-pro](o3-pro.md), [o3](o3.md), [GPT-5 mini](gpt-5-mini.md) here, though they rank higher overall. Trails [SmolLM3 3B](smollm3-3b.md), [Jamba 1.5 Large](jamba-1-5-large.md), [Devstral 2 (2512)](devstral-2.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
SWE-bench Verified 73.3% ▁··▁·▁▂▁●█▄▁ beats 12/29 hard · avg 19% 14% sharp · at its level
τ-bench Retail (maker) 82.4% ▁····▃·▂▇█▂● beats 28/28 medium · avg 45% 3.2% small run
τ²-bench Telecom (maker) 71.5% ▁·▅█▆●▂▃▃▂▃▁ beats 56/89 hard · avg 30% 2.6% sharp · noisy
τ-bench Airline (maker) 56.0% ▁▁▁·▅▄▁█▇▁●▇ beats 23/28 hard · avg 26% 2.2% at its level · small run
BFCL V4 (2025-11-03 archive, mode… 71.2% ▃··▅▃▃·▅·▃·● beats 9/10 hard · avg 33% 1.3% at its level
coding · #108 of 539 · 27% of its score
Beats [Grok 4.20 (0309 reasoning)](grok-4-20.md), [Grok 4.3](grok-4-3.md), [Muse Glimmer 30B](muse-glimmer-30b.md) here, though they rank higher overall. Trails [Llama 3.1 Nemotron Ultra 253B v1](llama-3-1-nemotron-ultra-253b.md), [Qwen3 235B-A22B Thinking 2507](qwen3-235b-a22b-thinking-2507.md), [o4-mini](o4-mini.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
SWE-bench Verified 73.3% ▁··▁·▁▂▁●█▄▁ beats 12/29 hard · avg 19% 14% sharp · at its level
Arena WebDev (Code Arena) 1390.2 ▁▁▃▂▅●▃▆▅▅▁▂ beats 41/129 avg 981 10% sharp
WebApp1K-Duo-React pass@1 (onekq-… 76.9% ▁··▁·▁▁▁▆█▇● beats 43/45 hard · avg 29% 3.0% at its level
chat & writing · #61 of 474 · 5.8% of its score
Beats [MiMo-V2.6-Flash (309B-A15B)](mimo-v2-6-flash.md), [Claude Haiku 5.5](claude-haiku-5-5.md), [GPT-6 Luna](gpt-6-luna.md) here, though they rank higher overall. Trails [Gemma 4 31B](gemma-4-31b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
LMArena (text) 1448.0 ▁▁▁▂▃▃▃▆▆▇●▃ beats 317/385 avg 1260 5.8% blunt
math · #174 of 530 · 31% of its score
Beats [MiMo-V2.5 (310B-A15B)](mimo-v2-5.md), [MiniMax-M2.7](minimax-m2-7.md) here, though they rank higher overall. Trails [Olmo 3 7B Think](olmo-3-7b-think.md), [Qwen3-VL 4B Thinking](qwen3-vl-4b-thinking.md), [Nemotron 3 Nano 30B-A3B](nemotron-3-nano-30b-a3b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
FrontierMath tiers 1–3 v2 12.6% ▂··▁▁●▄▄█▆▄▃ beats 7/86 very hard · avg 1.2% 22% sharp · at its level
FrontierMath tier 4 v2 2.4% ▁●▁▂█▅▂▃▂▁▁▁ beats 4/67 very hard · avg 0.1% 5.9% sharp · too hard for it
OTIS mock AIME 2024–2025 68.9% ▃▃▄▃▃▃●▇█▃▂▅ beats 100/197 very hard · avg 7.2% 3.3% sharp · noisy
web search · #61 of 96 · 2.1% of its score
Beats [GPT-5.2](gpt-5-2.md), [Kimi K2.6](kimi-k2-6.md), [GPT-5 Pro](gpt-5-pro.md) here, though they rank higher overall. Trails [GPT-4o mini (2024-07-18)](gpt-4o-mini-2024-07-18.md), [Mistral Small 3.1 24B (2503)](mistral-small-3-1.md), [Llama 4 Scout (109B-A17B)](llama-4-scout.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena search systems (style contr… 1167.1 ▁·▁▁▂●▂█▆▃▂▂ beats 8/36 avg 1069 2.1% blunt
other tests (8)
test result vs the others in its run difficulty counts why
GPQA Diamond 76.8% ▁▁▁▁▂▄▆▄▅●█▅ beats 120/211 hard · avg 39% 8.2% sharp · at its level
KCL-Essay vanilla 45.5% ▁···▁▃▂█▂●▃▂ beats 18/23 hard · avg 17% 4.6% at its level
EBR-bench (Epoch) 7.9% ▄▂·●█▂█▆▄▆·▆ beats 3/25 very hard · avg 0.3% 3.6% sharp · too hard for it
Mystery Game Puzzles (Epoch) 21.0% █··▂▃●▄█▂▄▂▁ beats 36/77 very hard · avg 9.4% 2.6% sharp · too hard for it · noisy
Chess Puzzles (Epoch) 7.0% █▁●▁▁▂▃▃▃▂▁▁ beats 50/137 very hard · avg 5.8% 2.5% sharp · noisy
KCL-MCQA vanilla 57.2% ▂···█▂▆▆██●▂ beats 22/23 very hard · avg 29% 2.5% at its level
Vectara hallucination leaderboard… 95.8% ▁▁▂▃▄▄●▆▃▂▂▁ beats 83/140 very easy · avg 94% 0.2% blunt · maxed out · noisy
Vectara hallucination leaderboard… 88.2% ▁▂▁▂●█▂▃▄▃▁▁ beats 28/98 very easy · avg 90% 0.0% blunt
source results share of the score
Epoch AI 8 62% ▇▇▇▇▇▇▇
LMArena leaderboard dataset 3 18% ▇▇
Korean Canonical Legal Benchmark: Towar… 2 7% ▇
τ-bench leaderboard: Anthropic's own su… 2 5% ▇
WebApp1K models leaderboard 1 3% ▇
Anthropic system cards and model announ… 1 3% ▇
Berkeley Function Calling Leaderboard r… 1 1% ▇
Vectara hallucination leaderboard 2 0% ▇
prior: pull toward the middle 0% ▇
weighted average = 66.3
Licences: Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Korean Canonical Legal Benchmark: Toward Knowledge-Independent Evaluation of LLMs’ Legal Reasoning Capabilities ([CC BY 4.0](../../licenses/cards-final-NOTICE.txt)) · τ-bench leaderboard: Anthropic's own submissions ([MIT](https://opensource.org/license/mit)) · WebApp1K models leaderboard ([MIT](../../licenses/webapp1k-leaderboard-MIT.txt)) · Berkeley Function Calling Leaderboard result archive ([Apache-2.0](../../licenses/bfcl-result-archive-v4-Apache-2.0.txt)) · Vectara hallucination leaderboard ([Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0))
## How to run it
No verified API or local download yet.
[interactive version](https://whatmodel.sh/model/claude-opus-4-1-20250805) · [JSON](https://whatmodel.sh/api?format=json&all=1)