[whatmodel.sh](../../README.md) / GPT-6 Sol
# GPT-6 Sol
OpenAI · released 2026-09 · closed weights
**score 80.1** ±0.6 · #11 of 732 · from 23 benchmark results across 7 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks GPT-6 Sol among every model on that task or test, worst to best.
task vs the others rank counts tests
agent tasks ▁▁▃▆█▄▅▅▄▄●▁ #11 of 313 20% 4
coding ▁▁▁▃▅▇█▇▅▄●▁ #10 of 469 12% 3
chat & writing ▁▁▁▃▆▄▆█▆▇●▃ #45 of 402* 4.3% 1
math ▁▁▃▅█▆▄█▄▂●▁ #6 of 431 25% 3
vision & documents ▁▁▂▂▁▃▄▂▆▇●▄ #35 of 153* 2.9% 1
web search ▁▁▁▅▄█●▄·▁·▁ #21 of 84* 1.5% 1
agent tasks · #11 of 313 · 20% of its score
test result vs the others in its run difficulty counts why
Arena Agent (October 2026 aggrega… 0.0796 IPS ▁▁▁▃▃▂█▁●▂▁▁ beats 49/59 avg -0.379 IPS 11% sharp
Terminal-Bench 4.0 49.4% █▅▅▅▅·▅▃▃●▅▅ beats 15/20 very hard · avg 0.5% 5.5% sharp · at its level
DeepSWE v1.1 (resolved) (maker) 68.8% █··●▃····▃·▃ beats 3/6 hard · avg 22% 2.0% at its level
Agents' Last Exam (metric/harness… 56.4% ▂·▂·█▄▂·▂▂▄● beats 13/14 very hard · avg 12% 1.5% at its level
coding · #10 of 469 · 12% of its score
Beats [GPT-6.1 Terra](gpt-6-1-terra.md) here, though they rank higher overall.
test result vs the others in its run difficulty counts why
Arena WebDev (Code Arena) 1678.2 ▁▁▃▂▅█▃▆▅●▁▂ beats 119/129 avg 981 7.6% sharp
DeepSWE v1.1 (resolved) (maker) 68.8% █··●▃····▃·▃ beats 3/6 hard · avg 22% 2.0% at its level
Luau Leetcode fully solved (Torpe… 82.7% ▁▁▁▁·▁▂▃▅▃█● beats 39/49 hard · avg 17% 2.0% sharp
chat & writing · #45 of 402 · 4.3% of its score
Trails [MiMo-V2.5-Pro (1T-A42B)](mimo-v2-5-pro.md), [GLM-5.1](glm-5-1.md), [Grok 4.20 (0309 reasoning)](grok-4-20.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
LMArena (text) 1458.3 ▁▁▁▂▃▃▃▆▆▇●▃ beats 333/385 avg 1260 4.3% blunt
math · #6 of 431 · 25% of its score
Beats [Claude Sonnet 5.5](claude-sonnet-5-5.md), [Claude Opus 5](claude-opus-5.md) here, though they rank higher overall.
test result vs the others in its run difficulty counts why
FrontierMath tier 4 v2 90.0% ▁▂▁▂█▅▂▃●▁▁▁ beats 62/67 very hard · avg 0.1% 15% sharp · at its level
FrontierMath tiers 1–3 v2 89.8% ▂··▁▁▃▄▄█▆▄● beats 81/86 very hard · avg 1.2% 10% sharp
OTIS mock AIME 2024–2025 100.0% ▃▃▄▃▃▃▇▇█▃▂● beats 189/197 very hard · avg 7.2% 0.2% sharp · maxed out · noisy
vision & documents · #35 of 153 · 2.9% of its score
Beats [Claude Sonnet 5.5](claude-sonnet-5-5.md) here, though they rank higher overall. Trails [Qwen3.6 Flash](qwen3-6-flash.md), [Qwen3.6 Plus](qwen3-6-plus.md), [Qwen3.7 Plus](qwen3-7-plus.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena vision (style controlled) 1266.0 ▁▁▂▂▂▂▃▄▅▅●▇ beats 121/152 avg 1061 2.9% blunt
web search · #21 of 84 · 1.5% of its score
Trails [GPT-4o mini (2024-07-18)](gpt-4o-mini-2024-07-18.md), [Mistral Small 3.1 24B (2503)](mistral-small-3-1.md), [GPT-4o (2024-08-06)](gpt-4o-2024-08-06.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena search systems (style contr… 1228.2 ▁·▁▁▂▂▂█▆●▂▂ beats 31/36 avg 1069 1.5% blunt
other tests (11)
test result vs the others in its run difficulty counts why
EBR-bench (Epoch) 53.3% ▄▂·▆█▂█▆▄●·▆ beats 20/25 very hard · avg 0.3% 11% sharp · at its level
Mystery Game Puzzles (Epoch) 56.0% █··▂▃▇▄█▂●▂▁ beats 68/77 very hard · avg 9.4% 9.3% sharp · at its level · noisy
Furniture Assembly (Epoch) 58.3% █▆▆▆▆▂●▂▂▂▂▅ beats 25/32 very hard · avg 1.2% 7.7% sharp · at its level
SimpleQA Verified 60.7% ▁▁▃▂▃▃▆▆█●▂▅ beats 68/81 very hard · avg 8.0% 1.6% at its level
HealthBench Professional (maker) 60.8% ▄·▄··▄▄·▄●·█ beats 6/8 hard · avg 20% 1.5% blunt · at its level
Icelandic LLM Leaderboard average… 65.6% ▁▁▃▂▂▄▁▃▄▄▄● beats 32/38 very hard · avg 14% 1.5% at its level
GPQA Diamond 94.3% ▁▁▁▁▂▄▆▄▅▇█● beats 204/211 hard · avg 39% 1.4% sharp · maxed out
HealthBench Hard (maker) 22.1% ●··▂····▂▄·█ beats 0/8 very hard · avg 9.6% 1.0% blunt · at its level
HealthBench (maker) 47.1% ●·▃·····█▃▃▅ beats 0/8 hard · avg 24% 0.9% blunt · at its level
RobloxQA v2.0 multiple choice (To… 97.8% ▁▁▃▁█▄▃▃▆▂●▂ beats 44/49 easy · avg 77% 0.7% maxed out
Vectara hallucination leaderboard… 93.5% ▁▂▁▂▅█▂●▄▃▁▁ beats 73/98 very easy · avg 90% 0.0% blunt
source results share of the score
Epoch AI 8 56% ▇▇▇▇▇▇▇
LMArena leaderboard dataset 5 27% ▇▇▇
OpenAI vendor-reported benchmark scores… 5 7% ▇
Terminal-Bench 4.0 official leaderboard… 1 6% ▇
Roblox LLM Leaderboard 2 3% ▇
Miðeind Icelandic LLM Leaderboard 1 1% ▇
Vectara hallucination leaderboard 1 0% ▇
prior: pull toward the middle 0% ▇
weighted average = 80.1
Licences: Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Terminal-Bench 4.0 official leaderboard submissions ([Apache-2.0](../../licenses/terminal-bench-leaderboard-submissions-Apache-2.0.txt)) · Roblox LLM Leaderboard ([MIT](../../licenses/roblox-llm-leaderboard-MIT.txt)) · Miðeind Icelandic LLM Leaderboard ([CC BY 4.0](../../licenses/mideind-icelandic-llm-leaderboard-CC-BY-4.0.txt)) · Vectara hallucination leaderboard ([Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0))
## How to run it
### Through an API
api (OpenAI) · $4.00/M blended · $2 in / $10 out per 1M tokens · [platform.openai.com](https://platform.openai.com/docs/models)
[price source](https://github.com/anomalyco/models.dev/blob/a668908cfe7073faa0363699486fc41a3ff52412/providers/openai/models/gpt-6-sol.toml): Standard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ. · [context source](https://github.com/anomalyco/models.dev/blob/a668908cfe7073faa0363699486fc41a3ff52412/models/openai/gpt-6-sol.toml)
[interactive version](https://whatmodel.sh/model/gpt-6-sol) · [JSON](https://whatmodel.sh/api?format=json&all=1)