[whatmodel.sh](../../README.md) / GPT-6.1 Sol
# GPT-6.1 Sol
OpenAI · released 2026-09 · proprietary
**score 83.0** ±0.7 · #5 of 732 · from 21 benchmark results across 6 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks GPT-6.1 Sol among every model on that task or test, worst to best.
task vs the others rank counts tests
agent tasks ▁▁▃▆█▄▅▅▄▄▂● #4 of 313* 19% 2
coding ▁▁▁▃▅▇█▇▅▄▃● #5 of 469* 10% 2
chat & writing ▁▁▁▃▆▄▆█▆▇▇● #21 of 402* 4.9% 1
math ▁▁▃▅█▆▄█▄▂▁● #2 of 431 17% 3
vision & documents ▁▁▂▂▁▃▄▂▆▇█● #8 of 153* 3.2% 1
web search ▁▁▁▅▄█▃●·▁·▁ #9 of 84* 1.8% 1
agent tasks · #4 of 313 · 19% of its score
Beats [GPT-6 Astra](gpt-6-astra.md), [GPT-6.1 Terra](gpt-6-1-terra.md) here, though they rank higher overall. Trails [Claude Sonnet 5.5](claude-sonnet-5-5.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena Agent (October 2026 aggrega… 0.1247 IPS ▁▁▁▃▃▂█▁▂●▁▁ beats 54/59 avg -0.379 IPS 12% sharp
Terminal-Bench 4.0 58.2% █▅▅▅▅·▅▃▃▅●▅ beats 18/20 very hard · avg 0.5% 6.3% sharp · at its level
coding · #5 of 469 · 10% of its score
Beats [GPT-6.1 Terra](gpt-6-1-terra.md) here, though they rank higher overall. Trails [Claude Sonnet 5.5](claude-sonnet-5-5.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena WebDev (Code Arena) 1750.6 ▁▁▃▂▅█▃▆▅▅▁● beats 125/129 avg 981 8.6% sharp
Luau Leetcode fully solved (Torpe… 87.0% ▁▁▁▁·▁▂▃▅▃█● beats 47/49 hard · avg 17% 1.8% sharp
chat & writing · #21 of 402 · 4.9% of its score
Beats [GPT-6 Astra](gpt-6-astra.md) here, though they rank higher overall. Trails [Gemini 3.6 Flash](gemini-3-6-flash.md), [Muse Spark 1.2](muse-spark-1-2.md), [Muse Spark 1.1](muse-spark-1-1.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
LMArena (text) 1481.3 ▁▁▁▂▃▃▃▆▆▇█● beats 362/385 avg 1260 4.9% blunt
math · #2 of 431 · 17% of its score
Beats [Claude Opus 5.5](claude-opus-5-5.md), [GPT-6.1 Terra](gpt-6-1-terra.md) here, though they rank higher overall.
test result vs the others in its run difficulty counts why
FrontierMath tier 4 v2 100.0% ▁▂▁▂█▅▂▃▂▁▁● beats 67/67 very hard · avg 0.1% 10% sharp
FrontierMath tiers 1–3 v2 93.7% ▂··▁▁▃▄▄█▆▄● beats 85/86 very hard · avg 1.2% 6.6% sharp · maxed out
OTIS mock AIME 2024–2025 100.0% ▃▃▄▃▃▃▇▇█▃▂● beats 191/197 very hard · avg 7.2% 0.1% sharp · maxed out · noisy
vision & documents · #8 of 153 · 3.2% of its score
Beats [GPT-6 Astra](gpt-6-astra.md), [Claude Opus 5.5](claude-opus-5-5.md) here, though they rank higher overall. Trails [Claude Opus 4.7](claude-opus-4-7.md), [Gemini 3.7 Flash](gemini-3-7-flash.md), [Gemini 3.8 Flash](gemini-3-8-flash.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena vision (style controlled) 1293.5 ▁▁▂▂▂▂▃▄▅▅█● beats 146/152 avg 1061 3.2% blunt
web search · #9 of 84 · 1.8% of its score
Beats [GPT-6 Astra](gpt-6-astra.md), [Claude Opus 5.5](claude-opus-5-5.md) here, though they rank higher overall. Trails [GPT-4o (2024-08-06)](gpt-4o-2024-08-06.md), [GPT-4.1 mini](gpt-4-1-mini.md), [GPT-4.1](gpt-4-1.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena search systems (style contr… 1249.9 ▁·▁▁▂▂▂█▆▃▂● beats 35/36 avg 1069 1.8% blunt
other tests (11)
test result vs the others in its run difficulty counts why
EBR-bench (Epoch) 54.3% ▄▂·▆█▂█▆▄●·▆ beats 21/25 very hard · avg 0.3% 12% sharp · at its level
Mystery Game Puzzles (Epoch) 80.0% █··▂▃▇▄█▂▄▂● beats 76/77 very hard · avg 9.4% 10% sharp · at its level · noisy
Furniture Assembly (Epoch) 80.0% █▆▆▆▆▂▆▂▂▂▂● beats 30/32 very hard · avg 1.2% 7.8% sharp · at its level
Chess Puzzles (Epoch) 61.0% █▁▁▁▁▂▃▃▃▂●▁ beats 134/137 very hard · avg 5.8% 4.9% sharp · at its level · noisy
HealthBench Professional (maker) 64.2% ▄·▄··▄▄·▄█·● beats 7/8 hard · avg 20% 1.7% blunt · at its level
SimpleQA Verified 73.9% ▁▁▃▂▃▃▆▆█▄▂● beats 80/81 very hard · avg 8.0% 1.6% at its level
Icelandic LLM Leaderboard average… 68.2% ▁▁▃▂▂▄▁▃▄▄▄● beats 34/38 very hard · avg 14% 1.6% at its level
HealthBench Hard (maker) 33.4% ▂··▂····▂▄·● beats 5/8 very hard · avg 9.6% 1.2% blunt · at its level
GPQA Diamond 95.4% ▁▁▁▁▂▄▆▄▅▇█● beats 208/211 hard · avg 39% 1.1% sharp · maxed out
HealthBench (maker) 56.7% ▃·▃·····█●▃▅ beats 5/8 hard · avg 24% 1.0% blunt · at its level
RobloxQA v2.0 multiple choice (To… 98.6% ▁▁▃▁█▄▃▃▆▂▂● beats 48/49 easy · avg 77% 0.7% maxed out
source results share of the score
Epoch AI 9 55% ▇▇▇▇▇▇▇
LMArena leaderboard dataset 5 31% ▇▇▇▇
Terminal-Bench 4.0 official leaderboard… 1 6% ▇
OpenAI vendor-reported benchmark scores… 3 4% ▇
Roblox LLM Leaderboard 2 2% ▇
Miðeind Icelandic LLM Leaderboard 1 2% ▇
prior: pull toward the middle 0% ▇
weighted average = 83.0
Licences: Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Terminal-Bench 4.0 official leaderboard submissions ([Apache-2.0](../../licenses/terminal-bench-leaderboard-submissions-Apache-2.0.txt)) · Roblox LLM Leaderboard ([MIT](../../licenses/roblox-llm-leaderboard-MIT.txt)) · Miðeind Icelandic LLM Leaderboard ([CC BY 4.0](../../licenses/mideind-icelandic-llm-leaderboard-CC-BY-4.0.txt))
## How to run it
### Through an API
api (OpenAI) · $4.00/M blended · $2 in / $10 out per 1M tokens · [developers.openai.com](https://developers.openai.com/api/docs/models/gpt-6.1-sol)
[price source](https://developers.openai.com/api/docs/models/gpt-6.1-sol): Observed 2026-10-06. USD per million tokens, Standard, prompts up to 272K input tokens; longer prompts 2x input and 1.5x output. Fast/regional premiums excluded. · [context source](https://developers.openai.com/api/docs/models/gpt-6.1-sol): Official 1,050,000-token total window; maximum input 922,000 and maximum output 128,000. Observed 2026-10-06.
[interactive version](https://whatmodel.sh/model/gpt-6-1-sol) · [JSON](https://whatmodel.sh/api?format=json&all=1)