[whatmodel.sh](../../README.md) / Qwen3-Max (2026-01-23)
# Qwen3-Max (2026-01-23)
Alibaba · released 2026-01 · proprietary
**score 68.7** ±0.9 · comparison only: no current run option verified · from 40 benchmark results across 2 sources · † no independently run results verified
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks Qwen3-Max (2026-01-23) among every model on that task or test, worst to best.
task vs the others rank counts tests
agent tasks ▁▁▂▆█▄▅●▄▃▁▁ #98 of 354 38% 14
coding ▁▁▁▃▄▆█▇▅●▃▁ #73 of 539 10% 3
chat & writing ▁▁▁▃▅▄▇█▇●▇▃ #111 of 474* 1.6% 1
math ▁▁▃▆██▅█●▁▁▁ #59 of 530 15% 5
web search ▂▁▂●▅█▅▄▁▂▁▁ #79 of 96 10% 5
agent tasks · #98 of 354 · 38% of its score
Beats [Grok 4.20 (0309 reasoning)](grok-4-20.md), [GPT-5.1](gpt-5-1.md), [o3-pro](o3-pro.md) here, though they rank higher overall. Trails [Hy3 preview (295B-A21B)](hy3-preview.md), [MiniMax-M2.7](minimax-m2-7.md), [Step 3.5 Flash (196B-A11B)](step-3-5-flash.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
τ²-bench aggregate (maker) 84.6% ▄····●▄▄···▄ beats 1/5 medium · avg 45% 4.9% typical
SWE-bench Verified (maker) 75.3% ▁▁▁▁▁▁▂▄█●▁▁ beats 108/138 hard · avg 23% 4.8% sharp · at its level · small run
τ²-bench Telecom (maker) 98.3% ▁·▅█▆▅▂▃▃▂●▁ beats 85/89 medium · avg 37% 4.1% sharp · small run
BrowseComp-ZH (maker) 60.9% ▁▁▁▁▁▃·▁▄▅●█ beats 15/23 hard · avg 21% 3.1% at its level · small run
SWE-bench Multilingual (maker) 66.7% ▁··▁▃▁▅●█▂▂▁ beats 30/65 hard · avg 26% 3.0% at its level · small run
τ²-bench Retail (maker) 79.4% ▁····▂▁▃▆█●▁ beats 41/44 medium · avg 39% 2.7% small run
Humanity's Last Exam with tools (… 49.8% ▁·▁▂▂▁▄▄▇●▄▅ beats 35/62 hard · avg 16% 2.2% at its level · small run
τ²-bench Airline (maker) 69.0% ▁▁·▂▁▃▂▁█▅▂● beats 40/42 hard · avg 30% 2.2% at its level · small run
Terminal-Bench 2.0 (maker) 22.5% ▂▂●▅████▆▂▃▃ beats 2/36 very hard · avg 8.9% 2.2% at its level · small run
BrowseComp (maker) 53.9% ▂·▃▁▂▂▆●█▂▂▄ beats 23/46 hard · avg 23% 2.0% at its level · small run
MCPMark (maker) 33.5% ▃·····█··▃●▃ beats 5/8 very hard · avg 11% 1.9% at its level · small run
BFCL V4 (December 2025 archive) (… 67.7% ▁▁▁▂▆▆▅▆█▂●▃ beats 103/114 medium · avg 39% 1.7% at its level · small run
Toolathlon (Tool Decathlon) (make… 18.8% ●▂▄▂▄▄▆▂█▆██ beats 0/27 very hard · avg 10% 1.5% at its level · small run
WideSearch (maker) 57.9% ●·▂▆··▂···▂▂ beats 0/10 medium · avg 36% 1.3% at its level · small run
coding · #73 of 539 · 10% of its score
Beats [Gemini 3.1 Pro (Preview)](gemini-3-1-pro.md), [DeepSeek V4 Flash Vision (Exp)](deepseek-v4-flash-vision-exp.md), [GPT-5.2](gpt-5-2.md) here, though they rank higher overall. Trails [MiMo-V2.5-Pro (1T-A42B)](mimo-v2-5-pro.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
SWE-bench Verified (maker) 75.3% ▁▁▁▁▁▁▂▄█●▁▁ beats 108/138 hard · avg 23% 4.8% sharp · at its level · small run
SWE-bench Multilingual (maker) 66.7% ▁··▁▃▁▅●█▂▂▁ beats 30/65 hard · avg 26% 3.0% at its level · small run
LiveCodeBench v6 (Feb–May 2025) (… 85.9% ▁▁▃▁█▅▄▇▅▅▃● beats 36/38 medium · avg 48% 2.5% small run
chat & writing · #111 of 474 · 1.6% of its score
Beats [LongCat 2.0 (1.6T-A48B)](longcat-2-0.md) here, though they rank higher overall. Trails [Gemma 4 12B](gemma-4-12b.md), [Kimi K2 Instruct (0905)](kimi-k2-0905.md), [Gemma 4 26B-A4B](gemma-4-26b-a4b.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
IFEval (aggregation unspecified) … 93.4% ▁▂▄▂▂▄▆██●▂▁ beats 133/145 easy · avg 79% 1.6% maxed out · small run
math · #59 of 530 · 15% of its score
Beats [Qwen3.6 Max Preview](qwen3-6-max-preview.md), [Claude Sonnet 4.6](claude-sonnet-4-6.md), [DeepSeek V4 Pro (Preview, Apr 2026)](deepseek-v4-pro-preview.md) here, though they rank higher overall. Trails [A.X K2 (688B-A33B)](ax-k2.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
AIME 2026 (maker) 93.3% ▁▁▁▂▂▂▆●▆▂·▁ beats 37/52 medium · avg 53% 4.7% sharp · maxed out · small run
IMO-AnswerBench (maker) 83.9% ▁▁·▁▁▁▄▆█●▂▃ beats 33/44 medium · avg 36% 3.8% small run
HMMT February 2025 (maker) 98.0% ▁▁▁▃▁▅▅▃██▁● beats 30/31 easy · avg 74% 2.6% maxed out · small run
HMMT November 2025 (maker) 94.7% ▁▁····▁▅▃█●▁ beats 22/23 easy · avg 73% 2.1% maxed out · small run
PolyMATH (maker) 64.7% ▁···▃▁·▇█▄●▄ beats 20/23 hard · avg 32% 1.9% at its level · small run
web search · #79 of 96 · 10% of its score
Beats [DeepSeek V4 Flash (Preview, Apr 2026)](deepseek-v4-flash-preview.md) here, though they rank higher overall. Trails [GPT-4.1 nano](gpt-4-1-nano-2025-04-14.md), [GPT-4o mini (2024-07-18)](gpt-4o-mini-2024-07-18.md), [Mistral Small 3.1 24B (2503)](mistral-small-3-1.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
BrowseComp-ZH (maker) 60.9% ▁▁▁▁▁▃·▁▄▅●█ beats 15/23 hard · avg 21% 3.1% at its level · small run
Humanity's Last Exam with tools (… 49.8% ▁·▁▂▂▁▄▄▇●▄▅ beats 35/62 hard · avg 16% 2.2% at its level · small run
BrowseComp (maker) 53.9% ▂·▃▁▂▂▆●█▂▂▄ beats 23/46 hard · avg 23% 2.0% at its level · small run
SealQA Seal-0 (maker) 46.9% ▃····▃·····● beats 2/4 hard · avg 20% 1.5% at its level · small run
WideSearch (maker) 57.9% ●·▂▆··▂···▂▂ beats 0/10 medium · avg 36% 1.3% at its level · small run
other tests (19)
test result vs the others in its run difficulty counts why
GPQA (subset unspecified) (maker) 87.4% ▂▁▂▂▄▃▆▃▅█▃● beats 102/106 hard · avg 47% 5.1% sharp · small run
LongBench v2 (maker) 60.6% ▂·▁·▂▃▁▄▄▃●▄ beats 25/33 very hard · avg 34% 3.4% at its level · small run
Humanity's Last Exam (maker) 30.2% ▁▁▁▄▆▆▇█●▆▁▃ beats 76/111 very hard · avg 5.6% 3.3% at its level · small run
MMLU-Pro (maker) 85.7% ▁▁·▁▁▁▃▂▄▅●▁ beats 175/188 medium · avg 55% 3.1% small run
C-Eval (maker) 93.7% ▁···▁▁▂▁▂▂▃● beats 33/33 medium · avg 73% 2.8% small run
INCLUDE (maker) 82.3% ▂····▂▂▄▄▄█● beats 33/36 medium · avg 56% 2.7% small run
MMLU-Redux (maker) 92.8% ▁▁▃▁▂▃▄▅▇▅●▄ beats 49/63 easy · avg 77% 2.5% maxed out · small run
MMMLU (maker) 84.4% ▂▁▁▂▃▂▄▄▅█●▃ beats 35/46 medium · avg 61% 2.4% small run
VitaBench (maker) 40.9% ▄··▂▄▆▆█▄▄●▂ beats 19/21 very hard · avg 13% 2.3% at its level · small run
IFBench (aggregation unspecified)… 70.9% ▂▆▂▄▄▄▂▄▄●█▇ beats 59/86 medium · avg 40% 2.0% at its level · small run
MultiChallenge (maker) 63.3% ▁·▁·▁▃▆▅▃▂●▅ beats 26/30 hard · avg 31% 1.9% at its level · small run
SuperGPQA (maker) 67.3% ▂▁▂▂▅▆▃▇▇▇█● beats 45/46 medium · avg 37% 1.8% at its level · small run
Global PIQA (maker) 86.0% ▃▃··▃··▃▃▅●▅ beats 7/11 medium · avg 72% 1.8% small run
MAXIFE (maker) 84.0% ▂·▂·▂···▆·●█ beats 7/11 medium · avg 63% 1.7% small run
MMLU-ProX (maker) 78.5% ▁·▁▁▁▂▁▃▃●▅▄ beats 19/36 medium · avg 56% 1.7% small run
DeepPlanning (maker) 28.7% ▂·····▂··▄█● beats 8/9 very hard · avg 11% 1.4% at its level · small run
NOVA-63 (maker) 54.2% ▃▃·▃···▃●▃▃█ beats 5/11 medium · avg 35% 1.2% blunt · at its level · small run
WMT24++ (maker) 77.6% ▁·▁▁·▁·▁▂●█▃ beats 12/27 easy · avg 68% 0.3% blunt · small run
SecCodeBench (maker) 57.5% ●··········█ beats 0/1 — not counted yet: no other model in the …
source results share of the score
Qwen/Qwen3.5-397B-A17B model card (subm… 37 91% ▇▇▇▇▇▇▇▇▇▇▇
τ²-bench leaderboard: Qwen (submitted /… 3 9% ▇
prior: pull toward the middle 0% ▇
weighted average = 68.7
Licences: Qwen/Qwen3.5-397B-A17B model card ([apache-2.0](../../licenses/Qwen--Qwen3.5-397B-A17B.txt)) · τ²-bench leaderboard: Qwen ([MIT](https://opensource.org/license/mit))
Not counted (1)
source test score why
Qwen/Qwen3.5-397B-A17… SecCodeBench 57.5% too few models have it yet