[whatmodel.sh](../../README.md) / Magistral Medium 1.0 (2506) # Magistral Medium 1.0 (2506) Mistral · released 2025-06 · closed weights **score 55.5** ±1.3 · comparison only: no current run option verified · from 6 benchmark results across 3 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Magistral Medium 1.0 (2506) among every model on that task or test, worst to best.
task            vs the others          rank  counts  tests
agent tasks     ▁▁▂▆●▄▅▄▄▃▁▁   #246 of 354*    3.2%      1
coding          ▃●······▃·▃▃       #4 of 7*    7.9%      1
chat & writing  ▁▁▁▃▅▄▇●▇▇▇▃   #265 of 474*     17%      1
math            ▁▁▃▆█●▅█▃▁▁▁   #236 of 530*     45%      2
agent tasks · #246 of 354 · 3.2% of its score Beats [o1 (2024-12-17)](o1-2024-12-17.md), [o3-mini](o3-mini.md), [DeepSeek R1 (Jan '25)](deepseek-r1.md) here, though they rank higher overall. Trails [SmolLM3 3B](smollm3-3b.md), [Jamba 1.5 Mini](jamba-1-5-mini.md), [Mellum2 12B-A2.5B Instruct](mellum2-12b-a2-5b-instruct.md) here, though they rank lower overall.
test                                result  vs the others in its run  difficulty      counts  why
Galileo Agent Leaderboard v2 (act…   32.0%  ▅▃·▃▃●▅█▃█▅▅ beats 5/19   hard · avg 26%    3.2%  at its level
coding · #4 of 7 · 7.9% of its score
test                                result  vs the others in its run  difficulty        counts  why
LiveCodeBench v5 (window unspecif…   59.4%  ▄█●······▄·▄ beats 3/5    medium · avg 50%    7.9%  at its level
chat & writing · #265 of 474 · 17% of its score Beats [Granite 4.2 8B](granite-4-2-8b.md), [Mistral Small 4 (119B-A6.5B)](mistral-small-4.md), [Olmo 3.1 32B Think](olmo-3-1-32b-think.md) here, though they rank higher overall. Trails [LFM2.5 1.2B Instruct](lfm2-5-1-2b-instruct.md), [Olmo 3 7B Instruct](olmo-3-7b-instruct.md), [Granite 4.0 H Micro 3B](granite-4-0-h-micro.md) here, though they rank lower overall.
test            result  vs the others in its run    difficulty  counts  why
LMArena (text)  1304.8  ▁▁▁▂▃▃▃●▆▇█▃ beats 132/385  avg 1260       17%  blunt
math · #236 of 530 · 45% of its score Beats [MiniMax-M2.1](minimax-m2-1.md), [DeepSeek V3 (Dec '24)](deepseek-v3.md), [Qwen3 235B-A22B (Apr 2025, hybrid)](qwen3-235b-a22b.md) here, though they rank higher overall. Trails [Mixtral 8x7B v0.1 (base)](mixtral-8x7b-v0-1.md), [Olmo 3 7B Instruct](olmo-3-7b-instruct.md), [Phi-4-mini-reasoning 3.8B](phi-4-mini-reasoning.md) here, though they rank lower overall.
test               result  vs the others in its run  difficulty        counts  why
AIME 2025 (maker)   65.0%  █●·····▃···▃ beats 3/5    medium · avg 48%     26%  sharp · at its level
AIME 2024 (maker)   73.6%  █●·····▃···▃ beats 3/5    medium · avg 60%     19%  sharp · at its level
other tests (1)
test                  result  vs the others in its run  difficulty        counts  why
GPQA Diamond (maker)   70.8%  █·█·█●█····█ beats 3/5    medium · avg 52%     26%  sharp · at its level
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md)
source                                    results  share of the score
mistralai/Magistral-Small-2509 model ca…        4   79% ▇▇▇▇▇▇▇▇▇
LMArena leaderboard dataset                     1   17% ▇▇
Galileo Agent Leaderboard                       1    3% ▇
prior: pull toward the middle                        1% ▇
weighted average                                   = 55.5
Licences: mistralai/Magistral-Small-2509 model card ([Apache-2.0](../../licenses/mistralai--Magistral-Small-2509.txt)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Galileo Agent Leaderboard ([Apache-2.0](../../licenses/galileo-agent-leaderboard-Apache-2.0.txt)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/magistral-medium-2506) · [JSON](https://whatmodel.sh/api?format=json&all=1)