[whatmodel.sh](../../README.md) / Mistral Small (2402) # Mistral Small (2402) Mistral · released 2024-02 · proprietary **score 46.3** ±1.2 · comparison only: no current run option verified · from 4 benchmark results across 3 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Mistral Small (2402) among every model on that task or test, worst to best. 
task         vs the others          rank  counts  tests
agent tasks  ▁▁▂●█▄▅▄▄▃▁▁   #320 of 354*    3.6%      1
agent tasks · #320 of 354 · 3.6% of its score Beats [Magistral Small 1.0 (2506)](magistral-small-2506.md), [Llama 4 Scout (109B-A17B)](llama-4-scout.md), [Bielik 11B v2.3 Instruct](bielik-11b-v2-3-instruct.md) here, though they rank higher overall. Trails [Granite 4.0 H 350M](granite-4-0-h-350m.md), [Qwen3 0.6B](qwen3-0-6b.md), [Qwen2.5 1.5B Instruct](qwen2-5-1-5b.md) here, though they rank lower overall. 
test     result  vs the others in its run   difficulty        counts  why
BFCL v3   46.3%  ▁▁▁▁▁▃●█▅▄▁▁ beats 26/114  medium · avg 51%    3.6%  blunt · at its level
other tests (3) 
test                     result  vs the others in its run  difficulty        counts  why
LiveBench 2024-07-26      32.2%  ▁▁▁▂▂▃▂●▆▃▅▃ beats 33/61  medium · avg 38%     60%  at its level
BigCodeBench (Instruct)   31.8%  ▃▂·▆●██▆▅▃▃▃ beats 8/33   medium · avg 39%     18%  at its level
BigCodeBench (Complete)   39.0%  ▂▁▁▄▂▅●█▆▂▂▂ beats 25/58  medium · avg 48%     18%  at its level
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
LiveBench model judgments                       1   60% ▇▇▇▇▇▇▇
BigCodeBench paper                              2   36% ▇▇▇▇
Berkeley Function Calling Leaderboard r…        1    4% ▇
prior: pull toward the middle                        1% ▇
weighted average                                   = 46.3
Licences: LiveBench model judgments ([Apache-2.0 (stated in the LiveBench datasheet)](https://www.apache.org/licenses/LICENSE-2.0)) · BigCodeBench paper ([CC BY 4.0](http://creativecommons.org/licenses/by/4.0/)) · Berkeley Function Calling Leaderboard result archive ([Apache-2.0](../../licenses/bfcl-result-archive-v4-Apache-2.0.txt)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/mistral-small-2402) · [JSON](https://whatmodel.sh/api?format=json&all=1)