[whatmodel.sh](../../README.md) / Mercury 2 # Mercury 2 Inception · proprietary **score 58.3** ±1.8 · comparison only: no current run option verified · from 3 benchmark results across 2 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Mercury 2 among every model on that task or test, worst to best. 
task            vs the others          rank  counts  tests
coding          ▁▁▁▃▄▆●▇▅▄▃▁   #248 of 539*     63%      1
chat & writing  ▁▁▁▃▅▄▇█●▇▇▃   #204 of 474*     36%      1
coding · #248 of 539 · 63% of its score Beats [Qwen3.5 4B](qwen3-5-4b.md), [Falcon-H1R 7B](falcon-h1r-7b.md), [Qwen3-VL 32B Instruct](qwen3-vl-32b-instruct.md) here, though they rank higher overall. Trails [QwQ-32B-Preview](qwq-32b-preview.md), [Ministral 3 3B Reasoning 2512](ministral-3-3b-reasoning.md), [DeepSeek-Coder-V2 Instruct (0724)](deepseek-coder-v2-0724.md) here, though they rank lower overall. 
test                       result  vs the others in its run  difficulty  counts  why
Arena WebDev (Code Arena)  1170.4  ▁●▃▂▅█▃▆▅▅▁▂ beats 3/129  avg 981        63%  sharp
chat & writing · #204 of 474 · 36% of its score Beats [MiniCPM5 2B](minicpm5-2b.md), [Granite 4.2 30B](granite-4-2-30b.md), [Seed-OSS 36B Instruct](seed-oss-36b.md) here, though they rank higher overall. Trails [LFM2.5 1.2B Instruct](lfm2-5-1-2b-instruct.md), [LFM2.5 1.2B Thinking](lfm2-5-1-2b-thinking.md), [LFM2.5 8B-A1B](lfm2-5-8b-a1b.md) here, though they rank lower overall. 
test            result  vs the others in its run    difficulty  counts  why
LMArena (text)  1342.8  ▁▁▁▂▃▃▃▆●▇█▃ beats 181/385  avg 1260       36%  blunt
other tests (1) 
test                                result  vs the others in its run  difficulty           counts  why
Vectara hallucination leaderboard…   87.7%  ▁▂▁▂●█▂▃▄▃▁▁ beats 20/98  very easy · avg 90%    0.0%  blunt
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                             results  share of the score
LMArena leaderboard dataset              2   98% ▇▇▇▇▇▇▇▇▇▇▇▇
Vectara hallucination leaderboard        1    0% ▇
prior: pull toward the middle                 2% ▇
weighted average                            = 58.3
Licences: LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Vectara hallucination leaderboard ([Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/mercury-2) · [JSON](https://whatmodel.sh/api?format=json&all=1)