[whatmodel.sh](../../README.md) / Gemini 2.5 Flash Preview (04-17) # Gemini 2.5 Flash Preview (04-17) Google · released 2025-04 · proprietary **score 62.5** ±1.4 · comparison only: no current run option verified · from 6 benchmark results across 6 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Gemini 2.5 Flash Preview (04-17) among every model on that task or test, worst to best. 
task                vs the others          rank  counts  tests
coding              ▁▁▁▃▄▆█●▅▄▃▁    #173 of 539     79%      3
math                ▁▁▃▆██▅●▃▁▁▁   #149 of 530*     16%      1
vision & documents  ▁▁▂▃▂▃▅●▆██▄   #113 of 189*    3.3%      1
coding · #173 of 539 · 79% of its score Beats [Qwen3-Coder-Next (80B-A3B)](qwen3-coder-next.md), [Gemini 2.5 Pro](gemini-2-5-pro.md), [Gemini 3.1 Flash-Lite](gemini-3-1-flash-lite.md) here, though they rank higher overall. Trails [Ministral 3 8B Reasoning 2512](ministral-3-8b-reasoning.md), [Phi-4-reasoning 14B](phi-4-reasoning.md), [Llama 3.1 Nemotron Ultra 253B v1](llama-3-1-nemotron-ultra-253b.md) here, though they rank lower overall. 
test                                result  vs the others in its run  difficulty            counts  why
Aider polyglot (225 exercises, tw…   47.1%  ▂·▂▃▅▂▃●▆▄▂▂ beats 24/49  very hard · avg 7.6%     54%  sharp · at its level
LiveCodeBench official (Aug 1, 20…   60.6%  ▃▃▅▃··▃●█▅▅▃ beats 7/15   hard · avg 24%           14%  sharp · at its level
WebApp1K-Duo-React pass@1 (onekq-…   57.0%  ▁··▁·▁▁▁●█▇█ beats 8/45   hard · avg 29%           12%  at its level
math · #149 of 530 · 16% of its score Beats [Claude Sonnet 4.6](claude-sonnet-4-6.md), [MiniMax-M3](minimax-m3.md), [MiMo-V2.5 (310B-A15B)](mimo-v2-5.md) here, though they rank higher overall. Trails [Olmo 3 32B Think](olmo-3-32b-think.md), [Nemotron-Cascade-8B](nemotron-cascade-8b.md), [Olmo 3.1 32B Think](olmo-3-1-32b-think.md) here, though they rank lower overall. 
test                      result  vs the others in its run    difficulty            counts  why
OTIS mock AIME 2024–2025   73.1%  ▃▃▄▃▃▃▇●█▃▂▅ beats 106/197  very hard · avg 7.2%     16%  sharp · at its level · noisy
vision & documents · #113 of 189 · 3.3% of its score Beats [DeepSeek V4 Flash Vision (Exp)](deepseek-v4-flash-vision-exp.md) here, though they rank higher overall. Trails [Mistral Small 4 (119B-A6.5B)](mistral-small-4.md), [Qwen3-VL 32B Instruct](qwen3-vl-32b-instruct.md), [Qwen3.5 4B](qwen3-5-4b.md) here, though they rank lower overall. 
test                                result  vs the others in its run  difficulty      counts  why
MSEarth-Bench Earth-science figur…   57.2%  █·██····●█·█ beats 3/5    hard · avg 48%    3.3%  blunt · at its level
other tests (1) 
test                                result  vs the others in its run    difficulty           counts  why
Vectara hallucination leaderboard…   98.7%  ▁▁▂▃▄▄█▆▃▂●▁ beats 132/140  very easy · avg 94%    0.7%  blunt · maxed out · noisy
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
Aider polyglot benchmark runs                   1   54% ▇▇▇▇▇▇
Epoch AI                                        1   16% ▇▇
LiveCodeBench official website results          1   14% ▇▇
WebApp1K models leaderboard                     1   12% ▇
MSEarth: A Multimodal Benchmark for Ear…        1    3% ▇
Vectara hallucination leaderboard               1    1% ▇
prior: pull toward the middle                        1% ▇
weighted average                                   = 62.5
Licences: Aider polyglot benchmark runs ([Apache-2.0](../../licenses/aider-polyglot-runs-Apache-2.0.txt)) · Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · LiveCodeBench official website results ([CC-BY-SA-4.0](../../licenses/lcb-sharealike-NOTICE.txt)) · WebApp1K models leaderboard ([MIT](../../licenses/webapp1k-leaderboard-MIT.txt)) · MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs ([CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/)) · Vectara hallucination leaderboard ([Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/gemini-2-5-flash-preview-04-17) · [JSON](https://whatmodel.sh/api?format=json&all=1)