[whatmodel.sh](../../README.md) / Gemini 3.5 Flash
# Gemini 3.5 Flash
Google · released 2026-05 · closed weights
**score 72.7** ±0.6 · #53 of 732 · from 30 benchmark results across 9 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks Gemini 3.5 Flash among every model on that task or test, worst to best.
task vs the others rank counts tests
agent tasks ▁▁▃▆█▄▅▅●▄▂▁ #54 of 313 8.3% 4
coding ▁▁▁▃▅▇█▇▅●▃▁ #57 of 469* 11% 2
chat & writing ▁▁▁▃▆▄▆█▆▇●▃ #25 of 402* 3.2% 1
math ▁▁▃▅█▆▄█●▂▁▁ #44 of 431 58% 13
vision & documents ▁▁▂▂▁▃▄▂▆▇●▄ #19 of 153 7.0% 4
web search ▁▁▁▅▄●▃▄·▁·▁ #45 of 84* 1.0% 1
agent tasks · #54 of 313 · 8.3% of its score
Beats [Gemini 3.1 Pro (Preview)](gemini-3-1-pro.md), [Muse Spark 1.1](muse-spark-1-1.md), [Muse Spark 1.2](muse-spark-1-2.md) here, though they rank higher overall. Trails [Claude Sonnet 4.6](claude-sonnet-4-6.md), [Qwen3.8 27B](qwen3-8-27b.md), [GLM-5.2](glm-5-2.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
SWE-bench Verified 79.3% ▁··▁·▁▂▁▄█●▁ beats 28/29 hard · avg 19% 5.5% sharp
Legal Research Bench (agentic, al… 30.8% ▄█··▄▄▄█●·▄█ beats 8/12 very hard · avg 6.3% 1.0% at its level
EEGAgentBench overall (tool-based… 49.5% ▂·▁▁··▇▇●▂·▁ beats 18/25 hard · avg 28% 1.0% blunt · at its level
KlinikeBench strict pass@1 (333 i… 15.6% ▁▁·▁▁▁▁▅▃●▅█ beats 14/27 very hard · avg 2.4% 0.8% typical
coding · #57 of 469 · 11% of its score
Beats [GPT-5.4](gpt-5-4.md), [Gemini 3.1 Pro (Preview)](gemini-3-1-pro.md), [DeepSeek V4 Flash Vision (Exp)](deepseek-v4-flash-vision-exp.md) here, though they rank higher overall. Trails [Qwen3.7 Plus](qwen3-7-plus.md), [Claude Sonnet 4.6](claude-sonnet-4-6.md), [Kimi K2.6](kimi-k2-6.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Arena WebDev (Code Arena) 1499.3 ▁▁▃▂▅█●▆▅▅▁▂ beats 71/129 avg 981 5.7% sharp
SWE-bench Verified 79.3% ▁··▁·▁▂▁▄█●▁ beats 28/29 hard · avg 19% 5.5% sharp
chat & writing · #25 of 402 · 3.2% of its score
Beats [GPT-6 Astra](gpt-6-astra.md), [Claude Sonnet 5.5](claude-sonnet-5-5.md), [GPT-6 Sol](gpt-6-sol.md) here, though they rank higher overall. Trails [Gemini 3.6 Flash](gemini-3-6-flash.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
LMArena (text) 1477.6 ▁▁▁▂▃▃▃▆▆▇●▃ beats 359/385 avg 1260 3.2% blunt
math · #44 of 431 · 58% of its score
Beats [Grok 4.7](grok-4-7.md) here, though they rank higher overall. Trails [GPT-5.2](gpt-5-2.md), [DeepSeek V4 Flash (0731)](deepseek-v4-flash.md), [Qwen3.7 Max](qwen3-7-max.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
FrontierMath tiers 1–3 v2 62.8% ▂··▁▁▃▄▄●▆▄▃ beats 48/86 very hard · avg 1.2% 15% sharp · at its level
FrontierMath tier 4 v2 26.8% ▁▂▁▂●▅▂▃▂▁▁▁ beats 29/67 very hard · avg 0.1% 11% sharp · at its level
MathArena ArXivMath June 2026 (48… 52.1% ▂···▄·●█▆▆▄▂ beats 4/19 very hard · avg 5.1% 7.3% sharp · at its level
MathArena ArXivMath April 2026 (4… 52.5% ▁·····▅●█▄·▁ beats 9/20 very hard · avg 7.6% 6.7% sharp · at its level
MathArena ArXivMath February 2026… 50.8% ▁▁▁▁█▇▄●▁▃·▃ beats 18/24 very hard · avg 9.4% 3.8% at its level
MathArena ArXivMath March 2026 (3… 55.8% █▃▅·●▃▃·▅·▃▃ beats 8/14 hard · avg 16% 3.0% at its level
MathArena ArXivMath May 2026 (40 … 44.2% ▁··▁●█▄▁·▃·▁ beats 2/17 very hard · avg 11% 2.3% at its level
MathArena BrokenArXiv April 2026 … 21.3% ▂▂▆●▃▃▂▂▂··▂ beats 7/18 very hard · avg 0.8% 2.2% sharp · at its level · noisy
MathArena BrokenArXiv June 2026 (… 12.3% ▄··●▂▂▂▆▄··▂ beats 3/14 very hard · avg 1.3% 1.5% sharp · at its level · noisy
MathArena BrokenArXiv May 2026 (5… 11.0% █●·▄▄▄····▄▄ beats 3/8 very hard · avg 1.9% 1.4% sharp
MathArena BrokenArXiv March 2026 … 16.1% █·▆●▂·▂▂···▂ beats 10/14 very hard · avg 1.0% 1.2% sharp · noisy
MathArena BrokenArXiv February 20… 6.5% ▃▂●▃█▃▂·▃··▂ beats 3/16 very hard · avg 0.9% 1.2% sharp · noisy
OTIS mock AIME 2024–2025 95.6% ▃▃▄▃▃▃▇▇█●▂▅ beats 163/197 very hard · avg 7.2% 0.6% sharp · maxed out · noisy
vision & documents · #19 of 153 · 7.0% of its score
Beats [Claude Sonnet 5.5](claude-sonnet-5-5.md), [GPT-6 Sol](gpt-6-sol.md), [GPT-5.5](gpt-5-5.md) here, though they rank higher overall.
test result vs the others in its run difficulty counts why
CharXiv (reasoning questions) (ma… 84.2% ▃·▃·▃▃▃·▃▃●▅ beats 8/11 medium · avg 38% 3.5% typical
Arena vision (style controlled) 1282.2 ▁▁▂▂▂▂▃▄▅▅█● beats 134/152 avg 1061 2.1% blunt
Arena document (style controlled) 1453.4 ▁▁▃▃▄▃●█▅▇▄▅ beats 14/37 avg 1331 1.1% blunt
SpaceCast-Bench predictive spatia… 58.0% ▃·▅▃▅▃··▅··● beats 11/11 very hard · avg 33% 0.3% at its level · noisy
web search · #45 of 84 · 1.0% of its score
Beats [Gemini 3.1 Pro (Preview)](gemini-3-1-pro.md) here, though they rank higher overall. Trails [GPT-4o mini (2024-07-18)](gpt-4o-mini-2024-07-18.md), [Mistral Small 3.1 24B (2503)](mistral-small-3-1.md), [Llama 4 Scout (109B-A17B)](llama-4-scout.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
Legal Research Bench (agentic, al… 30.8% ▄█··▄▄▄█●·▄█ beats 8/12 very hard · avg 6.3% 1.0% at its level
other tests (7)
test result vs the others in its run difficulty counts why
EBR-bench (Epoch) 4.8% ▄●·▆█▂█▆▄▆·▆ beats 2/25 very hard · avg 0.3% 4.8% sharp
Mystery Game Puzzles (Epoch) 32.0% █··▂▃▇▄●▂▄▂▁ beats 50/77 very hard · avg 9.4% 4.1% sharp · noisy
Chess Puzzles (Epoch) 50.0% █▁▁▁▁▂▃▃▃●▁▁ beats 131/137 very hard · avg 5.8% 2.7% sharp · at its level · noisy
GPQA Diamond 92.8% ▁▁▁▁▂▄▆▄▅▇█● beats 193/211 hard · avg 39% 2.6% sharp
Legal Research Bench (single-shot… 6.3% ▃▃█▃·▅···●▃▃ beats 8/12 very hard · avg 0.8% 1.3% too hard for it
SimpleQA Verified 66.2% ▁▁▃▂▃▃▆▆█▄●▅ beats 71/81 very hard · avg 8.0% 1.2% at its level
Icelandic LLM Leaderboard average… 62.2% ▁▁▃▂▂▄▁▃▄▄●█ beats 27/38 very hard · avg 14% 1.2% at its level
source results share of the score
Epoch AI 9 48% ▇▇▇▇▇▇
MathArena ArXivMath / BrokenArXiv / ArX… 10 31% ▇▇▇▇
LMArena leaderboard dataset 4 12% ▇
Google DeepMind Gemini model page and m… 1 3% ▇
Legal Research Bench 2 2% ▇
Miðeind Icelandic LLM Leaderboard 1 1% ▇
EEGAgentBench: Benchmarking LLM Agents … 1 1% ▇
KlinikeBench: Evaluating Language Model… 1 1% ▇
SpaceCast-Bench: Evaluating Predictive … 1 0% ▇
prior: pull toward the middle 0% ▇
weighted average = 72.7
Licences: Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets ([CC BY-SA 4.0](../../licenses/matharena-sharealike-NOTICE.txt)) · LMArena leaderboard dataset ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Legal Research Bench ([CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/)) · Miðeind Icelandic LLM Leaderboard ([CC BY 4.0](../../licenses/mideind-icelandic-llm-leaderboard-CC-BY-4.0.txt)) · EEGAgentBench: Benchmarking LLM Agents on Short- and Long-Horizon EEG Analysis ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · KlinikeBench: Evaluating Language Models Beyond Diagnostic Accuracy ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/))
## How to run it
### Through an API
api (Google) · $3.38/M blended · $1.5 in / $9 out per 1M tokens · [ai.google.dev](https://ai.google.dev/gemini-api/docs/models)
[price source](https://github.com/anomalyco/models.dev/blob/a668908cfe7073faa0363699486fc41a3ff52412/providers/google/models/gemini-3.5-flash.toml): Standard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ. · [context source](https://github.com/anomalyco/models.dev/blob/a668908cfe7073faa0363699486fc41a3ff52412/models/google/gemini-3.5-flash.toml)
[interactive version](https://whatmodel.sh/model/gemini-3-5-flash) · [JSON](https://whatmodel.sh/api?format=json&all=1)