[whatmodel.sh](../../README.md) / LongCat-Flash-Thinking (560B-A27B) # LongCat-Flash-Thinking (560B-A27B) Meituan · released 2025-09 · 560B params (27B active) · mit **score 67.7** ±1.0 · comparison only: no current run option verified · from 18 benchmark results across 1 source · † no independently run results verified Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks LongCat-Flash-Thinking (560B-A27B) among every model on that task or test, worst to best. 
task            vs the others          rank  counts  tests
agent tasks     ▁▁▂▆█▄▅●▄▃▁▁    #114 of 354     17%      4
coding          ▁▁▁▃▄▆█▇▅●▃▁    #62 of 539*    5.3%      1
chat & writing  ▁▁▁▃▅▄▇█●▇▇▃   #153 of 474*    3.0%      1
math            ▁▁▃▆██▅●▃▁▁▁     #82 of 530     30%      4
agent tasks · #114 of 354 · 17% of its score Beats [Grok 4.20 (0309 reasoning)](grok-4-20.md), [o3-pro](o3-pro.md), [Grok 4.3](grok-4-3.md) here, though they rank higher overall. Trails [SmolLM3 3B](smollm3-3b.md), [Nova 2 Pro (Preview)](nova-2-pro.md), [Mistral Medium 3.5 (128B)](mistral-medium-3-5.md) here, though they rank lower overall. 
test                      result  vs the others in its run    difficulty            counts  why
τ²-bench Retail (maker)    71.5%  █···█·█·█●·█ beats 4/5      hard · avg 35%          7.4%  at its level
τ²-bench Telecom (maker)   83.1%  █··██·█·█··● beats 5/5      very hard · avg 9.6%    4.8%  sharp · at its level · noisy
τ²-bench Airline (maker)   67.5%  ▄·····█··▄·● beats 5/5      hard · avg 28%          3.7%  at its level
BFCL v3 (maker)            74.4%  ▁▁▁▁▁▃▅█▆▅●▁ beats 166/171  medium · avg 54%        0.9%  blunt · at its level
coding · #62 of 539 · 5.3% of its score Beats [GPT-5.4](gpt-5-4.md), [Gemini 3.1 Pro (Preview)](gemini-3-1-pro.md), [DeepSeek V4 Flash Vision (Exp)](deepseek-v4-flash-vision-exp.md) here, though they rank higher overall. 
test                                result  vs the others in its run  difficulty        counts  why
LiveCodeBench (version unspecifie…   79.4%  ▄······▄█▄·● beats 5/5    medium · avg 41%    5.3%  typical
chat & writing · #153 of 474 · 3.0% of its score Beats [LongCat 2.0 (1.6T-A48B)](longcat-2-0.md) here, though they rank higher overall. Trails [LFM2.5 8B-A1B](lfm2-5-8b-a1b.md), [LFM2.5 2.6B](lfm2-5-2-6b.md), [Nemotron-Cascade-8B](nemotron-cascade-8b.md) here, though they rank lower overall. 
test                                result  vs the others in its run  difficulty      counts  why
IFEval prompt-level strict (maker)   86.9%  ██●··█·█···█ beats 2/5    easy · avg 73%    3.0%  typical
math · #82 of 530 · 30% of its score Beats [Claude Sonnet 4.6](claude-sonnet-4-6.md), [Claude Opus 4.5](claude-opus-4-5.md), [Qwen3.7 Plus](qwen3-7-plus.md) here, though they rank higher overall. Trails [Granite 4.2 30B](granite-4-2-30b.md), [INTELLECT-3](intellect-3.md), [Qwen3 235B-A22B Thinking 2507](qwen3-235b-a22b-thinking-2507.md) here, though they rank lower overall. 
test                                result  vs the others in its run    difficulty           counts  why
AIME 2025 (maker)                    90.6%  ▁·▁▁▁▂▅▆█▇●▁ beats 117/133  medium · avg 50%        11%  sharp
AIME 2024 (maker)                    93.3%  ▁▁▁▂▁▃▁▅███● beats 82/85    medium · avg 61%       8.8%  sharp · maxed out
HMMT 2025 (edition unspecified) (…   83.7%  ▄··▄··▄·▄··● beats 4/5      hard · avg 31%         8.0%  sharp
MATH-500 (maker)                     99.2%  █···██·█·●·█ beats 4/5      very easy · avg 92%    2.1%  maxed out · noisy
other tests (8) 
test                      result  vs the others in its run  difficulty            counts  why
GPQA Diamond (maker)       81.5%  ▄··▄··●▄···█ beats 2/5    hard · avg 42%           15%  sharp
MMLU-Pro (maker)           82.6%  ▄·●···█·▄··▄ beats 1/5    medium · avg 55%        7.2%  typical
MMLU-Redux (maker)         89.3%  ●███··█····█ beats 0/5    medium · avg 73%        6.0%  typical
ZebraLogic (maker)         95.5%  ██··█·●█···█ beats 3/5    easy · avg 75%          4.7%  maxed out
OJBench (maker)            40.7%  ▄······▄▄·▄● beats 4/5    very hard · avg 12%     4.6%  at its level
VitaBench (maker)          29.5%  █····██·█●·█ beats 4/5    very hard · avg 8.2%    4.4%  at its level
BeyondAIME (maker)         69.5%  █··▄····●··█ beats 3/5    medium · avg 42%        2.8%  at its level
miniF2F (pass@1) (maker)   67.6%  ██······▄··● beats 5/5    very hard · avg 14%     0.4%  blunt · at its level · noisy
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
Meituan LongCat-Flash-Thinking model ca…       18  100% ▇▇▇▇▇▇▇▇▇▇▇▇
prior: pull toward the middle                        0% ▇
weighted average                                   = 67.7
Licences: Meituan LongCat-Flash-Thinking model card ([MIT](https://huggingface.co/meituan-longcat/LongCat-Flash-Thinking/blob/7c9aad1e2daceaeab3a5a03deedb8e11e7a7819f/LICENSE)) ## How to run it No verified API or local download yet. Model repository and documentation: [huggingface.co/meituan-longcat](https://huggingface.co/meituan-longcat/LongCat-Flash-Thinking) [interactive version](https://whatmodel.sh/model/longcat-flash-thinking) · [JSON](https://whatmodel.sh/api?format=json&all=1)