[whatmodel.sh](../../README.md) / Qwen Turbo (2024-11-01) # Qwen Turbo (2024-11-01) Alibaba · released 2024-11 · proprietary **score 53.8** ±1.5 · comparison only: no current run option verified · from 4 benchmark results across 2 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at _{● marks Qwen Turbo (2024-11-01) among every model on that task or test, worst to best.}

task  vs the others          rank  counts  tests
math  ▁▁▃▆█●▅█▃▁▁▁   #295 of 530*     62%      2

math · #295 of 530 · 62% of its score

Beats [GPT-4o (2024-08-06)](gpt-4o-2024-08-06.md), [Command A (03-2025)](command-a.md), [GPT-4o (2024-05-13)](gpt-4o-2024-05-13.md) here, though they rank higher overall. Trails [Gemma 7B (base)](gemma-7b-base.md), [CodeGemma 7B (v1.0)](codegemma-7b.md), [Phi-2 (2.7B)](phi-2.md) here, though they rank lower overall.

test                      result  vs the others in its run   difficulty            counts  why
MATH level 5               56.2%  ▂▂▅▆▄●▆▃▅▂▃▄ beats 49/92   hard · avg 28%           52%  sharp · at its level
OTIS mock AIME 2024–2025    6.1%  ▃▃●▃▃▃▇▇█▃▂▅ beats 33/197  very hard · avg 7.2%     10%  sharp · noisy

other tests (2)

test                                result  vs the others in its run    difficulty        counts  why
GPQA Diamond                         41.8%  ▁▁▁▁▂●▆▄▅▇█▅ beats 43/211   hard · avg 39%       32%  sharp · at its level
Open PT-LLM Leaderboard average (…   76.5%  ▃▁▁▁▁▁▁▁▂█●▁ beats 234/276  medium · avg 72%    5.0%  at its level · noisy

## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md)

source                           results  share of the score
Epoch AI                               3   94% ▇▇▇▇▇▇▇▇▇▇▇
Open Portuguese LLM Leaderboard        1    5% ▇
prior: pull toward the middle               1% ▇
weighted average                          = 53.8

_{Licences: Epoch AI ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) · Open Portuguese LLM Leaderboard ([Apache-2.0](../../licenses/hf-leaderboard-spaces-Apache-2.0.txt))} ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/qwen-turbo-2024-11-01) · [JSON](https://whatmodel.sh/api?format=json&all=1)