[whatmodel.sh](../../README.md) / Reka Core (2024-05-01) # Reka Core (2024-05-01) Reka AI · released 2024-05 · proprietary **score 49.5** ±0.9 · comparison only: no current run option verified · from 7 benchmark results across 3 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Reka Core (2024-05-01) among every model on that task or test, worst to best. 
task            vs the others          rank  counts  tests
coding          ▁▁▁▃▄●█▇▅▄▃▁   #381 of 539*     22%      1
chat & writing  ▁▁▁▃▅▄●█▇▇▇▃   #310 of 474*    7.2%      1
math            ▁▁▃●██▅█▃▁▁▁   #420 of 530*     19%      2
coding · #381 of 539 · 22% of its score Beats [Solar Open 100B (102B-A12B)](solar-open-100b.md), [Qwen3 4B Instruct 2507](qwen3-4b-instruct-2507.md), [Qwen3-VL 8B Instruct](qwen3-vl-8b-instruct.md) here, though they rank higher overall. Trails [DeepSeek LLM 67B Chat](deepseek-llm-67b-chat.md), [WizardLM 70B V1.0](wizardlm-70b-v1-0.md), [Code Tulu 2 34B](code-tulu-2-34b.md) here, though they rank lower overall. 
test                               result  vs the others in its run  difficulty        counts  why
CRUXEval (ZeroEval, 800 problems)   46.3%  ▁▂▆●▆█▆▃▂·▁▁ beats 12/47  medium · avg 57%     22%  sharp · at its level
chat & writing · #310 of 474 · 7.2% of its score Beats [Mistral Small 4 (119B-A6.5B)](mistral-small-4.md), [Qwen2.5 Coder 32B Instruct](qwen2-5-coder-32b.md), [Ministral 3 14B Reasoning 2512](ministral-3-14b-reasoning.md) here, though they rank higher overall. Trails [Flan-T5 XXL](flan-t5-xxl.md), [Granite 4.0 H 1B](granite-4-0-h-1b.md), [Granite 4.0 1B](granite-4-0-1b.md) here, though they rank lower overall. 
test                                result  vs the others in its run  difficulty  counts  why
Polyrating rating (bias-aware re-…  1212.0  ▂▁▂▁▃▇█▆▇●▂▂ beats 84/95  avg 1187      7.2%  typical
math · #420 of 530 · 19% of its score Beats [Athene-70B](athene-70b.md) here, though they rank higher overall. Trails [OPT-2.7B](opt-2-7b.md), [Gemma 2B (base)](gemma-2b-base.md), [Stable Code 3B](stable-code-3b.md) here, though they rank lower overall. 
test                                result  vs the others in its run  difficulty           counts  why
GSM8K (ZeroEval, zero-shot)          87.4%  ▁▄·▁▄█▅●▅███ beats 19/43  very easy · avg 87%     10%  sharp
MATH Level 5 (ZeroEval, 721 probl…   21.9%  ▁▁▁▆●▂▇▇▄··▂ beats 10/38  hard · avg 30%         8.7%  sharp · at its level
other tests (3) 
test                                          result  vs the others in its run  difficulty           counts  why
MMLU-Redux (ZeroEval, 2,778 quest…             76.4%  ▁·▁▁▄▄▄●█▄▂▁ beats 22/53  easy · avg 75%          35%  at its level
ZebraLogic (ZeroEval, 1,000 puzzl…             13.0%  ▁▁▃●██▁▁·▁▁▁ beats 18/57  hard · avg 15%         9.2%  sharp
WildBench v2 WB-Score (task macro)  45.9028 WB-Score  ▁·▁▁·▃█▄▇●▅▆ beats 36/52  avg 43.019 WB-Score    8.3%  sharp
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
WildEval ZeroEval published results             5   84% ▇▇▇▇▇▇▇▇▇▇
WildBench v2 leaderboard data                   1    8% ▇
Polyrating: A Cost-Effective and Bias-A…        1    7% ▇
prior: pull toward the middle                        0% ▇
weighted average                                   = 49.5
Licences: WildEval ZeroEval published results ([Apache-2.0](../../licenses/zeroeval-published-results-Apache-2.0.txt)) · WildBench v2 leaderboard data ([Apache-2.0](https://github.com/allenai/WildBench/blob/d6b8dcaf377d173d031980f97c16e1a82618c03d/LICENSE)) · Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation ([CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/reka-core-20240501) · [JSON](https://whatmodel.sh/api?format=json&all=1)