[whatmodel.sh](../../README.md) / Minerva 8B # Minerva 8B Google · released 2022-06 · 8.63B params · proprietary **score 34.9** ±2.1 · comparison only: no current run option verified · from 4 benchmark results across 1 source · † no independently run results verified Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Minerva 8B among every model on that task or test, worst to best. 
task  vs the others          rank  counts  tests
math  ▁▁▃●██▅█▃▁▁▁   #425 of 530*     67%      2
math · #425 of 530 · 67% of its score Beats [GPT-3.5 Turbo (0125)](gpt-3-5-turbo-0125.md), [DBRX Instruct](dbrx-instruct.md), [Phi-3 Medium 128K Instruct](phi-3-medium-128k-instruct.md) here, though they rank higher overall. Trails [OPT-2.7B](opt-2-7b.md), [Gemma 2B (base)](gemma-2b-base.md), [Stable Code 3B](stable-code-3b.md) here, though they rank lower overall. 
test                  result  vs the others in its run  difficulty      counts  why
GSM8K (maker)          16.2%  ▃····●··▃··█ beats 1/5    easy · avg 66%     58%  sharp
Minerva MATH (maker)   14.1%  ▄··▄··▄·●··█ beats 3/5    hard · avg 33%    8.6%  typical
other tests (2) 
test                                result  vs the others in its run  difficulty        counts  why
MMLU-STEM (Minerva subset) (maker)   35.6%  ▄······●▄·▄█ beats 1/5    medium · avg 62%     22%  sharp
OCWCourses (Minerva) (maker)          7.7%  ▄·····▄●··▄▄ beats 3/5    hard · avg 15%      8.4%  too hard for it
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
Solving Quantitative Reasoning Problems…        4   98% ▇▇▇▇▇▇▇▇▇▇▇▇
prior: pull toward the middle                        2% ▇
weighted average                                   = 34.9
Licences: Solving Quantitative Reasoning Problems with Language Models ([CC BY 4.0](../../licenses/paper-2206.14858v2-CC-BY-4-0.txt)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/minerva-8b) · [JSON](https://whatmodel.sh/api?format=json&all=1)