[whatmodel.sh](../../README.md) / U-PaLM 62B # U-PaLM 62B Google · released 2022-10 · 62.5B params · proprietary **score 42.2** ±2.1 · comparison only: no current run option verified · from 7 benchmark results across 1 source · † no independently run results verified Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at _{● marks U-PaLM 62B among every model on that task or test, worst to best.}

other tests (7)

test                                result  vs the others in its run    difficulty      counts  why
WinoGrande (maker)                   76.2%  ▁▁▁▁▂▁▁▅▇█●▁ beats 115/131  easy · avg 85%     20%  at its level
TriviaQA (maker)                     68.3%  ▁▁▂▂▄▄▃▆▅●▅▂ beats 65/80    easy · avg 80%     19%  at its level
HellaSwag (maker)                    79.7%  ▁▁▁▂▂▂▄▆█●▄▂ beats 108/135  easy · avg 87%     16%  at its level
BoolQ (maker)                        85.4%  ▁····▁▂█▆▅▆● beats 94/103   easy · avg 90%     16%  at its level
Natural Questions (closed book) (…   18.7%  ▂▁▁▁▂▄▄▃●█▅▁ beats 41/68    hard · avg 29%     16%  typical
LAMBADA (OpenAI version), last-wo…   79.7%  ▁·····▁▁▃▃█● beats 85/86    easy · avg 84%    7.0%  blunt
PIQA (maker)                         81.4%  ▁▁▁▂▂▃▅█●▃▁▁ beats 104/123  easy · avg 85%    5.4%  blunt · at its level

## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md)

source                                    results  share of the score
Transcending Scaling Laws with 0.1% Ext…        7   98% ▇▇▇▇▇▇▇▇▇▇▇▇
prior: pull toward the middle                        2% ▇
weighted average                                   = 42.2

## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/u-palm-62b) · [JSON](https://whatmodel.sh/api?format=json&all=1)