[whatmodel.sh](../../README.md) / T0 3B # T0 3B BigScience · released 2021-10 · 3B params · apache-2.0 **score 23.2** ±3.9 · comparison only: no current run option verified · from 3 benchmark results across 2 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks T0 3B among every model on that task or test, worst to best.
other tests (3) 
test                                result  vs the others in its run  difficulty        counts  why
WebQSP closed-book zero-shot (ans…   21.4%  █●···██····█ beats 1/4    easy · avg 66%       50%  at its level
BIG-Bench Hard, 27 subsets, zero-…   27.5%  ●····█··█··█ beats 0/3    medium · avg 56%     26%  blunt
Mintaka (English) closed-book zer…   14.8%  ●····▄···▄·█ beats 0/4    medium · avg 48%     18%  blunt
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
Knowledge-Augmented Language Model Prom…        2   68% ▇▇▇▇▇▇▇▇
The CoT Collection: Improving Zero-shot…        1   26% ▇▇▇
prior: pull toward the middle                        7% ▇
weighted average                                   = 23.2
Licences: Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering ([CC BY 4.0](../../licenses/acl-2023-nlrse-1-7-CC-BY-4-0.txt)) · The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-782-CC-BY-4-0.txt)) ## How to run it No verified API or local download yet. Model repository and documentation: [huggingface.co/bigscience](https://huggingface.co/bigscience/T0_3B) [interactive version](https://whatmodel.sh/model/t0-3b) · [JSON](https://whatmodel.sh/api?format=json&all=1)