[whatmodel.sh](../../README.md) / RedPajama-INCITE 7B Base
# RedPajama-INCITE 7B Base
Together · released 2023-06 · 6.9B params · apache-2.0
**score 27.6** ±0.9 · #679 of 732 · from 21 benchmark results across 4 sources
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks RedPajama-INCITE 7B Base among every model on that task or test, worst to best.
other tests (13)
test result vs the others in its run difficulty counts why
ARC Challenge 39.4% ▁·▁··▁▁▇▂●▆▃ beats 12/26 easy · avg 82% 38% sharp · several runs
WinoGrande 64.3% ▁····▁··▁▂●▄ beats 10/26 easy · avg 86% 13% at its level · several runs
HellaSwag 70.3% ▃···▁▇▅●▇▃▁▁ beats 13/26 very easy · avg 91% 8.9% at its level · several runs
BoolQ 70.8% ▂▃▂▅▆▂●▆█▂▂▂ beats 14/26 easy · avg 88% 8.7% at its level · several runs
ARC Easy 69.2% ▁▁·▁▁▄▅▄●▅▁▃ beats 17/26 easy · avg 85% 7.0% blunt · at its level · several runs
OpenBookQA 29.0% █·▁▁▃·▁●▅▇▃▄ beats 11/26 easy · avg 81% 6.9% at its level · several runs
SciQ 92.7% ▁·▁·▁·▃▅●█▄▁ beats 13/26 very easy · avg 97% 6.5% blunt · several runs
PIQA 77.1% ▁·▁··▁▁▃█●█▂ beats 15/26 easy · avg 87% 4.8% blunt · at its level · several runs
LAMBADA (OpenAI version), last-wo… 71.3% ▁··▂▁▁▁▂▆●▅▃ beats 19/26 very easy · avg 86% 1.9% blunt · at its level
Social IQA 42.6% ▁···▁▃●▁▁▁·▁ beats 17/26 hard · avg 56% 1.6% blunt
Open PT-LLM Leaderboard average (… 33.0% ●▁▁▁▁▁▁▁▂█▅▁ beats 4/276 medium · avg 72% 1.1% noisy
This is not a Dataset (negation),… 50.3% ●▁····▃▁·▁·▁ beats 5/14 hard · avg 66% 0.5% sharp · too hard for it · noisy
TruthfulQA MC2 33.0% ●·█·█▄···▄·█ beats 0/9 medium · avg 55% 0.3% blunt · at its level
source results share of the score
Stability AI 11 66% ▇▇▇▇▇▇▇▇
OLMo: Accelerating the Science of Langu… 8 32% ▇▇▇▇
Open Portuguese LLM Leaderboard 1 1% ▇
This is not a Dataset: A Large Negation… 1 0% ▇
prior: pull toward the middle 0% ▇
weighted average = 27.6
Licences: Stability AI ([Apache-2.0](../../licenses/stablelm-original-eval-json-Apache-2.0.txt)) · OLMo: Accelerating the Science of Language Models ([CC BY 4.0](../../licenses/paper-2402.00838v4-CC-BY-4.0.txt)) · Open Portuguese LLM Leaderboard ([Apache-2.0](../../licenses/hf-leaderboard-spaces-Apache-2.0.txt)) · This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models ([CC BY 4.0](../../licenses/acl-2023-emnlp-main-531-CC-BY-4-0.txt))
## How to run it
### Other ways to run it
1. Run it as published (fp16, needs ~13.85 GB, from [huggingface.co/togethercomputer](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/78f7e482443971f4873ba3239f0ac810a367833b))
```sh
uv run --with torch --with 'transformers<5' --with accelerate python -c "from transformers import pipeline; print(pipeline('text-generation', model='togethercomputer/RedPajama-INCITE-7B-Base', torch_dtype='auto', device_map='auto')('Once upon a time', max_new_tokens=40)[0]['generated_text'])"
```
Model repository and documentation: [huggingface.co/togethercomputer](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base)
[interactive version](https://whatmodel.sh/model/redpajama-incite-7b-base) · [JSON](https://whatmodel.sh/api?format=json&all=1)