[whatmodel.sh](../../README.md) / Granite 4.1 3B
# Granite 4.1 3B
IBM · released 2026-04 · 3B params · apache-2.0
**score 50.5** ±1.0 · #360 of 732 · from 21 benchmark results across 1 source · † no independently run results verified
Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only.
## What it's good at
● marks Granite 4.1 3B among every model on that task or test, worst to best.
task vs the others rank counts tests
agent tasks ▁▁▃▆●▄▅▅▄▄▂▁ #221 of 313* 1.4% 1
coding ▁▁▁▃▅▇●▇▅▄▃▁ #287 of 469 31% 7
chat & writing ▁▁▁▃▆▄▆●▆▇▇▃ #226 of 402* 2.5% 1
math ●··········█ #3 of 3 27% 5
agent tasks · #221 of 313 · 1.4% of its score
Beats [o1 (2024-12-17)](o1-2024-12-17.md), [o3-mini](o3-mini.md), [DeepSeek R1 (Jan '25)](deepseek-r1.md) here, though they rank higher overall. Trails [SmolLM3 3B](smollm3-3b.md), [Jamba 1.5 Mini](jamba-1-5-mini.md), [Mellum2 12B-A2.5B Instruct](mellum2-12b-a2-5b-instruct.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
BFCL v3 (maker) 60.8% ▁▁▁▁▁▃▅█●▅▄▁ beats 100/171 medium · avg 60% 1.4% blunt · at its level · small run
coding · #287 of 469 · 31% of its score
Beats [Qwen3-VL 32B Instruct](qwen3-vl-32b-instruct.md), [Solar Open 100B (102B-A12B)](solar-open-100b.md), [Qwen3-VL 30B-A3B Instruct](qwen3-vl-30b-a3b-instruct.md) here, though they rank higher overall. Trails [DeepSeek LLM 67B Chat](deepseek-llm-67b-chat.md), [Yi 1.5 9B Chat](yi-1-5-9b-chat.md), [Mistral NeMo Instruct (2407)](mistral-nemo-instruct-2407.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
HumanEval (maker) 81.7% ▁▁▁▁▂▂▆▆█●▂▁ beats 180/205 easy · avg 77% 9.2% sharp · small run
HumanEval+ (maker) 76.8% ▁·▁▁▂▃▄▄█●▄▃ beats 99/145 easy · avg 73% 8.0% sharp · at its level · small run
MBPP (maker) 71.2% ▁▁▁▄▅█▆▅●▁▂▁ beats 71/86 easy · avg 74% 3.7% small run
MultiPL-E (maker) 52.5% ▃··▄·▅●▇▄█▃▄ beats 9/31 medium · avg 54% 3.2% at its level · small run
BigCodeBench (maker) 32.2% ▅····▃·█●▅█▃ beats 6/12 hard · avg 30% 2.8% at its level · small run
MBPP+ (maker) 62.2% ▁··▁▁▃▄●▆▄▁▁ beats 50/120 medium · avg 65% 2.8% at its level · small run
CRUXEval-O (maker) 40.8% ▂▂█●▅▂▁·▁·▁▁ beats 28/51 medium · avg 46% 1.7% blunt · at its level · small run
chat & writing · #226 of 402 · 2.5% of its score
Beats [Granite 4.2 8B](granite-4-2-8b.md), [Mistral Small 4 (119B-A6.5B)](mistral-small-4.md), [Olmo 3.1 32B Think](olmo-3-1-32b-think.md) here, though they rank higher overall. Trails [LFM2.5 1.2B Instruct](lfm2-5-1-2b-instruct.md), [Olmo 3 7B Instruct](olmo-3-7b-instruct.md), [Granite 4.0 H Micro 3B](granite-4-0-h-micro.md) here, though they rank lower overall.
test result vs the others in its run difficulty counts why
IFEval (aggregation unspecified) … 82.3% ▁▂▄▂▂▄●██▅▂▁ beats 61/145 easy · avg 81% 2.5% small run
math · #3 of 3 · 27% of its score
test result vs the others in its run difficulty counts why
GSM8K (maker) 86.9% ▂▂▂▂▃▄▅▇█●▆▄ beats 160/206 very easy · avg 85% 11% sharp · small run
Minerva MATH (maker) 67.9% ▁·▃▁▁▂▁█▄▁●▃ beats 23/27 easy · avg 66% 5.7% at its level · small run
DeepMind Mathematics (maker) 64.6% ▅····▅·█▃●·▅ beats 8/10 easy · avg 66% 5.0% at its level · small run
GSM-Symbolic (maker) 81.3% ▃▃····▃·▅▅●▃ beats 8/10 easy · avg 76% 2.8% small run
MGSM, 5 languages (en, es, fr, ja… 70.0% █·▄▄██···●·▄ beats 8/10 medium · avg 62% 2.1% at its level · small run
other tests (7)
test result vs the others in its run difficulty counts why
BIG-Bench Hard (maker) 75.8% ▁▁▁▁▂▄▅▆█●▃▁ beats 130/155 medium · avg 72% 8.4% sharp · at its level · small run
MMLU (maker) 67.0% ▁▁▁▁▁▂▂▅●█▆▄ beats 116/214 medium · avg 67% 6.8% at its level · small run
GPQA (subset unspecified) (maker) 31.7% ▂▁▂▂●▃▆▃▅█▃▃ beats 25/106 very hard · avg 35% 6.2% sharp · small run
MMLU-Pro (maker) 49.8% ▁▁·▁▁▁▃●▄▅█▁ beats 49/188 medium · avg 49% 4.8% at its level · small run
INCLUDE (maker) 52.0% ▂····▂▂●▄▄█▄ beats 8/36 medium · avg 54% 4.0% at its level · small run
MMMLU (maker) 57.6% ▂▁▁▂▃▂●▄▅██▃ beats 14/46 medium · avg 60% 3.7% at its level · small run
SimpleQA (maker) 3.7% ▄●▄▆█▆███·▂█ beats 2/32 very hard · avg 4.2% 3.6% too hard for it · small run
source results share of the score
ibm-granite/granite-4.1-8b model card (… 21 100% ▇▇▇▇▇▇▇▇▇▇▇▇
prior: pull toward the middle 0% ▇
weighted average = 50.5
Licences: ibm-granite/granite-4.1-8b model card ([Apache-2.0](../../licenses/ibm-granite--granite-4.1-8b.txt))
## How to run it
### Ollama (recommended)
1. Install Ollama. [Download it (macOS / Windows)](https://ollama.com/download)
```sh
# Linux
curl -fsSL https://ollama.com/install.sh | sh
```
2. Run Granite 4.1 3B (Q4_K_M, needs ~2.1 GB, from [ollama.com](https://ollama.com/library/granite4.1/tags))
```sh
ollama run granite4.1:3b
```
## Published speed measurements
Reference results for the hardware, engine and settings below. These are not verified speeds of the downloads above or predictions for your machine.
hardware precision speed engine and settings
Apple M5 Max (40-core GPU),… q4_k_m 130.75 tok/s ollama (version not recorded) · l…
Each speed links to its source, which has the full settings.
[interactive version](https://whatmodel.sh/model/granite-4-1-3b) · [JSON](https://whatmodel.sh/api?format=json&all=1)