[whatmodel.sh](../../README.md) / Granite 3.1 3B-A800M Instruct # Granite 3.1 3B-A800M Instruct IBM · released 2024-12 · 3.3B params (0.8B active) · apache-2.0 **score 36.8** ±1.6 · #611 of 732 · from 6 benchmark results across 1 source · † no independently run results verified Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Granite 3.1 3B-A800M Instruct among every model on that task or test, worst to best. 
task            vs the others          rank  counts  tests
chat & writing  ▁▁▁▃●▄▆█▆▇▇▃   #323 of 402*    7.8%      1
math            ▁▁▃●█▆▄█▄▂▁▁   #363 of 431*     35%      1
chat & writing · #323 of 402 · 7.8% of its score Beats [Gemma 4 E4B](gemma-4-e4b.md), [OpenThinker3 7B](openthinker3-7b.md), [Code Llama 70B Instruct](codellama-70b-instruct.md) here, though they rank higher overall. Trails [LFM2 350M](lfm2-350m.md), [Gemma 3 1B](gemma-3-1b.md), [Qwen3 0.6B](qwen3-0-6b.md) here, though they rank lower overall. 
test                                result  vs the others in its run   difficulty      counts  why
IFEval (aggregation unspecified) …   55.2%  ▁▂●▂▂▄▆██▅▂▁ beats 19/145  easy · avg 77%    7.8%  at its level
math · #363 of 431 · 35% of its score Beats [GPT-3.5 Turbo (0125)](gpt-3-5-turbo-0125.md), [DBRX Instruct](dbrx-instruct.md), [Command R Plus (04-2024)](command-r-plus-04-2024.md) here, though they rank higher overall. Trails [OPT-2.7B](opt-2-7b.md), [Gemma 2B (base)](gemma-2b-base.md), [Stable Code 3B](stable-code-3b.md) here, though they rank lower overall. 
test           result  vs the others in its run   difficulty      counts  why
GSM8K (maker)   49.0%  ▂▂▂▂▃▄▅●██▆▄ beats 86/206  easy · avg 85%     35%  sharp · at its level
other tests (4) 
test                   result  vs the others in its run   difficulty        counts  why
ARC Challenge (maker)   50.4%  ▄▁▁▂▁▄█●▃▂▃▂ beats 87/140  easy · avg 77%       24%  sharp · at its level
WinoGrande (maker)      64.9%  ▁▁▁▁▂▁▁▅●█▃▁ beats 58/131  medium · avg 80%     12%  at its level
MMLU (maker)            52.2%  ▁▁▁▁▁▂▂●██▆▄ beats 57/214  medium · avg 74%     10%  at its level
HellaSwag (maker)       73.0%  ▁▁▁▂▂▂▄▆●▇▄▂ beats 83/135  easy · avg 87%       10%  at its level
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
ibm-granite/granite-3.1-3b-a800m-instru…        6   99% ▇▇▇▇▇▇▇▇▇▇▇▇
prior: pull toward the middle                        1% ▇
weighted average                                   = 36.8
Licences: ibm-granite/granite-3.1-3b-a800m-instruct model card ([Apache-2.0](https://huggingface.co/ibm-granite/granite-3.1-3b-a800m-instruct/blob/a02780686e08a03fe0d2679a293b5c74a90efa89/README.md)) ## How to run it ### llama.cpp (recommended) 1. Install llama.cpp. Homebrew and winget installs name the commands llama-cli and llama-server instead. [Other ways to install](https://github.com/ggml-org/llama.cpp/blob/master/docs/install.md) ```sh # macOS / Linux curl -LsSf https://llama.app/install.sh | sh # Windows irm https://llama.app/install.ps1 | iex ``` 2. Run Granite 3.1 3B-A800M Instruct (Q4_K_M, needs ~2 GB, from [huggingface.co/lmstudio-community](https://huggingface.co/lmstudio-community/granite-3.1-3b-a800m-instruct-GGUF/tree/27b95c71f540e164d543c68af5dec28fb0ee2bde)) ```sh llama cli -hf lmstudio-community/granite-3.1-3b-a800m-instruct-GGUF:Q4_K_M ``` 3. Or start a local server and open the address it prints (http://localhost:9931) ```sh llama serve -hf lmstudio-community/granite-3.1-3b-a800m-instruct-GGUF:Q4_K_M ``` Other versions: Q8_0 (~3.5 GB) `llama cli -hf lmstudio-community/granite-3.1-3b-a800m-instruct-GGUF:Q8_0` ### LM Studio 1. Install LM Studio. Open the app once before using the lms command. [Download it (macOS / Windows / Linux)](https://lmstudio.ai/download) 2. Run Granite 3.1 3B-A800M Instruct (Q4_K_M, needs ~2 GB, from [huggingface.co/lmstudio-community](https://huggingface.co/lmstudio-community/granite-3.1-3b-a800m-instruct-GGUF/tree/27b95c71f540e164d543c68af5dec28fb0ee2bde)) ```sh lms get https://huggingface.co/lmstudio-community/granite-3.1-3b-a800m-instruct-GGUF@Q4_K_M -y ``` 3. Then run lms ls to see its name, and lms chat followed by that name Other versions: Q8_0 (~3.5 GB) `lms get https://huggingface.co/lmstudio-community/granite-3.1-3b-a800m-instruct-GGUF@Q8_0 -y` ### Ollama 1. Install Ollama. [Download it (macOS / Windows)](https://ollama.com/download) ```sh # Linux curl -fsSL https://ollama.com/install.sh | sh ``` 2. Run Granite 3.1 3B-A800M Instruct (Q4_K_M, needs ~2 GB, from [ollama.com](https://ollama.com/library/granite3.1-moe/tags)) ```sh ollama run granite3.1-moe:3b ``` Model repository and documentation: [huggingface.co/ibm-granite](https://huggingface.co/ibm-granite/granite-3.1-3b-a800m-instruct) ## Published speed measurements Reference results for the hardware, engine and settings below. These are not verified speeds of the downloads above or predictions for your machine. 
hardware                      precision        speed  engine and settings
Intel CoffeeLake-S GT2 [UHD…  q4_k_m     23.01 tok/s  ollama (version not recorded) · l…
Each speed links to its source, which has the full settings. [interactive version](https://whatmodel.sh/model/granite-3-1-3b-a800m) · [JSON](https://whatmodel.sh/api?format=json&all=1)