[whatmodel.sh](../../README.md) / CogVLM2 Llama3 Chinese Chat 19B # CogVLM2 Llama3 Chinese Chat 19B Zhipu AI (THUDM) · released 2024-05 · 19.5B params · cogvlm2 **score 47.3** ±6.5 · comparison only: no current run option verified · from 3 benchmark results across 1 source · † no independently run results verified Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at _{● marks CogVLM2 Llama3 Chinese Chat 19B among every model on that task or test, worst to best.}

task                vs the others         rank  counts  tests
vision & documents  ▁▁▂▃●▃▅▄▆██▄   #153 of 189     81%      3

vision & documents · #153 of 189 · 81% of its score

Beats [DeepSeek V4 Flash Vision (Exp)](deepseek-v4-flash-vision-exp.md), [Gemma 3 12B](gemma-3-12b.md), [Llama 3.2 90B Vision Instruct](llama-3-2-90b-vision.md) here, though they rank higher overall. Trails [Qwen3.5 2B](qwen3-5-2b.md) here, though they rank lower overall.

test              result  vs the others in its run  difficulty      counts  why
ChartQA (maker)    74.7%  ▁··▁▁▁▁▁●▅▅█ beats 8/44   easy · avg 80%     36%  blunt · small run
OCRBench (maker)   78.0%  ▁·▃▁●▅▂█▅█▁▃ beats 5/37   easy · avg 82%     28%  blunt · small run
TextVQA (maker)    85.0%  ▁▁▁▄▅▁▃·▃▃▃● beats 22/24  easy · avg 78%     16%  blunt · small run

## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md)

source                                 results  share of the score
Zhipu AI (submitted / maker-reported)        3   81% ▇▇▇▇▇▇▇▇▇▇
prior: pull toward the middle                    19% ▇▇
weighted average                                = 47.3

## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/cogvlm2-llama3-chinese-chat-19b) · [JSON](https://whatmodel.sh/api?format=json&all=1)