Overview of Quality Assessment Findings

This page provides an overview of our assessment of 61 public summaries. Each summary is scored for two dimensions: Transparency (T) on how the information is provided, and Usefulness (U) for whether it is sufficient for stakeholders' needs. For convenience, all scores are reflected as a percentage (out of hundred) and the grades are expressed on a scale from A+ (highest) to F (lowest). Sections in public summaries that were not filled in because they were not applicable are marked as "N/A". You can click on the model name for a detailed description of the scores and our notes. The evaluation steps are described on our methodology page along with a FAQ.

Note that this page does not display models whose summaries we are currently evaluating nor models for which a public summary is currently missing.

Section→ Grade Overall General Information Public Data Sources Private Data Sources Scraped/Crawled Data User Data Synthetic & Other Data Data Processing Document
Model↓ T U T U T U T U T U T U T U T U T U T U
Baguettotron and Monad A+ A+ 97 98 92 100 100 100 100 N/A 100 N/A 100 N/A 100 100 100 100 85 85
Pleias 1.0 A   A+ 94 98 100 93 100 100 100 N/A 88 100 100 N/A 100 100 100 100 85 79
Apertus A   A+ 92 97 74 93 100 100 100 N/A 100 N/A 100 N/A 100 N/A 100 100 87 84
Luciole Base A   A+ 90 96 95 93 85 100 100 N/A 100 N/A 100 N/A 82 N/A 100 100 88 76
FIBO B+ A+ 86 97 94 100 100 N/A 63 100 100 N/A 100 N/A 100 N/A 100 100 92 78
Luciole Instruct 1.1 A   A   90 90 82 93 92 100 100 N/A 100 N/A 100 N/A 89 0 100 100 88 85
Bria 3.2 B+ A   86 94 69 92 100 N/A 97 100 100 N/A 100 N/A 100 N/A 100 100 70 68
SmolLM3-3B B+ B+ 82 86 73 90 96 100 100 N/A 100 N/A 100 N/A 60 0 92 100 68 58
Domyn Large B+ B+ 83 81 80 90 76 100 85 N/A 83 N/A 78 N/A 97 N/A 98 77 81 57
Bielik v3 11B Instruct B+ C+ 89 71 87 93 92 100 100 N/A 83 51 100 N/A 100 100 98 71 88 84
PLLuM-12B-base-2512 B+ C+ 86 68 89 100 94 100 100 N/A 75 51 100 N/A 100 100 100 57 85 94
Adobe Firefly C+ B+ 71 82 71 92 81 100 16 N/A 78 100 100 N/A 89 0 100 72 74 68
Nemotron 3 and 3.5 Family C+ C+ 74 73 82 94 69 100 66 44 65 100 100 N/A 96 41 100 57 57 78
Inkling C+ C+ 67 70 72 100 54 100 89 100 56 39 100 N/A 63 58 100 78 87 81
Inkling Small C+ C+ 67 69 72 100 54 100 89 100 56 39 100 N/A 67 58 100 78 87 68
FLUX.3 B   C   76 59 66 100 100 100 61 100 100 N/A 45 75 89 50 75 21 92 78
Nova 2 Lite C+ C+ 71 62 82 100 51 44 78 100 76 39 45 50 78 58 80 78 88 84
Nemotron Nano 12B v2 C+ C+ 61 69 73 94 66 100 46 44 52 39 100 N/A 57 0 100 100 57 78
FastwebMIIA C   C+ 53 73 74 90 32 44 45 44 33 N/A 100 N/A 40 50 92 100 74 68
MAI Cyber 1 Flash C+ C   69 50 79 78 58 44 23 100 80 39 100 100 79 0 75 26 85 81
MAI Code 1.1 Flash C+ C   69 50 79 78 54 44 23 100 80 39 100 100 100 0 75 26 85 81
Minimax M3 C+ D+ 70 48 64 100 52 41 50 100 74 39 74 0 92 100 98 35 87 81
MAI Code 1 Flash C+ C   68 50 79 78 54 44 23 100 80 39 100 100 79 0 75 26 85 81
MAI-Image-2.5 C+ D+ 71 46 71 78 35 44 89 100 80 39 100 N/A 65 N/A 75 26 85 81
Ministral 3 14B C   C   57 58 73 90 48 44 66 100 40 39 72 50 57 0 100 78 85 81
Ministral 3 8B C   C   57 58 73 90 48 44 66 100 40 39 72 50 57 0 100 78 85 81
Ministral 3 3B C   C   57 58 73 90 48 44 66 100 40 39 72 50 57 0 100 78 85 81
MAI-Image-2 C+ D+ 70 46 71 78 29 44 89 100 80 39 100 N/A 65 N/A 75 26 85 81
Apertus v1.5 C   C+ 54 60 75 93 100 100 100 N/A 2 0 100 N/A 100 N/A 100 100 87 84
GPT-5.6 Luna C+ D+ 67 47 67 90 51 7 34 100 73 24 74 50 92 70 90 57 87 65
GPT-5.5 C+ D+ 67 47 67 90 50 7 34 100 73 24 74 50 92 70 90 57 87 65
GPT-6 Astra C+ D+ 67 47 67 90 51 7 34 100 73 24 74 50 89 70 90 57 87 65
GPT-5.2 C+ D+ 67 47 67 90 51 7 34 100 73 24 74 50 89 70 90 57 87 65
Grok Voice Think Fast C+ D+ 64 49 76 92 64 48 37 44 64 51 100 N/A 64 58 100 35 87 63
Hy3 C+ C   61 52 50 92 50 44 89 100 57 39 100 N/A 47 0 100 57 83 63
GPT Images 2.0 C+ D+ 70 42 67 90 51 7 92 N/A 73 24 74 50 85 58 90 57 87 65
GPT-5.4 Nano C+ D+ 65 47 67 90 51 7 34 100 73 24 74 50 78 70 90 57 87 65
Gemma 4 C   C   59 53 72 54 6 0 67 100 59 39 45 50 78 58 90 67 88 65
Gemini 3 Pro C   C   59 53 72 54 6 0 67 100 59 39 45 50 78 58 90 67 87 65
Mistral Small 4 C   C   54 58 71 90 47 44 66 100 40 39 72 50 26 0 100 78 85 81
Mistral Large 3 C   C   54 58 71 90 47 44 66 100 40 39 72 50 26 0 100 78 85 81
Grok 4.5 C   C   57 51 77 100 7 0 34 100 62 39 100 100 62 58 76 35 87 63
Mythos 5.1 / Fable 5.1 C   D+ 57 49 67 93 41 44 34 100 66 24 45 50 56 41 90 57 85 76
Command A+ C   C   55 51 75 78 41 44 66 100 37 24 61 50 67 58 90 57 85 84
Claude Opus 5 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Opus 4.8 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Mythos 5 / Claude Fable 5 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Mythos Preview C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Sonnet 5 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Opus 4.7 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Muse Image C   D+ 53 49 67 90 32 44 72 100 55 24 72 100 15 0 66 48 83 63
Muse Glimmer C   D+ 53 49 67 90 32 44 72 100 55 24 86 100 15 0 66 48 72 55
Muse Spark C   D+ 53 48 67 90 32 44 72 100 55 24 86 100 15 0 66 48 72 47
Phi 4 Reasoning Vision 15B C+ D   61 35 78 78 42 44 100 N/A 100 N/A 100 N/A 100 100 10 0 75 81
Seed 2.0 Pro C   D+ 53 42 65 68 18 0 56 100 68 39 33 0 56 41 76 57 85 71
Seedance 2.5 C   D   50 39 65 68 18 0 56 100 61 24 100 N/A 36 0 76 57 85 71
Seedance 2.0 D+ D   49 39 65 68 18 0 56 100 57 24 100 N/A 36 0 76 57 85 71
Seedream 5.0 Pro D+ D   49 37 54 42 18 0 56 100 61 24 100 N/A 36 0 76 57 85 71
Midjourney Image and Video family of models D   D+ 36 45 71 64 9 44 23 100 32 24 100 N/A 19 0 100 57 66 79
DeepSeek-V4 D+ D+ 40 41 61 42 50 44 45 100 0 0 100 N/A 56 58 100 57 83 76
Phi-4 D   F   33 24 70 100 3 0 53 N/A 0 N/A 0 N/A 8 0 52 0 87 81