Overview of Quality Assessment Findings

Below is an overview of our quality assessment for each public summary. We scored each section of the summary based on our developed methodology, and then calculated the overall score and grade. Each summary is scored for two dimensions: Transparency (T) on how the information is provided, and Usefulness (U) for whether it is sufficient for stakeholders' needs. For convenience, all scores are reflected as a percentage (out of hundred) and the grades are expressed on a scale from A+ (highest) to F (lowest). Sections in public summaries that were not filled in because they were not applicable are marked as "N/A". Public summaries not being provided are marked using "!". The development of the framework and the evaluation steps are described on our methodology page along with a FAQ.

Section→	Grade		Overall		General Information		Public Data Sources		Private Data Sources		Scraped/Crawled Data		User Data		Synthetic & Other Data		Data Processing		Document
Model↓	T	U	T	U	T	U	T	U	T	U	T	U	T	U	T	U	T	U	T	U
Apertus	A	A+	92	97	74	93	100	100	100	N/A	100	N/A	100	N/A	100	N/A	100	100	87	84
Bria 3.2	B+	A	86	94	69	92	100	N/A	100	100	100	N/A	100	N/A	100	N/A	100	100	70	68
SmolLM3-3B	B+	B+	82	86	73	90	96	100	100	N/A	100	N/A	100	N/A	60	0	92	100	68	58
Domyn Large	B	B+	79	81	80	90	68	100	85	N/A	83	N/A	78	N/A	97	N/A	98	77	81	57
Bielik v3 11B Instruct	B+	C+	88	71	87	93	86	100	100	N/A	83	51	100	N/A	100	100	98	71	88	84
Adobe Firefly	C+	B+	70	82	71	92	72	100	16	N/A	78	100	100	N/A	89	0	100	72	74	68
Inkling	C+	C+	66	69	72	100	51	100	89	100	56	39	100	N/A	63	58	100	78	87	68
FastwebMIIA	C	C+	50	73	74	90	26	44	45	44	33	N/A	100	N/A	40	50	92	100	74	68
MAI-Image-2	C+	D+	66	45	71	78	26	44	89	100	80	39	100	N/A	65	N/A	75	26	85	68
GPT-5.5	C+	D+	62	47	67	90	27	7	34	100	73	24	74	50	92	70	90	57	87	65
Gemini 3 Pro	C	C	56	53	72	54	4	0	67	100	59	39	45	50	78	58	90	67	87	57
Grok 4.5	C	C	54	51	77	100	5	0	34	100	63	39	100	100	62	58	76	35	87	63
Muse Image	C	D+	52	49	67	90	32	44	72	100	55	24	72	100	15	0	66	48	83	63
Muse Spark	C	D+	52	48	67	90	32	44	72	100	55	24	86	100	15	0	66	48	72	47
Phi-4	D	F	33	24	70	100	3	0	53	N/A	0	N/A	0	N/A	8	0	52	0	87	81
MAI Code 1 Flash	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Devstral 2 123B Instruct 2502	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Veo 3.1	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Palmyra X5	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
C4AI Command A Plus 05 2026	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Gemma 4 31B	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
GPT Image 2	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
North Mini Code 1.0	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Claude Fable 5	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Gemini 3.6 Flash	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Mistral Large 3 675B Base 2512	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
FLUX.2	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Aya Vision 32B	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
GPT-OSS	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Apriel 1.5 15B Thinker	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Amazon Nova 2	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
GPT-5.6 Sol	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Sora 2	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
FIBO	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!

Source and Analysis

Adobe Firefly by Adobe
Based on public summary dated 2025-11-01 and evaluated on 2026-07-22. See detailed analysis.
Apertus by Swiss AI Initiative
Based on public summary dated 2025-09-01 and evaluated on 2026-03-30. See detailed analysis.
Apriel 1.5 15B Thinker by OpenAI
no public summary found
Aya Vision 32B by Cohere
no public summary found
Bielik v3 11B Instruct by SpeakLeash
Based on public summary dated 2026-01-01 and evaluated on 2026-03-30. See detailed analysis.
Bria 3.2 by Bria AI
Based on public summary dated 2026-01-06 and evaluated on 2026-03-31. See detailed analysis.
Claude Fable 5 by Anthropic
no public summary found
C4AI Command A Plus 05 2026 by Cohere
no public summary found
Devstral 2 123B Instruct 2502 by Mistral AI
no public summary found
Domyn Large by Domyn
Based on public summary dated 2026-03-19 and evaluated on 2026-07-21. See detailed analysis.
FastwebMIIA by Fastweb
Based on public summary dated 2026-03-23 and evaluated on 2026-07-22. See detailed analysis.
FIBO by Bria AI
no public summary found
FLUX.2 by Black Forest Labs
no public summary found
Gemini 3.6 Flash by Google
no public summary found
Gemini 3 Pro by Google
Based on public summary dated 2026-07-02 and evaluated on 2026-07-21. See detailed analysis.
Gemma 4 31B by Google
no public summary found
GPT-5.5 by OpenAI
Based on public summary dated 2026-06-26 and evaluated on 2026-07-09. See detailed analysis.
GPT-5.6 Sol by OpenAI
no public summary found
GPT Image 2 by OpenAI
no public summary found
GPT-OSS by OpenAI
no public summary found
Grok 4.5 by xAI
Based on public summary dated 2026-07-08 and evaluated on 2026-07-20. See detailed analysis.
Inkling by Thinking Machines
Based on public summary dated 2026-07-16 and evaluated on 2026-07-20. See detailed analysis.
MAI Code 1 Flash by Microsoft AI
no public summary found
MAI-Image-2 by Microsoft
Based on public summary dated 2026-03-19 and evaluated on 2026-07-21. See detailed analysis.
Mistral Large 3 675B Base 2512 by Mistral AI
no public summary found
Muse Image by Meta
Based on public summary dated 2026-07-06 and evaluated on 2026-07-21. See detailed analysis.
Muse Spark by Meta
Based on public summary dated 2026-07-08 and evaluated on 2026-07-21. See detailed analysis.
North Mini Code 1.0 by Cohere
no public summary found
Amazon Nova 2 by Amazon
no public summary found
Palmyra X5 by WRITER
no public summary found
Phi-4 by Microsoft
Based on public summary dated 2025-11-24 and evaluated on 2026-03-31. See detailed analysis.
SmolLM3-3B by HuggingFace
Based on public summary dated 2025-07-25 and evaluated on 2026-03-31. See detailed analysis.
Sora 2 by OpenAI
no public summary found
Veo 3.1 by Google
no public summary found