Overview of Quality Assessment Findings

Below is an overview of our quality assessment for each public summary. We scored each section of the summary based on our developed methodology, and then calculated the overall score and grade. Each summary is scored for two dimensions: Transparency (T) on how the information is provided, and Usefulness (U) for whether it is sufficient for stakeholders' needs. For convenience, all scores are reflected as a percentage (out of hundred) and the grades are expressed on a scale from A+ (highest) to F (lowest). Sections in public summaries that were not filled in because they were not applicable are marked as "N/A". Public summaries not being provided are marked using "!". The development of the framework and the evaluation steps are described on our methodology page along with a FAQ.

Section→	Grade		Overall		General Information		Public Data Sources		Private Data Sources		Scraped/Crawled Data		User Data		Synthetic & Other Data		Data Processing		Document
Model↓	T	U	T	U	T	U	T	U	T	U	T	U	T	U	T	U	T	U	T	U
Apertus	A	A+	92	97	74	93	100	100	100	N/A	100	N/A	100	N/A	100	N/A	100	100	87	84
Bria 3.2	B+	A	86	94	69	92	100	N/A	100	100	100	N/A	100	N/A	100	N/A	100	100	70	68
SmolLM3-3B	B+	B+	82	86	73	90	96	100	100	N/A	100	N/A	100	N/A	60	0	92	100	68	58
Domyn Large	B	B+	79	81	80	90	68	100	85	N/A	83	N/A	78	N/A	97	N/A	98	77	81	57
Bielik v3 11B Instruct	B+	C+	88	71	87	93	86	100	100	N/A	83	51	100	N/A	100	100	98	71	88	84
Adobe Firefly	C+	B+	70	82	71	92	72	100	16	N/A	78	100	100	N/A	89	0	100	72	74	68
Inkling	C+	C+	66	69	72	100	51	100	89	100	56	39	100	N/A	63	58	100	78	87	68
FastwebMIIA	C	C+	50	73	74	90	26	44	45	44	33	N/A	100	N/A	40	50	92	100	74	68
MAI-Image-2	C+	D+	66	45	71	78	26	44	89	100	80	39	100	N/A	65	N/A	75	26	85	68
GPT-5.5	C+	D+	62	47	67	90	27	7	34	100	73	24	74	50	92	70	90	57	87	65
Gemini 3 Pro	C	C	56	53	72	54	4	0	67	100	59	39	45	50	78	58	90	67	87	57
Grok 4.5	C	C	54	51	77	100	5	0	34	100	63	39	100	100	62	58	76	35	87	63
Muse Image	C	D+	52	49	67	90	32	44	72	100	55	24	72	100	15	0	66	48	83	63
Muse Spark	C	D+	52	48	67	90	32	44	72	100	55	24	86	100	15	0	66	48	72	47
Phi-4	D	F	33	24	70	100	3	0	53	N/A	0	N/A	0	N/A	8	0	52	0	87	81
GPT-OSS	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
GPT-5.6 Sol	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Sora 2	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!
Claude Fable 5	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!	!

Source and Analysis

Adobe Firefly by Adobe
Based on public summary dated 2025-11-01 and evaluated on 2026-07-22. See detailed analysis.
Apertus by Swiss AI Initiative
Based on public summary dated 2025-09-01 and evaluated on 2026-03-30. See detailed analysis.
Bielik v3 11B Instruct by SpeakLeash
Based on public summary dated 2026-01-01 and evaluated on 2026-03-30. See detailed analysis.
Bria 3.2 by Bria AI
Based on public summary dated 2026-01-06 and evaluated on 2026-03-31. See detailed analysis.
Claude Fable 5 by Anthropic
no public summary found
Domyn Large by Domyn
Based on public summary dated 2026-03-19 and evaluated on 2026-07-21. See detailed analysis.
FastwebMIIA by Fastweb
Based on public summary dated 2026-03-23 and evaluated on 2026-07-22. See detailed analysis.
Gemini 3 Pro by Google
Based on public summary dated 2026-07-02 and evaluated on 2026-07-21. See detailed analysis.
GPT-5.5 by OpenAI
Based on public summary dated 2026-06-26 and evaluated on 2026-07-09. See detailed analysis.
GPT-5.6 Sol by OpenAI
no public summary found
GPT-OSS by OpenAI
no public summary found
Grok 4.5 by xAI
Based on public summary dated 2026-07-08 and evaluated on 2026-07-20. See detailed analysis.
Inkling by Thinking Machines
Based on public summary dated 2026-07-16 and evaluated on 2026-07-20. See detailed analysis.
MAI-Image-2 by Microsoft
Based on public summary dated 2026-03-19 and evaluated on 2026-07-21. See detailed analysis.
Muse Image by Meta
Based on public summary dated 2026-07-06 and evaluated on 2026-07-21. See detailed analysis.
Muse Spark by Meta
Based on public summary dated 2026-07-08 and evaluated on 2026-07-21. See detailed analysis.
Phi-4 by Microsoft
Based on public summary dated 2025-11-24 and evaluated on 2026-03-31. See detailed analysis.
SmolLM3-3B by HuggingFace
Based on public summary dated 2025-07-25 and evaluated on 2026-03-31. See detailed analysis.
Sora 2 by OpenAI
no public summary found