Overview of Quality Assessment Findings

Below is an overview of our quality assessment for each public summary. We scored each section of the summary based on our developed methodology, and then calculated the overall score and grade. Each summary is scored for two dimensions: Transparency (T) on how the information is provided, and Usefulness (U) for whether it is sufficient for stakeholders' needs. For convenience, all scores are reflected as a percentage (out of hundred) and the grades are expressed on a scale from A+ (highest) to F (lowest). Public summaries that were missing are marked as "N/A".

↓Section Grade Overall General Information Public Data Sources Private Data Sources Scraped/Crawled Data User Data Synthetic & Other Data Data Processing Document
Dimension→ T U T U T U T U T U T U T U T U T U T U
Apertus A A+ 92 97 87 84 74 93 100 100 100 N/A 100 N/A 100 N/A 100 N/A 100 100
Bria 3.2 B+ A 86 94 70 68 69 92 100 N/A 100 100 100 N/A 100 N/A 100 N/A 100 100
SmolLM3-3B B+ B+ 82 86 68 58 73 90 96 100 100 N/A 100 N/A 100 N/A 60 0 92 100
Bielik v3 11B Instruct B+ C+ 88 71 88 84 87 93 86 100 100 N/A 83 51 100 N/A 100 100 98 71
Phi-4 D F 33 24 87 81 70 100 3 0 53 N/A 0 N/A 0 N/A 8 0 52 0
Claude Sonnet 4.5 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Gemini 2.5 Flash Image N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
GPT-5 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
GPT-OSS N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Sora 2 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A