Overview of Quality Assessment Findings

Below is an overview of our quality assessment for each public summary. We scored each section of the summary based on our developed methodology, and then calculated the overall score and grade. Each summary is scored for two dimensions: Transparency (T) on how the information is provided, and Usefulness (U) for whether it is sufficient for stakeholders' needs. For convenience, all scores are reflected as a percentage (out of hundred) and the grades are expressed on a scale from A+ (highest) to F (lowest). Sections in public summaries that were not filled in because they were not applicable are marked as "N/A". Public summaries not being provided are marked using "!". The development of the framework and the evaluation steps are described on our methodology page along with a FAQ.

Section→ Grade Overall General Information Public Data Sources Private Data Sources Scraped/Crawled Data User Data Synthetic & Other Data Data Processing Document
Model↓ T U T U T U T U T U T U T U T U T U T U
Apertus A   A+ 92 97 74 93 100 100 100 N/A 100 N/A 100 N/A 100 N/A 100 100 87 84
Bria 3.2 B+ A   86 94 69 92 100 N/A 100 100 100 N/A 100 N/A 100 N/A 100 100 70 68
SmolLM3-3B B+ B+ 82 86 73 90 96 100 100 N/A 100 N/A 100 N/A 60 0 92 100 68 58
Bielik v3 11B Instruct B+ C+ 88 71 87 93 86 100 100 N/A 83 51 100 N/A 100 100 98 71 88 84
Inkling C+ C+ 66 69 72 100 51 100 89 100 56 39 100 N/A 63 58 100 78 87 68
GPT-5.5 C+ D+ 62 47 67 90 27 7 34 100 73 24 74 50 92 70 90 57 87 65
Grok 4.5 C   C   54 51 77 100 5 0 34 100 63 39 100 100 62 58 76 35 87 63
Phi-4 D   F   33 24 70 100 3 0 53 N/A 0 N/A 0 N/A 8 0 52 0 87 81
Claude Fable 5 !!!!!!!!!!!!!!!!!!!!
GPT-OSS !!!!!!!!!!!!!!!!!!!!
GPT-5.6 Sol !!!!!!!!!!!!!!!!!!!!
Sora 2 !!!!!!!!!!!!!!!!!!!!
Gemini 2.5 Flash Image !!!!!!!!!!!!!!!!!!!!

Source and Analysis