SmolLM3-3B

GPAI Provider:

Metadata

When was this model published? 2025-07-08
Is this a new or a fine-tuned? Fine-tuned model
When was the Public Summary last updated? 2025-07-25
When did we evaluate the Public Summary? 2026-01-12

Results of Evaluation

SmolLM3-3B	Transparency				Usefulness		General
	Clarity	Completeness	Consistency	Correctness	Accessibility	Comprehension	*Transparency*	*Usefulness*
Document	68.18	100.0	68.75	50.0	65.38	50.0	68.97	58.0
General information	52.5	83.08	100.0	73.91	N/A	90.91	73.53	90.91
Public Data Sources	84.62	100.0	100.0	100.0	100.0	100.0	96.06	100.0
Private Data Sources	N/A	100.0	100.0	100.0	N/A	N/A	100.0	N/A
Scraped/Crawled Data	N/A	100.0	N/A	100.0	N/A	N/A	100.0	N/A
User Data	N/A	100.0	N/A	100.0	N/A	N/A	100.0	N/A
Synthetic/Other Data	67.57	61.29	100.0	41.94	N/A	0.0	60.0	0.0
Data Processing	100.0	83.33	100.0	91.67	100.0	100.0	92.0	100.0
Sum	73.1	89.12	95.1	76.74	90.62	84.17	82.5	86.01
							B+	B+

Evaluation Notes

The public summary for HuggingFace's SmolLM3-3B model is available on its platform as a <a href="https://huggingface.co/spaces/hfmlsoc/smollm3-eu-data-transparency" target="_blank">webpage</a>. In general, the structure of the template was preserved with clear indication of section numbers, consistent field labels, and explicitly indicating yes/no where applicable. Other than issues with accessibility, we found no major issues with the public summary. It scored 82.58% and received a grade of B+ for Transparency, and 86.01% with grade B+ for Usefulness, which meant that the summary was of a moderate but good quality. SmolLM scored particularly well on its disclosure of public data sources, a key disclosure demanded by Article 53(1)(d), and a good indicator of transparency in model development process.