Apertus
GPAI Provider: Swiss AI Initiative
Metadata
Model URL: https://huggingface.co/swiss-ai/Apertus-70B-2509
When was this model published? 2025-09-02
Is this a new or a fine-tuned model? New model
When was the Public Summary last updated? 2025-09-01
When did we evaluate the Public Summary? 2026-01-12
Where did we find the Public Summary? We found this document linked on this page. An archived version can be found here.
Results of Evaluation
| Apertus | Transparency | Usefulness | General | |||||
|---|---|---|---|---|---|---|---|---|
| Clarity | Completeness | Consistency | Correctness | Accessibility | Comprehension | Transparency | Usefulness | |
| Document | 81.82 | 100.0 | 100.0 | 70.0 | 100.0 | 66.67 | 87.04 | 84.21 |
| General information | 47.62 | 82.26 | 100.0 | 100.0 | 100.0 | 90.91 | 74.62 | 93.75 |
| Public Data Sources | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 |
| Private Data Sources | N/A | 100.0 | 100.0 | 100.0 | N/A | N/A | 100.0 | N/A |
| Scraped/Crawled Data | N/A | 100.0 | N/A | 100.0 | N/A | N/A | 100.0 | N/A |
| User Data | N/A | 100.0 | N/A | 100.0 | N/A | N/A | 100.0 | N/A |
| Synthetic/Other Data | N/A | 100.0 | 100.0 | 100.0 | N/A | N/A | 100.0 | N/A |
| Data Processing | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 |
| Sum | 85.8 | 94.39 | 100.0 | 98.48 | 100.0 | 95.56 | 92.9 | 97.14 |
| A | A+ | |||||||
Evaluation Notes
The public summary for the Apertus model family can be found as a PDF on HuggingFace in the same context as its models, for instance at the repository of Apertus-70B-2509. Each field of the template was filled in, including explicitly marking sections as not applicable, though some fields included superfluous information not relevant to the topic or question which caused a few points deduction. We assessed its score to be 92.90% with Grade A for transparency, and 97.14% with Grade A+ for usefulness, which were the highest of all assessed summaries published before and during our initial research.