[whatmodel.sh](../../README.md) / GPT-4o mini Audio Preview (2024-12-17) # GPT-4o mini Audio Preview (2024-12-17) OpenAI · released 2024-12 · proprietary **score 48.6** ±2.4 · comparison only: no current run option verified · from 10 benchmark results across 1 source Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks GPT-4o mini Audio Preview (2024-12-17) among every model on that task or test, worst to best.
other tests (10) 
test                                result  vs the others in its run  difficulty           counts  why
AHELM Speech Robust Bench (LibriS…   47.1%  ▂·●··▆▄·▂▂·▄ beats 2/13   avg 34%                 43%  typical
AHELM CoRe-Bench conversational a…   51.4%  ▂·▄··●▂·▄▂█▄ beats 3/13   medium · avg 52%        22%  at its level
AHELM LibriSpeech transcription b…   16.3%  ▃···●·█▃▅▃▅█ beats 1/13   avg 11%                 11%  typical
AHELM MUStARD audio sarcasm detec…   62.3%  ▂·······▆█▆● beats 11/13  very hard · avg 57%    6.2%  blunt
AHELM VoxCeleb2 same-speaker dete…   50.9%  ▂·●·▂█▂▄▄··▄ beats 1/13   very hard · avg 54%    5.2%  sharp · too hard for it · noisy
AHELM AIR-Bench Foundation music …   54.1%  ▃█●▅▃·▃·▃▅▃▃ beats 4/13   medium · avg 57%       4.1%  blunt · at its level
AHELM MELD audio emotion classifi…   33.4%  ▃··●▃▃·▃▅▅█▅ beats 1/13   medium · avg 39%       3.1%  blunt · at its level
AHELM FLEURS 7-language transcrip…   54.5%  ▄▂···▂▆●█▂·▂ beats 7/13   avg 83%                2.1%  blunt · noisy
AHELM Multilingual LibriSpeech 7-…   12.3%  ▂▂▂··▂▂·●▂█▆ beats 5/13   avg 14%                0.4%  blunt · noisy
AHELM VocalSound human-sound reco…   79.4%  ██▄▄·█·●·█▄▄ beats 8/13   easy · avg 67%         0.0%  blunt · at its level · noisy
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
AHELM: A Holistic Evaluation of Audio-L…       10   97% ▇▇▇▇▇▇▇▇▇▇▇▇
prior: pull toward the middle                        3% ▇
weighted average                                   = 48.6
Licences: AHELM: A Holistic Evaluation of Audio-Language Models ([CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/gpt-4o-mini-audio-preview-2024-12-17) · [JSON](https://whatmodel.sh/api?format=json&all=1)