model,harness,fixed_of_105,fixed_v1_of_45,fixed_v2_of_60,genuine_extras_total,wall_min_total,cost_usd_list_equiv_total
GPT-5.6 Sol,Codex CLI,31,13,18,38,70.2,29.16
Fable 5,Claude Code,24,9,15,3,31.4,68.07
Opus 5,Claude Code,21,11,10,6,37.4,38.77
Kimi K3,Claude Code / OpenRouter,21,4,17,6,107.8,25.27
Grok 4.5,Grok Build CLI (ACP),16,5,11,7,24.9,2.58
Opus 4.8,Claude Code,9,2,7,1,34.8,19.35
Sonnet 5,Claude Code,9,1,8,4,32.8,15.12
GPT-5.6 Sol (re-run Jul 31),Codex CLI,34,13,21,28,66.7,33.92
GPT-5.6 Luna (max effort),Codex CLI,33,17,16,31,85.7,1.8
GPT-5.6 Luna (high effort),Codex CLI,13,5,8,22,64.1,0.57
DeepSeek V4-Flash,Claude Code / OpenRouter,8,4,4,4,24.9,0.61
GPT-5.6 Sol (max effort),Codex CLI,42,19,23,40,163.8,69.61
Fable 5 (max effort),Claude Code,29,12,17,5,57.3,104.49
Opus 5 (max effort),Claude Code,27,13,14,2,60.0,51.33
Grok 4.5 (high re-run - CLI has no max),Grok Build CLI (ACP),13,5,8,5,25.4,10.94
DeepSeek V4-Flash 0731,Claude Code / OpenRouter,14,6,8,0,48.5,1.74
DeepSeek V4-Pro,Claude Code / OpenRouter,10,5,5,1,27.6,1.26
Qwen3.8-Max,Claude Code / Alibaba API,19,5,14,6,148.1,31.1
"Muse Spark 1.2 (xhigh, Meta API)",Claude Code / Meta API,17,6,11,12,35.7,13.99
Grok 4.5 (re-run Aug 6),Grok Build CLI (ACP),17,5,12,10,27.9,8.5
"Muse Spark 1.2 (default effort, OpenRouter)",Claude Code / OpenRouter,14,3,11,3,65.2,19.52
Grok 4.6 (xhigh),Grok Build CLI (ACP),27,10,17,15,34.4,22.73