[whatmodel.sh](../../README.md) / Palmyra X4 (palmyra-x-004) # Palmyra X4 (palmyra-x-004) Writer · released 2024-10 · proprietary **score 52.6** ±3.3 · comparison only: no current run option verified · from 3 benchmark results across 2 sources Score within the [LMArena (text)](https://whatmodel.sh/?set=lmarena-text&score=set) comparison set only. ## What it's good at ● marks Palmyra X4 (palmyra-x-004) among every model on that task or test, worst to best. 
task         vs the others         rank  counts  tests
agent tasks  ▁▁▂▆●▄▅▄▄▃▁▁   #272 of 354     95%      3
agent tasks · #272 of 354 · 95% of its score Beats [o3-mini](o3-mini.md), [Llama 3.1 Nemotron Ultra 253B v1](llama-3-1-nemotron-ultra-253b.md), [Nova 2 Lite](nova-2-lite.md) here, though they rank higher overall. Trails [SmolLM3 3B](smollm3-3b.md), [Phi-3.5-mini-instruct](phi-3-5-mini-instruct.md), [Jamba 1.5 Mini](jamba-1-5-mini.md) here, though they rank lower overall. 
test                                result  vs the others in its run   difficulty        counts  why
BFCL V4 (December 2025 archive)      27.9%  ▁▁▁▂█●▅▅▆▂▂▂ beats 23/77   hard · avg 31%       50%  at its level
BFCL v3                              56.8%  ▁▁▁▁▁▃▅●▅▄▁▁ beats 65/114  medium · avg 51%     25%  blunt · at its level
Galileo Agent Leaderboard v1 (too…   88.6%  ▃▃▃▃▆▅▆●█▂▅▂ beats 19/31   easy · avg 78%       20%  typical
## How the score was worked out Each result implies a score on its own, after adjusting for how hard that test is and who ran it. The model's score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its *counts* column above; here it is added up by who ran the tests. [Method](../method.md) 
source                                    results  share of the score
Berkeley Function Calling Leaderboard r…        2   75% ▇▇▇▇▇▇▇▇▇
Galileo Agent Leaderboard                       1   20% ▇▇
prior: pull toward the middle                        5% ▇
weighted average                                   = 52.6
Licences: Berkeley Function Calling Leaderboard result archive ([Apache-2.0](../../licenses/bfcl-result-archive-v4-Apache-2.0.txt)) · Galileo Agent Leaderboard ([Apache-2.0](../../licenses/galileo-agent-leaderboard-Apache-2.0.txt)) ## How to run it No verified API or local download yet. [interactive version](https://whatmodel.sh/model/palmyra-x-004) · [JSON](https://whatmodel.sh/api?format=json&all=1)