Provider,Category,Overall,Tables,Charts,Content_Faithfulness,Semantic_Formatting,Visual_Grounding,Cost_Per_Page,Cost_Charts,Cost_Tables,Cost_Text,Cost_Layout,HF_Model_ID
LlamaParse Cost Effective,LlamaParse,80.61,84.19,77.91,89.87,67.29,83.77,0.375,,,,,
LlamaParse Agentic,LlamaParse,87.01,88.88,88.68,91.78,81.44,84.25,1.25,,,,,
LlamaParse Agentic Plus,LlamaParse,90.20,93.37,94.18,92.25,87.12,84.09,5.625,,,,,
OpenAI GPT-5 Mini (Reasoning Minimal),VLM - Proprietary,46.83,69.82,30.13,82.30,45.77,6.15,0.88,0.70,1.22,0.67,0.91,
OpenAI GPT-5 Mini (Reasoning Medium),VLM - Proprietary,51.52,74.60,38.96,85.68,45.35,13.03,3.05,2.93,3.43,2.67,3.15,
Anthropic Haiku 4.5 (Disable Thinking),VLM - Proprietary,45.17,77.21,13.77,78.74,49.39,6.72,1.64,0.97,2.46,1.53,1.60,
Anthropic Haiku 4.5 (Thinking),VLM - Proprietary,53.12,78.70,27.39,84.83,62.36,12.30,3.69,3.49,4.26,3.16,3.83,
Google Gemini 3 Flash (Thinking Minimal),VLM - Proprietary,71.04,89.85,64.83,86.19,58.35,55.97,0.65,0.49,0.84,0.56,0.69,
Google Gemini 3 Flash (Thinking High),VLM - Proprietary,75.05,91.50,64.79,90.87,68.31,59.77,2.41,2.38,2.29,2.25,2.70,
Google Gemini 3 Flash (Thinking Medium),VLM - Proprietary,75.00,91.01,61.56,88.67,67.95,65.79,1.98,2.23,2.01,1.74,1.97,
GLM-5.3 Flash,VLM - Proprietary,70.75,89.18,54.96,88.34,79.49,41.78,0.44,0.39,0.49,0.42,0.47,
OpenAI GPT-6.1 Sol (Reasoning Low),VLM - Proprietary,70.48,92.44,37.16,89.25,74.78,58.76,1.95,1.43,2.58,1.63,2.16,
Google Gemini 3.5 Flash (Thinking Medium),VLM - Proprietary,69.92,91.12,44.01,90.19,59.14,65.14,4.28,3.50,5.12,3.57,4.94,
Google Gemini 3.5 Flash (Thinking Minimal),VLM - Proprietary,63.09,86.24,18.74,88.22,68.09,54.18,1.82,1.13,2.53,1.47,2.15,
Google Gemini 3.5 Flash (Thinking High),VLM - Proprietary,74.02,90.44,45.27,88.92,77.85,67.6,4.95,4.02,5.91,4.10,5.78,
Google Gemini 3.6 Flash (Thinking Medium),VLM - Proprietary,66.78,89.47,31.0,87.7,58.46,67.27,3.76,3.25,4.21,3.22,4.35,
Google Gemini 3.6 Flash (Thinking Minimal),VLM - Proprietary,65.60,85.5,24.76,83.3,64.49,69.94,1.48,0.98,1.90,1.24,1.80,
Google Gemini 3.6 Flash (Thinking High),VLM - Proprietary,70.03,89.3,34.53,88.21,73.11,64.98,4.25,3.67,4.75,3.63,4.95,
Google Gemini 3.7 Flash (Thinking High),VLM - Proprietary,71.27,90.16,32.07,88.6,74.98,70.56,1.91,1.52,2.25,1.59,2.28,
Google Gemini 3.7 Flash (Thinking Medium),VLM - Proprietary,70.78,88.66,35.11,88.45,73.05,68.63,1.06,0.83,1.24,0.97,1.21,
Google Gemini 3.7 Flash (Thinking Low),VLM - Proprietary,69.57,87.96,31.84,88.44,68.89,70.71,0.70,0.47,0.89,0.61,0.83,
Google Gemini 3.8 Flash (Thinking High),VLM - Proprietary,72.08,89.12,32.34,89.68,76.36,72.91,3.41,3.46,3.48,2.67,4.02,
Google Gemini 3.8 Flash (Thinking Low),VLM - Proprietary,70.15,88.18,35.09,88.25,66.99,72.24,0.71,0.48,0.89,0.62,0.85,
Google Gemini 3.8 Flash (Thinking Medium),VLM - Proprietary,70.70,89.08,32.72,88.42,71.8,71.5,1.24,1.11,1.42,1.05,1.38,
Anthropic Opus 4.6,VLM - Proprietary,54.07,86.52,13.49,89.70,64.19,16.47,5.78,4.02,8.16,5.19,6.40,
Anthropic Opus 4.7,VLM - Proprietary,63.34,87.17,55.84,90.26,69.42,13.99,7.14,5.69,8.63,6.07,8.17,
Anthropic Opus 4.8,VLM - Proprietary,63.70,89.65,49.75,89.02,71.38,18.69,7.30,5.82,8.78,6.24,8.36,
Anthropic Opus 5.5 (Effort High),VLM - Proprietary,79.85,94.25,70.89,91.72,77.04,65.33,6.13,5.47,7.12,5.18,6.76,
Anthropic Opus 5.5,VLM - Proprietary,78.01,93.86,64.12,91.81,77.04,63.2,5.79,4.68,6.90,5.07,6.51,
Anthropic Opus 5.5 (Effort Low),VLM - Proprietary,74.47,92.69,53.52,91.68,75.21,59.27,5.46,4.27,6.71,4.85,6.03,
Anthropic Fable 5,VLM - Proprietary,70.78,89.79,52.21,90.02,72.62,49.24,15.60,13.04,19.36,13.03,16.99,
Anthropic Fable 5.1,VLM - Proprietary,78.92,91.52,67.06,91.19,76.52,68.3,16.05,14.64,17.82,13.79,17.96,
Anthropic Sonnet 5,VLM - Proprietary,62.13,86.65,60.53,86.51,64.93,12.03,3.18,2.79,3.82,2.60,3.52,
Anthropic Sonnet 5.5,VLM - Proprietary,70.18,91.04,37.69,91.64,71.63,58.92,2.74,2.10,3.39,2.41,3.06,
Google Gemini 3.1 Pro,VLM - Proprietary,69.14,91.00,41.13,90.16,52.43,70.99,8.49,6.69,9.69,7.73,10.54,
Google Gemini 3.1 Pro (Thinking Low),VLM - Proprietary,60.82,90.29,11.43,87.11,45.56,69.7,2.50,1.56,3.22,2.15,3.07,
Google Gemini 3.1 Flash Lite,VLM - Proprietary,58.32,85.48,9.92,89.46,58.38,48.38,0.29,0.19,0.37,0.27,0.31,
Google Gemini 3.1 Flash Lite (Thinking Medium),VLM - Proprietary,58.13,83.43,14.35,87.67,56.17,49.05,0.32,0.21,0.40,0.30,0.37,
Anthropic Haiku 5.5,VLM - Proprietary,57.40,86.85,10.13,90.24,65.64,34.14,0.14,0.11,0.19,0.13,0.15,
Google Gemini 3.1 Flash Lite (Thinking High),VLM - Proprietary,57.29,76.76,30.89,83.28,56.61,38.93,1.04,0.86,1.18,0.97,1.12,
Google Gemini 3.5 Flash Lite,VLM - Proprietary,57.15,73.48,6.26,82.22,57.74,66.03,0.56,0.34,0.74,0.40,0.74,
Google Gemini 3.5 Flash Lite (Thinking High),VLM - Proprietary,60.64,83.31,19.27,86.85,54.03,59.75,1.18,0.91,1.47,0.96,1.37,
Google Gemini 3.5 Flash Lite (Thinking Medium),VLM - Proprietary,54.30,72.85,6.23,78.8,48.05,65.55,0.47,0.29,0.63,0.39,0.58,
OpenAI GPT-5.4 (Reasoning None),VLM - Proprietary,62.23,83.89,65.22,85.57,59.52,16.95,2.90,2.55,4.04,2.13,3.00,
OpenAI GPT-5.5 (Reasoning Medium),VLM - Proprietary,67.76,90.05,65.53,86.81,60.12,36.28,13.09,13.22,13.93,11.30,13.90,
OpenAI GPT-5.5 (Reasoning None),VLM - Proprietary,64.39,89.31,59.11,87.17,64.46,21.90,5.93,4.87,8.12,4.40,6.33,
OpenAI GPT-5.6 Terra (Reasoning Medium),VLM - Proprietary,68.39,86.72,67.86,87.06,68.47,31.82,2.71,2.62,3.40,2.09,2.75,
OpenAI GPT-5.6 Terra (Reasoning Low),VLM - Proprietary,68.07,86.91,67.71,86.83,67.92,30.97,2.59,2.44,3.25,1.97,2.68,
OpenAI GPT-5.6 Terra (Reasoning None),VLM - Proprietary,64.17,86.23,63.75,82.56,59.96,28.35,2.36,2.10,3.09,1.77,2.48,
OpenAI GPT-5.6 Sol (Reasoning High),VLM - Proprietary,75.35,91.39,68.68,88.16,77.16,51.35,8.08,8.42,8.14,6.76,9.02,
OpenAI GPT-5.6 Sol (Reasoning None),VLM - Proprietary,62.12,89.34,59.57,86.17,50.42,25.09,4.06,3.26,5.44,3.24,4.29,
OpenAI GPT-5.6 Luna (Reasoning Max),VLM - Proprietary,68.34,88.27,49.16,86.57,64.95,52.73,1.70,1.70,1.46,1.58,2.04,
OpenAI GPT-5.6 Luna (Reasoning XHigh),VLM - Proprietary,68.24,89.42,49.44,87.13,66.51,48.69,1.01,0.98,0.92,0.94,1.21,
OpenAI GPT-5.6 Luna (Reasoning High),VLM - Proprietary,67.37,88.75,49.25,86.99,67.14,44.74,0.59,0.57,0.59,0.52,0.68,
OpenAI GPT-5.6 Luna (Reasoning Medium),VLM - Proprietary,63.58,85.32,46.91,85.27,65.8,34.6,0.29,0.25,0.35,0.25,0.31,
OpenAI GPT-5.6 Luna (Reasoning Low),VLM - Proprietary,60.18,81.67,38.95,85.28,64.75,30.26,0.23,0.18,0.30,0.20,0.25,
OpenAI GPT-5.6 Luna (Reasoning None),VLM - Proprietary,56.32,81.30,28.32,82.65,63.90,25.43,0.22,0.17,0.30,0.18,0.23,
OpenAI GPT-6 Astra (Reasoning Low),VLM - Proprietary,70.67,93.17,35.08,89.6,75.52,59.99,9.87,7.14,13.09,8.15,11.09,
OpenAI GPT-6 Sol (Reasoning High),VLM - Proprietary,69.69,92.63,48.05,87.81,67.91,52.06,3.47,2.97,3.75,3.17,3.99,
OpenAI GPT-6 Sol (Reasoning Medium),VLM - Proprietary,68.19,90.27,46.46,87.3,67.88,49.05,2.40,2.01,2.91,2.08,2.60,
OpenAI GPT-6 Sol (Reasoning None),VLM - Proprietary,66.10,89.49,42.02,86.38,67.32,45.27,1.86,1.35,2.56,1.52,1.98,
OpenAI GPT-6 Luna (Reasoning Max),VLM - Proprietary,65.77,87.42,45.71,84.44,61.81,49.48,0.72,0.67,0.59,0.73,0.88,
OpenAI GPT-6 Luna (Reasoning XHigh),VLM - Proprietary,64.32,88.01,42.38,85.0,65.34,40.86,0.29,0.26,0.28,0.27,0.33,
OpenAI GPT-6 Luna (Reasoning High),VLM - Proprietary,64.21,87.97,44.28,85.27,63.58,39.97,0.21,0.19,0.22,0.18,0.23,
OpenAI GPT-6 Luna (Reasoning Medium),VLM - Proprietary,62.38,86.74,42.97,84.94,61.13,36.14,0.14,0.13,0.17,0.12,0.15,
OpenAI GPT-6 Luna (Reasoning Low),VLM - Proprietary,59.32,84.2,39.05,84.95,59.9,28.51,0.11,0.08,0.14,0.09,0.11,
OpenAI GPT-6 Luna (Reasoning None),VLM - Proprietary,52.93,81.42,15.48,85.07,59.84,22.85,0.09,0.06,0.13,0.07,0.10,
OpenAI GPT-5.4 Nano,VLM - Proprietary,43.35,60.16,17.57,78.05,54.56,6.41,0.25,0.17,0.35,0.19,0.28,
Amazon Nova 2 Lite,VLM - Proprietary,40.43,68.38,6.7,77.04,45.26,4.78,0.70,0.30,0.70,0.99,0.79,
AWS Textract,Commercial - IDP,47.88,84.58,5.97,74.76,3.71,70.36,1.5,,,,,
Google Cloud Document AI,Commercial - IDP,50.39,55.10,1.44,83.65,50.51,61.26,1,,,,,
Azure Document Intelligence (Layout),Commercial - IDP,59.64,86.00,1.56,84.93,51.93,73.78,1,,,,,
anyformat (Standard),Commercial - Startup APIs,80.30,86.46,85.56,87.35,79.04,63.07,4.3,,,,,
Reducto (Agentic),Commercial - Startup APIs,72.97,80.42,73.4,86.37,57.6,67.07,4.76,6,3.4,4.2,5,
Pulse Ultra 2,Commercial - Startup APIs,81.60,90.35,89.70,87.63,73.97,66.35,1.5,,,,,
Datalab Accurate,Commercial - Startup APIs,69.95,90.29,62.40,83.87,40.79,72.38,1,,,,,
Datalab Balanced,Commercial - Startup APIs,69.51,89.10,62.05,83.63,39.74,73.05,0.4,,,,,
Datalab Fast,Commercial - Startup APIs,67.79,85.08,57.56,82.76,39.06,74.47,0.4,,,,,
Reducto,Commercial - Startup APIs,67.83,70.33,56.99,86.37,56.75,68.71,2.38,3,1.7,2.1,2.5,
Reducto (r-1),Commercial - Startup APIs,62.37,85.15,2.76,89.19,73.99,60.75,1,1,1,1,1,
Extend,Commercial - Startup APIs,55.75,85.05,1.59,84.08,47.36,60.67,2.5,,,,,
Extend (2.0),Commercial - Startup APIs,75.33,84.82,78.31,84.59,60.31,68.61,2.5,,,,,
Extend Light (1.0),Commercial - Startup APIs,73.26,75.8,78.6,84.8,58.6,68.5,0.625,,,,,
LandingAI,Commercial - Startup APIs,45.23,73.72,10.88,88.60,27.87,25.08,3,,,,,
Firecrawl,Commercial - Startup APIs,31.08,55.88,0,74.37,25.16,0,0.9,,,,,
oi-parser,Commercial - Startup APIs,78.30,92.62,78.28,86.17,66.88,67.53,,,,,,
DocAI,Commercial - Startup APIs,60.74,51.39,60.45,80.42,42.12,69.32,1.00,,,,,
Mistral OCR 4 (Annotation),Commercial - IDP,68.23,73.94,40.11,89.55,66.37,71.17,0.5,,,,,
Mistral OCR 4,Commercial - IDP,60.68,73.94,2.35,89.55,66.37,71.17,0.4,,,,,
Databricks AI Parse,Commercial - IDP,74.71,83.67,70.17,88.25,55.25,76.23,0.35,0.38,0.30,0.30,0.41,
Nutrient DWS (Agentic),Commercial - IDP,76.43,72.13,83.46,84.45,64.66,77.47,1.80,,,,,
Infinity-Parser2-Pro,VLM - Open Weight,74.28,86.4,61.3,89.7,59.1,74.9,,,,,,infly/Infinity-Parser2-Pro
Infinity-Parser2-Flash,VLM - Open Weight,73.25,82.88,55.56,89.52,57.7,80.61,,,,,,infly/Infinity-Parser2-Flash
Qwen3-VL-8B-Instruct,VLM - Open Weight,61.97,74.61,28.18,87.63,64.23,55.18,,,,,,Qwen/Qwen3-VL-8B-Instruct
Qwen 3.8 27B,VLM - Open Weight,61.21,84.52,16.59,86.57,55.29,63.06,,,,,,Qwen/Qwen3.8-27B
Qwen 3.8 27B (Thinking),VLM - Open Weight,70.79,66.82,69.17,88.28,59.77,69.90,,,,,,Qwen/Qwen3.8-27B
Dots.mocr,VLM - Open Weight,55.79,85.15,0.95,90.03,46.99,55.81,,,,,,rednote-hilab/dots.mocr
HPD-Parsing,VLM - Open Weight,54.04,73.77,0.79,82.21,45.67,67.76,,,,,,PaddlePaddle/HPD-Parsing
Falcon-OCR,VLM - Open Weight,53.08,74.70,0.82,78.59,47.91,63.37,,,,,,tiiuae/Falcon-OCR
Docling-models,VLM - Open Weight,50.65,66.41,52.76,66.93,1.03,66.11,,,,,,docling-project/docling-models
Chandra-ocr-2,VLM - Open Weight,70.1,89.2,65.1,83.7,61.4,51.2,,,,,,datalab-to/chandra-ocr-2
PaddleOCR-VL-1.6,VLM - Open Weight,67.43,67.77,54.24,82.71,54.64,77.8,,,,,,PaddlePaddle/PaddleOCR-VL-1.6
PaddleOCR-VL-1.5,VLM - Open Weight,65.95,67.38,47.62,82.72,54.27,77.78,,,,,,PaddlePaddle/PaddleOCR-VL-1.5
Surya OCR 2,VLM - Open Weight,64.83,82.68,21.95,86.57,61.36,71.59,,,,,,datalab-to/surya-ocr-2
HunyuanOCR 1.5,VLM - Open Weight,63.86,65.45,55.98,86.44,47.73,63.72,,,,,,tencent/HunyuanOCR
Gemma-4-31B-it,VLM - Open Weight,62.4,80.6,15,89.9,69.3,57.4,,,,,,google/gemma-4-31B-it
TeleOCR,VLM - Open Weight,58.67,72.74,9.97,85.39,45.13,80.14,,,,,,StarDoc-AI/TeleOCR
Gemma-4-26B-A4B-it,VLM - Open Weight,58.5,70,14.2,83.8,65.1,59.2,,,,,,google/gemma-4-26B-A4B-it
Nemotron-3-Nano-Omni-30B-A3B (Thinking),VLM - Open Weight,48.51,70.44,31.47,80.97,59.69,0,,,,,,nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16
LightOnOCR-2-1B,VLM - Open Weight,48,75.5,13.5,87.8,63.2,0,,,,,,lightonai/LightOnOCR-2-1B
Nemotron-3.5-Parse,VLM - Open Weight,75.2,84.67,64.4,87.96,68.28,70.67,,,,,,nvidia/Nemotron-3.5-Parse
LightOnOCR-3-4B,VLM - Open Weight,75.1,83.8,66.1,89.9,67.6,68.3,,,,,,lightonai/LightOnOCR-3-4B
LightOnOCR-3-0.8B,VLM - Open Weight,74.6,84.5,64.7,88.9,66.7,68.2,,,,,,lightonai/LightOnOCR-3-0.8B
LightOnOCR-3-1B,VLM - Open Weight,71.4,84.8,57.3,88.6,64.5,61.7,,,,,,lightonai/LightOnOCR-3-1B
Qianfan-OCR,VLM - Open Weight,46.2,72.3,0.9,83.5,53.8,20.6,,,,,,baidu/Qianfan-OCR
MinerU2.5-Pro-2605-1.2B,VLM - Open Weight,72.78,77.59,61.64,87.88,57.49,79.30,,,,,,opendatalab/MinerU2.5-Pro-2605-1.2B
Unlimited-OCR,VLM - Open Weight,46.17,70.21,1.34,86.81,0.97,71.52,,,,,,baidu/Unlimited-OCR
Jina-OCR-v1,VLM - Open Weight,45.93,74.90,7.52,86.58,60.64,0,,,,,,jinaai/jina-ocr-v1
MinerU2.5-2509-1.2B,VLM - Open Weight,45.9,71.7,1.1,80.8,4.5,71.5,,,,,,opendatalab/MinerU2.5-2509-1.2B
Qwen3.6-35B-A3B,VLM - Open Weight,44.1,19.1,5.1,90.7,58.3,47.4,,,,,,Qwen/Qwen3.6-35B-A3B
MinerU-Diffusion-V1-0320-2.5B,VLM - Open Weight,42.63,66.51,1.19,69.46,1.46,74.54,,,,,,opendatalab/MinerU-Diffusion-V1-0320-2.5B
DeepSeek-OCR-2,VLM - Open Weight,41.2,61.7,1.1,82,54,7,,,,,,deepseek-ai/DeepSeek-OCR-2
PaddleOCR-VL,VLM - Open Weight,40.9,67.1,0.9,82.7,54,0,,,,,,PaddlePaddle/PaddleOCR-VL
OvisOCR2,VLM - Open Weight,40.84,77.37,1.01,88.47,37.35,0,,,,,,ATH-MaaS/OvisOCR2
Gemma-4-E4B-it,VLM - Open Weight,40.5,25,7.7,81.4,52.5,35.8,,,,,,google/gemma-4-E4B-it
Granite Vision 4.1 4B,VLM - Open Weight,39.45,63.81,47.47,64.43,21.52,0,,,,,,ibm-granite/granite-vision-4.1-4b
WeVisDoc-2B,VLM - Open Weight,38.93,70.41,0.86,77.11,46.28,0,,,,,,tencent/WeVisDoc-2B
WeVisDoc-4B,VLM - Open Weight,36.15,65.86,0.79,70.45,43.65,0,,,,,,tencent/WeVisDoc-4B
Qwen3.5-4B,VLM - Open Weight,35.4,8,2.5,88.9,57.8,19.7,,,,,,Qwen/Qwen3.5-4B
Qwen3.5-9B,VLM - Open Weight,31.9,9.9,5.4,90.5,22,31.8,,,,,,Qwen/Qwen3.5-9B
Qwen3.5-0.8B,VLM - Open Weight,28.4,1.5,0.4,82,43.1,15,,,,,,Qwen/Qwen3.5-0.8B
Qwen3.5-2B,VLM - Open Weight,27.3,0,0.1,87.2,31.1,18.3,,,,,,Qwen/Qwen3.5-2B
GLM-OCR,VLM - Open Weight,29.6,66.1,1.7,78,2.3,0,,,,,,zai-org/GLM-OCR
KDL-Frontier-Parser-nano,VLM - Open Weight,72.38,85.73,58.61,87.75,55.06,74.75,,,,,,KDLAI/KDL-Frontier-Parser-nano
florin-parser-nano,VLM - Open Weight,76.69,86.10,65.19,87.37,70.64,74.14,,,,,,florin-inc/florin-parser-nano
rakedoc-nano,VLM - Open Weight,77.23,86.44,64.89,88.84,71.68,74.28,,,,,,cloudraker/rakedoc-nano
aeddix-alpine-ocr (KDL pipeline),VLM - Open Weight,76.77,85.89,68.78,87.90,66.05,75.21,,,,,,aeddix-labs/aeddix-alpine-ocr
DeepSeek V4.1 Flash (Thinking High),VLM - Open Weight,65.72,82.82,51.11,87.33,73.48,33.87,,,,,,deepseek-ai/DeepSeek-V4.1-Flash
DeepSeek V4.1 Flash (No Thinking),VLM - Open Weight,56.57,79.65,20.46,88.09,66.05,28.61,,,,,,deepseek-ai/DeepSeek-V4.1-Flash
MarkItDown,Open Source - Local,18.63,15.77,2.02,64.54,0.91,9.90,,,,,,
OpenDataLoader,Open Source - Local,29.40,35.18,0.92,66.06,34.07,10.77,,,,,,
PyMuPDF4LLM,Open Source - Local,53.49,72.00,2.19,79.34,52.04,61.89,,,,,,
PyMuPDF (Text),Open Source - Local,16.02,0.00,0.00,68.28,0.95,10.86,,,,,,
PyMuPDF (HTML),Open Source - Local,16.62,0.00,0.00,55.63,18.26,9.20,,,,,,
pypdf,Open Source - Local,14.87,0.00,0.00,62.50,0.91,10.92,,,,,,
pdf-inspector,Open Source - Local,26.59,26.64,5.29,56.06,35.07,9.91,,,,,,
LiteParse (no OCR),Open Source - Local,36.9,42.4,1.8,70.0,38.5,31.8,,,,,,
Warp Ingest,Open Source - Local,40.18,57.45,7.04,70.81,45.81,19.78,,,,,,