Chart understanding and visual reasoning.
Evaluates multimodal models on realistic chart understanding using 2,323 hand-curated arXiv charts, with descriptive questions (basic elements) and reasoning questions (synthesis across complex elements).
Model
Score
Opus 5.5Max
96.4%
GPT-6 AstraMax
96.1%
GPT-6 AstraxHigh
95.8%
Sonnet 5.5Max
GPT-6.1 SolMax
96.0%
Gemini 3.8 FlashHigh
95.4%
APEX NEWSLETTER
New benchmarks, leaderboard shifts, and research from the APEX team.
By subscribing, you agree to receive updates from Mercor.Unsubscribe anytime.