ResearchJune 10, 20266 min read
RealMath-Eval: Why State-of-the-Art LLM Judges Fail on Real Human Math Reasoning
A new benchmark paper, RealMath-Eval, surfaces a sharp and uncomfortable finding: the SOTA LLM judges routinely used to evaluate math reasoning models systematically break down when faced with the kind of authentic, messy reasoning real humans produce.