How Far Are We? Systematic Evaluation of LLMs vs. Human Experts in Mathematical Contest in Modeling
How Far Are We? Systematic Evaluation of LLMs vs. Human Experts in Mathematical Contest in Modeling explores A new framework to systematically evaluate LLMs on complex, real-world problem-solving tasks, revealing critical execution gaps.. Commercial viability score: 4/10 in LLM Evaluation.
Use This Via API or MCP
Use the canonical paper page as a proof artifact
This route is the stable paper-level surface for citations, viability, references, and downstream handoffs. Use it as the proof layer behind Signal Canvas, workspace creation, and launch-pack generation.
BUILDER'S SANDBOX
Build This Paper
Use an AI coding agent to implement this research.
OpenAI CodexAI Agent
Lightweight coding agent in your terminal.
Claude CodeAI Agent
Agentic coding tool for terminal workflows.
AntiGravity IDEScaffolding
AI agent mindset installer and workflow scaffolder.
CursorIDE
AI-first code editor built on VS Code.
VS CodeIDE
Free, open-source editor by Microsoft.
Recommended Stack
Startup Essentials
Estimated $10K - $14K over 6-10 weeks.
See exactly what it costs to build this -- with 3 comparable funded startups.
7-day free trial. Cancel anytime.
Discover the researchers behind this paper and find similar experts.
7-day free trial. Cancel anytime.
Related Papers
- Builds On ThisEvaluating Large Language Models on Solved and Unsolved Problems in Graph Theory: Implications for Computing EducationViability: 3.0
- Prior WorkFrom Abstract to Contextual: What LLMs Still Cannot Do in MathematicsViability: 4.0
- Higher ViabilityIs Mathematical Problem-Solving Expertise in Large Language Models Associated with Assessment Performance?Viability: 5.0
- Higher ViabilityEvaluating LLMs When They Do Not Know the Answer: Statistical Evaluation of Mathematical Reasoning via Comparative SignalsViability: 5.0
- Higher Viability
Related Resources
- What are the limitations of current LLM evaluation methods when assessing long-tail knowledge acquisition?(question)
- What specific data science tasks does the DSAEval benchmark focus on for LLM evaluation?(question)
- How does scenario diversity in AI benchmarking contribute to more robust LLM evaluations?(question)