Graduate math problems paired with plots, spectra, and diagrams as QSA triples. Addresses the text-to-multimodal drop on OlympiadBench MM, where top models lose more than 25 points versus text-only.
Available Now · Sample Available
Multimodal Math QSA
Graduate math with plots and diagrams, built where models lose 25+ points going multimodal.
Volume
0
Volume
Scalable Volume
Coverage
Grad, PhD, Expert, Math, Mathematics
17.4%Frontier Model · Pass@1
40.4%Claude Opus 5 · Pass@1
46.8%Claude Opus 5 · Pass@3
Targets
MMMU (Math), MathVista, OlympiadBench (MM math), MMMU-Pro, MathVision
Modality & Delivery
ImageText→Text
Formats
Excel (.xlsx)Images
What You Receive
Coverage
Plots, spectra, and diagrams — each problem paired with a corresponding scientific image.
Package Structure
Differentiators
- Structured question, worked solution, and final answer record format.
- Pairs domain questions with task-relevant visual evidence.
Record Schema
| A | B | C | D | |
|---|---|---|---|---|
| 1 | answer | image_ref | question | solution |
| 2 | The concise final answer associated with the question. | Reference to the image associated with the record, when supplied. | The question or task presented in the dataset record. | The worked solution or supporting reasoning for the question. |
Results
| Model | Metric | Result |
|---|---|---|
| Frontier Model | Pass@1 | |
| Claude Opus 5 | Pass@1 | |
| Claude Opus 5 | Pass@3 |
Methodology & Quality
Methodology
Questions are expert-authored, then split across an SME pool for complexity validation before benchmarking.
SME involvement
Domain-expert curated with up to L2 review
Stressors
Combined visual interpretation and domain reasoning.
Design criteria
- Keep the question, supporting solution, and final answer as distinct record components.
- Require visual extraction together with domain-specific reasoning.
Build assumptions
Quality approach
Known limitations
Customization & Scalability
Custom sets available. Additional volume in progress
Get Started
Request a Sample
Share your target domains and the OTS team will follow up with sample data and next steps.