Research-grade PhD physics questions designed to challenge frontier reasoning models. Each problem is self-contained and paired with a rigorous, step-by-step reference solution featuring formal derivations, quantitative analysis, and clearly stated physical assumptions.
Available Now · Sample Available
Physics QSA
PhD-level physics in QFT, general relativity, and condensed matter theory.
Volume
0
Volume
Scalable Volume
Coverage
Grad, PhD, Physics
10.9%Grok 4.3 · Pass@1
55.8%Claude Opus 5 · Pass@1
65.2%Claude Opus 5 · Pass@3
Targets
GPQA Diamond, HLE (physics), CritPt, GPQA, OlympiadBench (physics), SciBench
Modality & Delivery
Text→Text
Formats
Excel (.xlsx)
What You Receive
Coverage
Quantum mechanics, quantum field theory, statistical mechanics, condensed matter, relativity, cosmology, astrophysics, plasma physics, and many-body theory.
Package Structure
Differentiators
- Structured question, worked solution, and final answer record format.
Record Schema
| A | B | C | |
|---|---|---|---|
| 1 | answer | question | solution |
| 2 | The concise final answer associated with the question. | The question or task presented in the dataset record. | The worked solution or supporting reasoning for the question. |
Results
| Model | Metric | Result |
|---|---|---|
| Grok 4.3 | Pass@1 | |
| Claude Opus 5 | Pass@1 | |
| Claude Opus 5 | Pass@3 |
Methodology & Quality
Methodology
Questions are expert-authored, then split across an SME pool for complexity validation before benchmarking.
SME involvement
Domain-expert curated with up to L2 review
Stressors
Design criteria
- Keep the question, supporting solution, and final answer as distinct record components.
Build assumptions
Quality approach
Known limitations
Customization & Scalability
Custom sets available. Additional volume in progress
Get Started
Request a Sample
Share your target domains and the OTS team will follow up with sample data and next steps.