Every question is pre-filtered against the top 5 leading frontier models: only items that stump at least 2 of 5 tries while at least one model still solves them pass through. Each record pairs a question with a worked solution and a final answer.
Available Now · Sample Available
Complex STEM Model-Stumping QSA
Curated model-stumping Q&A across physics, chemistry, and biology — every item pre-filtered so frontier models miss it.
Volume
0
Volume
Scalable Volume
Coverage
Physics, Biology, Chemistry, STEM
0.0
%
Targets
Modality & Delivery
Text→Text
Formats
Excel (.xlsx)
What You Receive
Coverage
Guarantees difficulty with solvability, spanning physics, biology, and chemistry.
Package Structure
Differentiators
- Structured question, worked solution, and final answer record format.
- Items must stump leading frontier models repeatedly while remaining solvable by at least one model.
Record Schema
| Field | Description |
|---|---|
answer | The concise final answer associated with the question. |
question | The question or task presented in the dataset record. |
solution | The worked solution or supporting reasoning for the question. |
Results
Methodology & Quality
Methodology
Questions are expert-authored, then split across an SME pool for complexity validation before benchmarking.
SME involvement
Domain-expert curated with up to L2 review
Stressors
Hard but solvable reasoning across physics, biology, and chemistry.
Design criteria
- Keep the question, supporting solution, and final answer as distinct record components.
- Admit only questions that stump at least two of five attempts while at least one model still solves them.
Build assumptions
Quality approach
- Five-attempt frontier-model screening before item admission.
Known limitations
Customization & Scalability
Custom sets available. Additional volume in progress