Graduate-level COBOL question-and-answer records built around real mainframe programming. Each record pairs a question with a worked solution and a final answer.
Available Now · Sample Available
COBOL Coding QSA — Graduate
Full-program COBOL questions at graduate level, a step harder than function-level benchmark ports.
Updated:June 26, 2026
Volume
0
Volume
Scalable Volume
Coverage
COBOL, Coding, Computer Science
28.8%Codex GPT-5.4 · Pass@3
Targets
COBOLEval, CobolCodeBench
Modality & Delivery
Text→Text
Formats
Excel (.xlsx)
What You Receive
Coverage
Questions cover mainframe code: batch file processing, two-level control-break reporting, the SORT verb with INPUT/OUTPUT PROCEDURE composition, relative files with hash-and-probe collision handling, sub-program linkage, EBCDIC collation, and packed-decimal arithmetic.
Package Structure
Differentiators
- Sits in the same lane as COBOLEval and CobolCodeBench at a harder difficulty level: full programs rather than function-level HumanEval ports.
- Structured question, worked solution, and final answer record format.
Record Schema
| A | B | C | |
|---|---|---|---|
| 1 | answer | question | solution |
| 2 | The concise final answer associated with the question. | The question or task presented in the dataset record. | The worked solution or supporting reasoning for the question. |
Results
| Model | Metric | Result |
|---|---|---|
| Codex GPT-5.4 | Pass@3 |
Methodology & Quality
Methodology
Questions are expert-authored, then split across an SME pool for complexity validation before benchmarking.
SME involvement
Domain-expert curated with up to L2 review
Stressors
Batch file processing, two-level control-break reporting, SORT with INPUT/OUTPUT PROCEDURE composition, hash-and-probe collision handling on relative files, EBCDIC collation, and packed-decimal arithmetic.
Design criteria
- Keep the question, supporting solution, and final answer as distinct record components.
Build assumptions
Quality approach
Known limitations
Customization & Scalability
Custom sets available. Additional volume in progress
Get Started
Request a Sample
Share your target domains and the OTS team will follow up with sample data and next steps.