Legal reasoning and analysis tasks framed as practical scenarios and advisory problems, grounded in identified authorities.
Available Now · Sample Available
Legal Reasoning
Scenario-based legal advisory tasks grounded in identified authorities.
Volume
0
Volume
Scalable Volume
Coverage
0.0
%
Opus 4.8
Targets
LegalBench, LexGLUE
Modality & Delivery
Text→Text
Formats
JSONExcel
What You Receive
Coverage
Scenarios span the UK Digital Securities Sandbox, EU MiCA and DORA, the US DOJ sensitive-data rule, EU financial and digital regulation, and the UK failure-to-prevent-fraud regime. Topics include; Financial Regulation, Technology Regulation, Corporate Compliance, Cross-Border Data Regulation, etc.
Package Structure
Differentiators
- Frames legal work as scenario analysis or counsel-style advisory tasks rather than recall-only questions.
- Every supplied task includes a reference analysis and source reference.
Record Schema
| Field | Description |
|---|---|
answer | The supplied reference analysis or counsel-style answer. |
question | The legal scenario or advisory prompt. |
source_ref | The cited source or authority supporting the task. |
Results
| Model | Metric | Result |
|---|---|---|
| Opus 4.8 | Pass@1 | |
| Opus 4.8 | Pass@5 |
Methodology & Quality
Methodology
Each supplied record pairs a practical legal scenario with a reference analysis and identified source authority.
SME involvement
Domain-expert curated with up to L2 review
Stressors
Cross-regime issue spotting, application of current regulatory requirements to practical facts, and production of counsel-style analysis.
Design criteria
- Require application of legal authorities to a practical fact pattern.
- Retain the source authority used to support each reference analysis.
Build assumptions
Quality approach
- All tasks include a reference analysis and source reference.
Known limitations
Customization & Scalability
Custom sets available. Additional volume in progress