/
/
Multimodal Real-World Engineering

Available on Request · Sample Available

Multimodal Real-World Engineering

Technical drawings and schematics paired with engineering questions and worked solutions.

Volume

0

Volume

Scalable Volume

Coverage

Aerospace, Civil, Electrical, Manufacturing, Mechanical, Robotics, Engineering

Model Benchmark
0.0 %

Claude Opus 5 · Pass at k

Targets

N/A

Modality & Delivery

ImageText→Text

Formats

Excel (.xlsx)Images

What You Receive

Multimodal engineering tasks pairing technical drawings, schematics, layouts, and diagrams with questions, worked solutions, and final answers across ten disciplines from aerospace to power systems.

Coverage

Aerospace, civil, electrical, manufacturing, mechanical, process, robotics, semiconductor, telecommunications, and power systems engineering, requiring visual extraction and domain-specific calculations.

Package Structure

Differentiators

  • Pairs domain questions with task-relevant visual evidence.
  • Pairs real technical drawings, schematics, layouts, and diagrams with worked engineering solutions.

Record Schema

FieldDescription
answerThe concise final answer associated with the question.
image_refPath to the associated image file referenced by the record.
questionThe question or task presented in the dataset record.
solutionThe worked solution or supporting reasoning for the question.

Results

ModelMetricResult
Claude Opus 5Pass@145.2%
Claude Opus 5Pass@360.7%

Methodology & Quality

Methodology

Questions are expert-authored, then split across an SME pool for complexity validation before benchmarking.

SME involvement

Domain-expert curated with up to L2 review

Stressors

Combined visual interpretation and domain reasoning.; Technical imagery across aerospace, civil, electrical, manufacturing, mechanical, robotics, semiconductor, telecom, and power systems.

Design criteria

  1. Require visual extraction together with domain-specific reasoning.
  2. Require both visual extraction and domain-specific engineering calculations.

Build assumptions

Quality approach

Known limitations

Customization & Scalability

Custom sets available. Additional volume in progress