/
/
Multimodal Real-World Engineering

Available on Request · Sample Available

Multimodal Real-World Engineering

Technical drawings and schematics paired with engineering questions and worked solutions.

Volume

0

Volume

Scalable Volume

Coverage

Aerospace, Civil, Electrical, Manufacturing, Mechanical, Robotics, Engineering

45.2%Claude Opus 5 · Pass@1
60.7%Claude Opus 5 · Pass@3

Targets

N/A

Modality & Delivery

ImageText→Text

Formats

Excel (.xlsx)Images

What You Receive

Multimodal engineering tasks pairing technical drawings, schematics, layouts, and diagrams with questions, worked solutions, and final answers across ten disciplines from aerospace to power systems.

Coverage

Aerospace, civil, electrical, manufacturing, mechanical, process, robotics, semiconductor, telecommunications, and power systems engineering, requiring visual extraction and domain-specific calculations.

Package Structure

Differentiators

  • Pairs domain questions with task-relevant visual evidence.
  • Pairs real technical drawings, schematics, layouts, and diagrams with worked engineering solutions.

Record Schema

ABCD
1answerimage_refquestionsolution
2The concise final answer associated with the question.Path to the associated image file referenced by the record.The question or task presented in the dataset record.The worked solution or supporting reasoning for the question.

Results

ModelMetricResult
Claude Opus 5Pass@145.2%
Claude Opus 5Pass@360.7%

Methodology & Quality

Methodology

Questions are expert-authored, then split across an SME pool for complexity validation before benchmarking.

SME involvement

Domain-expert curated with up to L2 review

Stressors

Combined visual interpretation and domain reasoning.; Technical imagery across aerospace, civil, electrical, manufacturing, mechanical, robotics, semiconductor, telecom, and power systems.

Design criteria

  1. Require visual extraction together with domain-specific reasoning.
  2. Require both visual extraction and domain-specific engineering calculations.

Build assumptions

Quality approach

Known limitations

Customization & Scalability

Custom sets available. Additional volume in progress

Get Started

Request a Sample

Share your target domains and the OTS team will follow up with sample data and next steps.

This field is for validation purposes and should be left unchanged.