Innodata Inc.
Main Menu
Main Menu
Contact Us
Silver trophy cup sitting on a podium, with a large orange-and-blue circular backdrop and small dot-and-line accents around it.

Innodata's LLM Scoreboard

AI Model Benchmark Rankings

Innodata’s LLM Scoreboard ranks leading large language models (LLMs) against expert datasets developed by Innodata’s data science department, Innodata Labs. Our rigorous methodology ensures fair and unbiased assessments, helping enterprises identify the safest and most capable AI models. 

 

These datasets, vetted by Innodata’s leading generative AI domain experts, cover key safety and risk areas, including: 

Features-Chrome1

Factuality

bias

Bias

Features-Chrome4

Toxicity

illicit-activity

Illicit Activities

PII-Leakage

PII Leakage

hallucination

Hallucinations

Features-Chrome5

Safety

And More...

Ranking Today's Leading LLMs:

Mistral-Nemo-Instruct-2407

Meta-Llama-3-8B-Instruct

OLMo-2-1124-7B-Instruct

Gemma-2-9b-it

Deepseek-llm-7b-chat

Explore the Latest Rankings
Silver trophy with a star on the front stands centered, with upward-pointing arrows in the background on a light surface.
Model ranking table shows OpenAI-GPT-4o top score 0.69, followed by Meta-Llama and Deepseek; columns include dataset, score, deviation.
Bias table listing AI models with Rt-inod-bias dataset, showing score and deviation columns, on a dark panel background.
Benchmark table ranking AI models with columns Model, Dataset, Score, and Deviation, shown on a dark panel over a green background.

Models benchmarked as of 2/06/2025

Interested in How Your LLM Compares?

Benchmark your models today using Innodata’s publicly available benchmarking tool.  

Benchmarking Toolkit
Download Datasets
GitHub Documentation
Read About Our Approach
Talk to an Expert