Noometry

Model comparison

ERNIE 5.0 0110 vs o3

o3 is the stronger model overall, scoring 47.5 to 41.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

o3 OpenAI

47.5

Rank #61 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 2 categories and o3 in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where o3 leads 32.0 to 17.0.

Side by side

ERNIE 5.0 0110o3
ProviderBaiduOpenAI
Noometry Index41.847.5
Released—2025-04-16
WeightsProprietaryProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$2
Output $ / M tokens—$8
Results tracked2063

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3 leads

ERNIE 5.0 0110: 43.0 (#94), o3: 46.8 (#64)

BenchmarkERNIE 5.0 0110o3
LMArena Coding14551408
SWE-bench Verified—62.3%
SWE-bench Verified (bash only)—58.4%
Aider Polyglot—81.3%
GSO—8.8%
WeirdML—52.4%
CadEval—74%
ALE-Bench—933.55

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, o3: 34.5 (#44)

BenchmarkERNIE 5.0 0110o3
Berkeley Function Calling Leaderboard—63%
GDPval—30.8%
DeepResearch Bench—45.2%
OSWorld—23%
LMArena Search—1144
METR Time Horizons—65.4%

Reasoning o3 leads

ERNIE 5.0 0110: 17.0 (#297), o3: 32.0 (#78)

BenchmarkERNIE 5.0 0110o3
LMArena Hard Prompts14451402
ARC-AGI-2—6.5%
SimpleBench—53.1%
Kagi LLM Benchmark—67.6%
NYT Connections (extended)10.3%—
ARC-AGI-1—60.8%
CritPt—1.4%
Chess Puzzles—38%
EnigmaEval—13.1%
Thematic Generalization41.7%—
Mystery Game Puzzles—29%
DTBench—84.8%
LMCA—39.7%
Epoch Capabilities Index—146.86
ForecastBench—62.5

Math o3 leads

ERNIE 5.0 0110: 39.3 (#110), o3: 50.2 (#58)

BenchmarkERNIE 5.0 0110o3
LMArena Math14371426
FrontierMath (Tiers 1-3)—33.3%
OTIS Mock AIME 2024-2025—84.4%
Omni-MATH—71.4%
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—18.7%
FrontierMath Tier 4 (v1)—2.1%

Knowledge o3 leads

ERNIE 5.0 0110: 39.8 (#128), o3: 54.6 (#52)

BenchmarkERNIE 5.0 0110o3
LMArena Expert14281402
GPQA Diamond—81.8%
Humanity's Last Exam—20.3%
SimpleQA Verified—49.4%
MMLU-Pro—85.9%
Confabulations—14.4%
GPQA (HELM)—75.3%

Multimodal o3 leads

ERNIE 5.0 0110: 39.9 (#53), o3: 41.4 (#36)

BenchmarkERNIE 5.0 0110o3
LMArena Vision12491214
GeoBench—74%
VPCT—52%

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), o3: 51.7 (#105)

BenchmarkERNIE 5.0 0110o3
LMArena Non-English14361401
LMArena Chinese15121437
LMArena French14671430
LMArena German14601420
LMArena Japanese13821403
LMArena Korean14061370
LMArena Russian14461406
LMArena Spanish14731395

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), o3: 72.8 (#127)

BenchmarkERNIE 5.0 0110o3
LMArena Instruction Following14131368
IFEval—86.9%

Long Context o3 leads

ERNIE 5.0 0110: 43.4 (#95), o3: 53.3 (#6)

BenchmarkERNIE 5.0 0110o3
LMArena Longer Query14221372
Fiction.LiveBench—88.9%
CL-bench—17.8%

Writing & Preference Too close to call

ERNIE 5.0 0110: 63.1 (#66), o3: 63.5 (#64)

BenchmarkERNIE 5.0 0110o3
LMArena Text14451410
LMArena Creative Writing14261359
LMArena Multi-Turn14341405
Short-Story Creative Writing—83.9%
EQ-Bench Creative Writing—1676
WildBench—86.1%

Frequently asked questions

Is ERNIE 5.0 0110 better than o3?

o3 is the stronger model overall, scoring 47.5 to 41.8 on the Noometry Index.

Is ERNIE 5.0 0110 or o3 better for coding?

o3 scores higher on coding benchmarks: 46.8 versus 43.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and o3 share?

18 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and o3 has 63.

Related comparisons

Go deeper