Noometry

Model comparison

ERNIE 5.0 0110 vs o4-mini

ERNIE 5.0 0110 and o4-mini score almost the same on the Noometry Index (41.8 vs 41.6), so choose on price, context window or the category you care about most.

Last verified . 18 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

o4-mini OpenAI

41.6

Rank #132 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 3 categories and o4-mini in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 54.0.

Side by side

ERNIE 5.0 0110o4-mini
ProviderBaiduOpenAI
Noometry Index41.841.6
Released—2025-04-16
WeightsProprietaryProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$1.10
Output $ / M tokens—$4.40
Results tracked2060

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), o4-mini: 40.9 (#127)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Coding14551368
SWE-bench Verified (bash only)—45%
Aider Polyglot—72%
GSO—3.6%
WeirdML—52.6%
CadEval—62%
ALE-Bench—826.17
AlgoTune—1.72

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, o4-mini: 32.6 (#61)

BenchmarkERNIE 5.0 0110o4-mini
Berkeley Function Calling Leaderboard—53.2%
GDPval—25.3%
METR Time Horizons—63.9%

Reasoning o4-mini leads

ERNIE 5.0 0110: 17.0 (#297), o4-mini: 24.6 (#162)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Hard Prompts14451351
ARC-AGI-2—6.1%
SimpleBench—38.7%
Kagi LLM Benchmark—67.6%
NYT Connections (extended)10.3%—
ARC-AGI-1—58.7%
CritPt—0.6%
Chess Puzzles—26%
EnigmaEval—9.2%
Thematic Generalization41.7%—
Mystery Game Puzzles—5%
DTBench—77.6%
LMCA—26.5%
Epoch Capabilities Index—145.64
ForecastBench—61.8

Math o4-mini leads

ERNIE 5.0 0110: 39.3 (#110), o4-mini: 40.8 (#89)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Math14371389
FrontierMath (Tiers 1-3)—36.1%
FrontierMath Tier 4—4.9%
OTIS Mock AIME 2024-2025—81.7%
Omni-MATH—72%
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—24.8%
FrontierMath Tier 4 (v1)—6.3%

Knowledge o4-mini leads

ERNIE 5.0 0110: 39.8 (#128), o4-mini: 43.6 (#91)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Expert14281343
GPQA Diamond—79.6%
Humanity's Last Exam—18.1%
SimpleQA Verified—19.6%
MMLU-Pro—82%
Confabulations—15.8%
Vectara Hallucination Rate—18.6%
GPQA (HELM)—73.5%

Multimodal Too close to call

ERNIE 5.0 0110: 39.9 (#53), o4-mini: 40.2 (#49)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Vision12491194
GeoBench—64%
VPCT—57.5%

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), o4-mini: 47.0 (#154)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Non-English14361337
LMArena Chinese15121354
LMArena French14671364
LMArena German14601336
LMArena Japanese13821308
LMArena Korean14061312
LMArena Russian14461334
LMArena Spanish14731347

Instruction Following Too close to call

ERNIE 5.0 0110: 74.5 (#92), o4-mini: 75.2 (#68)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Instruction Following14131321
IFEval—92.8%

Long Context o4-mini leads

ERNIE 5.0 0110: 43.4 (#95), o4-mini: 45.5 (#33)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Longer Query14221315
Fiction.LiveBench—77.8%

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), o4-mini: 54.0 (#152)

BenchmarkERNIE 5.0 0110o4-mini
LMArena Text14451353
LMArena Creative Writing14261294
LMArena Multi-Turn14341350
Short-Story Creative Writing—75%
WildBench—85.4%

Frequently asked questions

Is ERNIE 5.0 0110 better than o4-mini?

ERNIE 5.0 0110 and o4-mini score almost the same on the Noometry Index (41.8 vs 41.6), so choose on price, context window or the category you care about most.

Is ERNIE 5.0 0110 or o4-mini better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 40.9 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and o4-mini share?

18 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and o4-mini has 60.

Related comparisons

Go deeper