Noometry

Model comparison

ERNIE 5.1 vs Grok 4.5

Grok 4.5 is the stronger model overall, scoring 55.0 to 43.8 on the Noometry Index.

Last verified . 19 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Summary

  • They share 19 benchmarks with published results for both. ERNIE 5.1 scores higher in 2 categories and Grok 4.5 in 6 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.5 leads 56.1 to 21.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 79.9% for Grok 4.5.

Side by side

ERNIE 5.1Grok 4.5
ProviderBaiduxAI
Noometry Index43.855.0
Released—2026-07-08
WeightsProprietaryProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked1952

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

ERNIE 5.1: 44.0 (#76), Grok 4.5: 52.2 (#35)

BenchmarkERNIE 5.1Grok 4.5
LMArena Coding14881474
DeepSWE—53.8%
FrontierCode—42.4%
LMArena WebDev—1553
SciCode—54.1%
WeirdML—46.4%
ALE-Bench—1,309

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Grok 4.5: 44.4 (#17)

BenchmarkERNIE 5.1Grok 4.5
LMArena Search12271213
APEX-Agents—56.2%
τ²-bench Banking—47.9%
PostTrainBench—23.4%
GBAEval—65.4%
GDP.pdf—14%
Vending-Bench 2—3,887

Reasoning Grok 4.5 leads

ERNIE 5.1: 21.9 (#211), Grok 4.5: 56.1 (#25)

BenchmarkERNIE 5.1Grok 4.5
NYT Connections (extended)23.4%79.9%
LMArena Hard Prompts14811462
ARC-AGI-2—52.6%
SimpleBench—70%
Kagi LLM Benchmark—83.5%
ARC-AGI-1—87.2%
CritPt—15.4%
Chess Puzzles—36%
DTBench—96.5%
LMCA—45.2%
Surface Evolver Bench—74.4%
Epoch Capabilities Index—153.92

Math Grok 4.5 leads

ERNIE 5.1: 40.3 (#92), Grok 4.5: 60.9 (#35)

BenchmarkERNIE 5.1Grok 4.5
LMArena Math14811459
FrontierMath (Tiers 1-3)—57.2%
FrontierMath Tier 4—24.4%
OTIS Mock AIME 2024-2025—97.8%
ProofBench—31%

Knowledge Grok 4.5 leads

ERNIE 5.1: 41.9 (#102), Grok 4.5: 62.3 (#24)

BenchmarkERNIE 5.1Grok 4.5
LMArena Expert14921466
GPQA Diamond—93.4%
SimpleQA Verified—48.3%

Multimodal Not comparable

ERNIE 5.1: —, Grok 4.5: 37.6 (#72)

BenchmarkERNIE 5.1Grok 4.5
LMArena Vision—1288
Blueprint-Bench 2—27.3%
Furniture Assembly—22.5%
LMArena Document—1452

Multilingual ERNIE 5.1 leads

ERNIE 5.1: 55.5 (#29), Grok 4.5: 54.4 (#42)

BenchmarkERNIE 5.1Grok 4.5
LMArena Non-English14541440
LMArena Chinese15081496
LMArena French14881456
LMArena German14701446
LMArena Japanese14221428
LMArena Korean14271404
LMArena Russian14591448
LMArena Spanish14731450

Instruction Following Too close to call

ERNIE 5.1: 76.7 (#37), Grok 4.5: 76.0 (#48)

BenchmarkERNIE 5.1Grok 4.5
LMArena Instruction Following14601446

Long Context Too close to call

ERNIE 5.1: 44.7 (#59), Grok 4.5: 44.8 (#56)

BenchmarkERNIE 5.1Grok 4.5
LMArena Longer Query14621463

Writing & Preference Too close to call

ERNIE 5.1: 65.1 (#52), Grok 4.5: 65.8 (#42)

BenchmarkERNIE 5.1Grok 4.5
LMArena Text14681448
LMArena Creative Writing14411442
LMArena Multi-Turn14711456
EQ-Bench Creative Writing—1579

Frequently asked questions

Is ERNIE 5.1 better than Grok 4.5?

Grok 4.5 is the stronger model overall, scoring 55.0 to 43.8 on the Noometry Index.

Is ERNIE 5.1 or Grok 4.5 better for coding?

Grok 4.5 scores higher on coding benchmarks: 52.2 versus 44.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Grok 4.5 share?

19 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Grok 4.5 has 52.

Related comparisons

Go deeper