Model comparison

ERNIE 5.0 0110 vs Gemma 4 31B IT

Gemma 4 31B IT is the stronger model overall, scoring 43.5 to 41.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Gemma 4 31B IT Google

43.5

Rank #90 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 4 categories and Gemma 4 31B IT in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemma 4 31B IT leads 27.2 to 17.0.
  • The biggest single-benchmark swing is NYT Connections (extended): 10.3% for ERNIE 5.0 0110 and 70.6% for Gemma 4 31B IT.
  • Gemma 4 31B IT has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110 and Gemma 4 31B IT specifications
ERNIE 5.0 0110Gemma 4 31B IT
ProviderBaiduGoogle
Noometry Index41.843.5
Released—2026-04-02
WeightsProprietaryOpen
Context window—262K
Max output—33K
Input $ / M tokens—$0.09
Output $ / M tokens—$0.34
Results tracked2035

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

ERNIE 5.0 0110: 43.0 (#94), Gemma 4 31B IT: 42.3 (#108)

Coding benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Coding14551459
LMArena WebDev—1366
SciCode—43.4%
WeirdML—52.3%
ALE-Bench—925.5

Reasoning Gemma 4 31B IT leads

ERNIE 5.0 0110: 17.0 (#297), Gemma 4 31B IT: 27.2 (#122)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
NYT Connections (extended)10.3%70.6%
Thematic Generalization41.7%53%
LMArena Hard Prompts14451448
Kagi LLM Benchmark—63.5%
CritPt—1.4%
Chess Puzzles—5%
DTBench—82.7%
LMCA—39.3%
Surface Evolver Bench—30.6%
Epoch Capabilities Index—142.74

Math Gemma 4 31B IT leads

ERNIE 5.0 0110: 39.3 (#110), Gemma 4 31B IT: 43.2 (#81)

Math benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Math14371465
OTIS Mock AIME 2024-2025—73.3%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Gemma 4 31B IT: 37.9 (#151)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Expert14281465
GPQA Diamond—75.8%
SimpleQA Verified—10.4%
Vectara Hallucination Rate—7.4%

Multimodal Gemma 4 31B IT leads

ERNIE 5.0 0110: 39.9 (#53), Gemma 4 31B IT: 41.6 (#34)

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Vision12491277
LMArena Document—1425

Multilingual Too close to call

ERNIE 5.0 0110: 54.1 (#49), Gemma 4 31B IT: 53.8 (#57)

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Non-English14361431
LMArena Chinese15121476
LMArena French14671435
LMArena Russian14461460
LMArena Spanish14731444
LMArena German1460—
LMArena Japanese1382—
LMArena Korean1406—

Instruction Following Too close to call

ERNIE 5.0 0110: 74.5 (#92), Gemma 4 31B IT: 75.5 (#61)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Instruction Following14131433

Long Context Too close to call

ERNIE 5.0 0110: 43.4 (#95), Gemma 4 31B IT: 44.2 (#71)

Long Context benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Longer Query14221446

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Gemma 4 31B IT: 60.5 (#96)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Gemma 4 31B IT
LMArena Text14451443
LMArena Creative Writing14261415
LMArena Multi-Turn14341452
EQ-Bench Creative Writing—1368
EQ-Bench 4—1120

Frequently asked questions

Is ERNIE 5.0 0110 better than Gemma 4 31B IT?

Gemma 4 31B IT is the stronger model overall, scoring 43.5 to 41.8 on the Noometry Index.

Is ERNIE 5.0 0110 or Gemma 4 31B IT better for coding?

They score almost the same on coding (43.0 vs 42.3); test both on your own repository before choosing.

How many benchmarks do ERNIE 5.0 0110 and Gemma 4 31B IT share?

17 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Gemma 4 31B IT has 35.

Related comparisons

Go deeper