Noometry

Model comparison

ERNIE 5.1 vs Gemini 3.7 Flash

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 43.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Gemini 3.7 Flash Google

59.8

Rank #14 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.1 scores higher in 0 categories and Gemini 3.7 Flash in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.7 Flash leads 70.0 to 21.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 94% for Gemini 3.7 Flash.

Side by side

ERNIE 5.1Gemini 3.7 Flash
ProviderBaiduGoogle
Noometry Index43.859.8
Released—2026-08-13
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked1944

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

ERNIE 5.1: 44.0 (#76), Gemini 3.7 Flash: 56.2 (#22)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Coding14881497
DeepSWE—65.5%
FrontierCode—43.6%
LMArena WebDev—1592
FrontierSWE—20.3%
SciCode—59.8%
ALE-Bench—904.3

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Gemini 3.7 Flash: 42.1 (#19)

BenchmarkERNIE 5.1Gemini 3.7 Flash
APEX-Agents—67.8%
Remote Labor Index—5%
GDP.pdf—23.8%
LMArena Search1227—

Reasoning Gemini 3.7 Flash leads

ERNIE 5.1: 21.9 (#211), Gemini 3.7 Flash: 70.0 (#15)

BenchmarkERNIE 5.1Gemini 3.7 Flash
NYT Connections (extended)23.4%94%
LMArena Hard Prompts14811494
ARC-AGI-2—84.6%
ARC-AGI-1—95.5%
CritPt—14.3%
Chess Puzzles—47%
Mystery Game Puzzles—37%
DTBench—96.8%
LMCA—50.4%
Epoch Capabilities Index—157.27

Math Gemini 3.7 Flash leads

ERNIE 5.1: 40.3 (#92), Gemini 3.7 Flash: 69.6 (#23)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Math14811507
FrontierMath (Tiers 1-3)—71.6%
FrontierMath Tier 4—36.6%
OTIS Mock AIME 2024-2025—97.2%
ProofBench—58%

Knowledge Gemini 3.7 Flash leads

ERNIE 5.1: 41.9 (#102), Gemini 3.7 Flash: 69.7 (#5)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Expert14921508
GPQA Diamond—94.8%
SimpleQA Verified—69.2%

Multimodal Not comparable

ERNIE 5.1: —, Gemini 3.7 Flash: 37.3 (#73)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Vision—1316
Furniture Assembly—26.7%

Multilingual Gemini 3.7 Flash leads

ERNIE 5.1: 55.5 (#29), Gemini 3.7 Flash: 57.6 (#7)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Non-English14541484
LMArena Chinese15081548
LMArena French14881505
LMArena German14701498
LMArena Japanese14221512
LMArena Korean14271483
LMArena Russian14591516
LMArena Spanish14731503

Instruction Following Gemini 3.7 Flash leads

ERNIE 5.1: 76.7 (#37), Gemini 3.7 Flash: 77.7 (#15)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Instruction Following14601483

Long Context Too close to call

ERNIE 5.1: 44.7 (#59), Gemini 3.7 Flash: 45.7 (#30)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Longer Query14621492

Writing & Preference Gemini 3.7 Flash leads

ERNIE 5.1: 65.1 (#52), Gemini 3.7 Flash: 71.2 (#20)

BenchmarkERNIE 5.1Gemini 3.7 Flash
LMArena Text14681486
LMArena Creative Writing14411490
LMArena Multi-Turn14711489
EQ-Bench Creative Writing—1723

Frequently asked questions

Is ERNIE 5.1 better than Gemini 3.7 Flash?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 43.8 on the Noometry Index.

Is ERNIE 5.1 or Gemini 3.7 Flash better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 56.2 versus 44.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Gemini 3.7 Flash share?

18 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Gemini 3.7 Flash has 44.

Related comparisons

Go deeper