Noometry

Model comparison

ERNIE 5.1 vs Gemini 3.8 Flash

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 43.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.1 scores higher in 0 categories and Gemini 3.8 Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.8 Flash leads 76.9 to 21.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 97.4% for Gemini 3.8 Flash.

Side by side

ERNIE 5.1Gemini 3.8 Flash
ProviderBaiduGoogle
Noometry Index43.861.8
Released—2026-09-02
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked1950

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

ERNIE 5.1: 44.0 (#76), Gemini 3.8 Flash: 59.2 (#15)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Coding14881510
DeepSWE—73.8%
FrontierCode—41.2%
CursorBench—39.6%
LMArena WebDev—1584
FrontierSWE—19.6%
SciCode—56.6%
WeirdML—84.8%
ALE-Bench—1,270

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Gemini 3.8 Flash: 41.8 (#21)

BenchmarkERNIE 5.1Gemini 3.8 Flash
APEX-Agents—64.3%
Remote Labor Index—5.8%
GDP.pdf—23.4%
LMArena Search1227—
Vending-Bench 2—5,094

Reasoning Gemini 3.8 Flash leads

ERNIE 5.1: 21.9 (#211), Gemini 3.8 Flash: 76.9 (#5)

BenchmarkERNIE 5.1Gemini 3.8 Flash
NYT Connections (extended)23.4%97.4%
LMArena Hard Prompts14811508
ARC-AGI-2—89.2%
ARC-AGI-1—98.5%
CritPt—18.3%
Chess Puzzles—61%
Mystery Game Puzzles—47%
DTBench—95.7%
LMCA—52.9%
Surface Evolver Bench—76.9%
Epoch Capabilities Index—156.71

Math Gemini 3.8 Flash leads

ERNIE 5.1: 40.3 (#92), Gemini 3.8 Flash: 65.3 (#28)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Math14811528
FrontierMath (Tiers 1-3)—68.4%
FrontierMath Tier 4—22%
OTIS Mock AIME 2024-2025—98.9%
ProofBench—48%

Knowledge Gemini 3.8 Flash leads

ERNIE 5.1: 41.9 (#102), Gemini 3.8 Flash: 74.8 (#2)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Expert14921524
GPQA Diamond—95.4%
Humanity's Last Exam—44.5%
SimpleQA Verified—69.7%

Multimodal Not comparable

ERNIE 5.1: —, Gemini 3.8 Flash: 40.7 (#45)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Vision—1314
Blueprint-Bench 2—38.6%
Furniture Assembly—31.7%

Multilingual Gemini 3.8 Flash leads

ERNIE 5.1: 55.5 (#29), Gemini 3.8 Flash: 58.0 (#5)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Non-English14541491
LMArena Chinese15081554
LMArena French14881498
LMArena German14701493
LMArena Japanese14221502
LMArena Korean14271459
LMArena Russian14591515
LMArena Spanish14731485

Instruction Following Gemini 3.8 Flash leads

ERNIE 5.1: 76.7 (#37), Gemini 3.8 Flash: 78.0 (#13)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Instruction Following14601490

Long Context Gemini 3.8 Flash leads

ERNIE 5.1: 44.7 (#59), Gemini 3.8 Flash: 46.3 (#24)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Longer Query14621508

Writing & Preference Gemini 3.8 Flash leads

ERNIE 5.1: 65.1 (#52), Gemini 3.8 Flash: 72.2 (#15)

BenchmarkERNIE 5.1Gemini 3.8 Flash
LMArena Text14681499
LMArena Creative Writing14411492
LMArena Multi-Turn14711501
EQ-Bench Creative Writing—1748

Frequently asked questions

Is ERNIE 5.1 better than Gemini 3.8 Flash?

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 43.8 on the Noometry Index.

Is ERNIE 5.1 or Gemini 3.8 Flash better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 59.2 versus 44.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Gemini 3.8 Flash share?

18 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Gemini 3.8 Flash has 50.

Related comparisons

Go deeper