Noometry

Model comparison

Gemini 2.5 Flash vs Yi-34B

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 27.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 7 categories and Yi-34B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 2.5 Flash leads 36.4 to 7.5.
  • Yi-34B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 FlashYi-34B
ProviderGoogle01.AI
Noometry Index39.327.8
Released2025-04-172023-11-02
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5423

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash leads

Gemini 2.5 Flash: 35.8 (#220), Yi-34B: 32.3 (#274)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Coding14241112
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Yi-34B: —

BenchmarkGemini 2.5 FlashYi-34B
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Yi-34B leads

Gemini 2.5 Flash: 18.1 (#286), Yi-34B: 21.2 (#226)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Hard Prompts14221104
Epoch Capabilities Index143.03117.39
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
BIG-Bench Hard—71.7%
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 39.9 (#98), Yi-34B: 21.6 (#282)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Math14151114
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—
MATH Level 5—5.1%
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—
GSM8K—76%

Knowledge Gemini 2.5 Flash leads

Gemini 2.5 Flash: 36.4 (#168), Yi-34B: 7.5 (#309)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Expert14261061
GPQA Diamond—14.7%
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—
MMLU—76.3%

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Yi-34B: —

BenchmarkGemini 2.5 FlashYi-34B
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Gemini 2.5 Flash leads

Gemini 2.5 Flash: 52.3 (#88), Yi-34B: 29.7 (#264)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Non-English14091079
LMArena Chinese14501176
LMArena French14331081
LMArena German14181042
LMArena Japanese1405993
LMArena Korean1385959
LMArena Russian14151050
LMArena Spanish14211070

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Yi-34B: 56.2 (#274)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Instruction Following14051091
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Yi-34B: 33.2 (#264)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Longer Query14191094
Fiction.LiveBench77.8%—

Writing & Preference Gemini 2.5 Flash leads

Gemini 2.5 Flash: 53.8 (#157), Yi-34B: 34.1 (#273)

BenchmarkGemini 2.5 FlashYi-34B
LMArena Text14171129
LMArena Creative Writing14001108
LMArena Multi-Turn14081113
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Yi-34B?

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 27.8 on the Noometry Index.

Is Gemini 2.5 Flash or Yi-34B better for coding?

Gemini 2.5 Flash scores higher on coding benchmarks: 35.8 versus 32.3 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Yi-34B share?

18 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper