Noometry

Model comparison

Gemma 4 31B IT vs MiMo-V2.5

Gemma 4 31B IT and MiMo-V2.5 score almost the same on the Noometry Index (43.5 vs 43.4), so choose on price, context window or the category you care about most.

Last verified . 19 shared benchmarks.

Gemma 4 31B IT Google

43.5

Rank #90 Confirmed

MiMo-V2.5 Xiaomi

43.4

Rank #93 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemma 4 31B IT scores higher in 4 categories and MiMo-V2.5 in 5 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemma 4 31B IT leads 43.2 to 36.8.
  • Gemma 4 31B IT is cheaper at $0.09 / $0.34 per million input/output tokens, against $0.14 / $0.28 for MiMo-V2.5.
  • MiMo-V2.5 accepts more context: 1.05M tokens versus 262K.

Side by side

Gemma 4 31B ITMiMo-V2.5
ProviderGoogleXiaomi
Noometry Index43.543.4
Released2026-04-022026-04-22
WeightsOpenOpen
Context window262K1.05M
Max output33K131K
Input $ / M tokens$0.09$0.14
Output $ / M tokens$0.34$0.28
Results tracked3523

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.5 leads

Gemma 4 31B IT: 42.3 (#108), MiMo-V2.5: 43.9 (#81)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena WebDev13661438
SciCode43.4%43.1%
LMArena Coding14591469
ALE-Bench925.5513.95
WeirdML52.3%—

Reasoning MiMo-V2.5 leads

Gemma 4 31B IT: 27.2 (#122), MiMo-V2.5: 28.6 (#101)

BenchmarkGemma 4 31B ITMiMo-V2.5
CritPt1.4%3.7%
LMArena Hard Prompts14481450
Kagi LLM Benchmark63.5%—
NYT Connections (extended)70.6%—
Chess Puzzles5%—
Thematic Generalization53%—
DTBench82.7%—
LMCA39.3%—
Surface Evolver Bench30.6%—
Epoch Capabilities Index142.74—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 43.2 (#81), MiMo-V2.5: 36.8 (#163)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena Math14651436
OTIS Mock AIME 2024-202573.3%—
ProofBench—16%

Knowledge MiMo-V2.5 leads

Gemma 4 31B IT: 37.9 (#151), MiMo-V2.5: 40.8 (#115)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena Expert14651460
GPQA Diamond75.8%—
SimpleQA Verified10.4%—
Vectara Hallucination Rate7.4%—

Multimodal Gemma 4 31B IT leads

Gemma 4 31B IT: 41.6 (#34), MiMo-V2.5: 39.8 (#54)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena Vision12771247
LMArena Document1425—

Multilingual Gemma 4 31B IT leads

Gemma 4 31B IT: 53.8 (#57), MiMo-V2.5: 51.9 (#99)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena Non-English14311404
LMArena Chinese14761468
LMArena French14351447
LMArena Russian14601395
LMArena Spanish14441416
LMArena German—1421
LMArena Japanese—1306
LMArena Korean—1363

Instruction Following Too close to call

Gemma 4 31B IT: 75.5 (#61), MiMo-V2.5: 75.5 (#60)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena Instruction Following14331434

Long Context Too close to call

Gemma 4 31B IT: 44.2 (#71), MiMo-V2.5: 44.2 (#73)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena Longer Query14461445

Writing & Preference MiMo-V2.5 leads

Gemma 4 31B IT: 60.5 (#96), MiMo-V2.5: 61.6 (#86)

BenchmarkGemma 4 31B ITMiMo-V2.5
LMArena Text14431428
LMArena Creative Writing14151393
LMArena Multi-Turn14521445
EQ-Bench Creative Writing1368—
EQ-Bench 41120—

Frequently asked questions

Is Gemma 4 31B IT better than MiMo-V2.5?

Gemma 4 31B IT and MiMo-V2.5 score almost the same on the Noometry Index (43.5 vs 43.4), so choose on price, context window or the category you care about most.

Which is cheaper, Gemma 4 31B IT or MiMo-V2.5?

Gemma 4 31B IT is cheaper. It lists at $0.09 per million input tokens and $0.34 per million output tokens; MiMo-V2.5 lists at $0.14 and $0.28.

Is Gemma 4 31B IT or MiMo-V2.5 better for coding?

MiMo-V2.5 scores higher on coding benchmarks: 43.9 versus 42.3 in the Noometry coding category.

Which has the bigger context window?

MiMo-V2.5 does, with 1.05M tokens against 262K.

How many benchmarks do Gemma 4 31B IT and MiMo-V2.5 share?

19 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and MiMo-V2.5 has 23.

Related comparisons

Go deeper