Noometry

Model comparison

Gemma 4 31B IT vs Kimi K2.5 Instant

Gemma 4 31B IT and Kimi K2.5 Instant score almost the same on the Noometry Index (43.5 vs 43.6), so choose on price, context window or the category you care about most.

Last verified . 16 shared benchmarks.

Gemma 4 31B IT Google

43.5

Rank #90 Confirmed

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemma 4 31B IT scores higher in 5 categories and Kimi K2.5 Instant in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemma 4 31B IT leads 43.2 to 39.4.

Side by side

Gemma 4 31B ITKimi K2.5 Instant
ProviderGoogleMoonshot AI
Noometry Index43.543.6
Released2026-04-02—
WeightsOpenOpen
Context window262K—
Max output33K—
Input $ / M tokens$0.09—
Output $ / M tokens$0.34—
Results tracked3518

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemma 4 31B IT: 42.3 (#108), Kimi K2.5 Instant: 42.6 (#97)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena WebDev13661404
LMArena Coding14591484
SciCode43.4%—
WeirdML52.3%—
ALE-Bench925.5—

Reasoning Kimi K2.5 Instant leads

Gemma 4 31B IT: 27.2 (#122), Kimi K2.5 Instant: 29.7 (#90)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Hard Prompts14481443
Kagi LLM Benchmark63.5%—
NYT Connections (extended)70.6%—
CritPt1.4%—
Chess Puzzles5%—
Thematic Generalization53%—
DTBench82.7%—
LMCA39.3%—
Surface Evolver Bench30.6%—
Epoch Capabilities Index142.74—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 43.2 (#81), Kimi K2.5 Instant: 39.4 (#105)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Math14651442
OTIS Mock AIME 2024-202573.3%—

Knowledge Kimi K2.5 Instant leads

Gemma 4 31B IT: 37.9 (#151), Kimi K2.5 Instant: 40.2 (#123)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Expert14651440
GPQA Diamond75.8%—
SimpleQA Verified10.4%—
Vectara Hallucination Rate7.4%—

Multimodal Gemma 4 31B IT leads

Gemma 4 31B IT: 41.6 (#34), Kimi K2.5 Instant: 40.2 (#50)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Vision12771254
LMArena Document1425—

Multilingual Gemma 4 31B IT leads

Gemma 4 31B IT: 53.8 (#57), Kimi K2.5 Instant: 52.0 (#94)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Non-English14311406
LMArena Chinese14761449
LMArena French14351403
LMArena Russian14601404
LMArena Spanish14441447
LMArena German—1413
LMArena Korean—1378

Instruction Following Too close to call

Gemma 4 31B IT: 75.5 (#61), Kimi K2.5 Instant: 75.3 (#65)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Instruction Following14331430

Long Context Too close to call

Gemma 4 31B IT: 44.2 (#71), Kimi K2.5 Instant: 43.9 (#83)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Longer Query14461435

Writing & Preference Too close to call

Gemma 4 31B IT: 60.5 (#96), Kimi K2.5 Instant: 60.6 (#95)

BenchmarkGemma 4 31B ITKimi K2.5 Instant
LMArena Text14431420
LMArena Creative Writing14151381
LMArena Multi-Turn14521427
EQ-Bench Creative Writing1368—
EQ-Bench 41120—

Frequently asked questions

Is Gemma 4 31B IT better than Kimi K2.5 Instant?

Gemma 4 31B IT and Kimi K2.5 Instant score almost the same on the Noometry Index (43.5 vs 43.6), so choose on price, context window or the category you care about most.

Is Gemma 4 31B IT or Kimi K2.5 Instant better for coding?

They score almost the same on coding (42.3 vs 42.6); test both on your own repository before choosing.

How many benchmarks do Gemma 4 31B IT and Kimi K2.5 Instant share?

16 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and Kimi K2.5 Instant has 18.

Related comparisons

Go deeper