Noometry

Model comparison

Gemma 2B vs Kimi K2.7 Code

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 29.6 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

Kimi K2.7 Code Moonshot AI

43.3

Rank #94 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemma 2B scores higher in 0 categories and Kimi K2.7 Code in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2.7 Code leads 52.9 to 30.0.

Side by side

Gemma 2BKimi K2.7 Code
ProviderGoogleMoonshot AI
Noometry Index29.643.3
Released2024-02-212026-06-12
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.95
Output $ / M tokens—$4
Results tracked2319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.7 Code leads

Gemma 2B: 29.4 (#305), Kimi K2.7 Code: 42.9 (#95)

BenchmarkGemma 2BKimi K2.7 Code
DeepSWE—30.5%
FrontierCode—30.1%
LMArena WebDev—1473
SciCode—47.5%
WeirdML—54.1%
LMArena Coding1010—
ALE-Bench—886.23
HumanEval+20.7%—
MBPP+34.1%—

Agentic & Tool Use Not comparable

Gemma 2B: —, Kimi K2.7 Code: 24.0 (#122)

BenchmarkGemma 2BKimi K2.7 Code
APEX-Agents—37.6%
GBAEval—0.9%
Vending-Bench 2—5,083

Reasoning Kimi K2.7 Code leads

Gemma 2B: 18.8 (#275), Kimi K2.7 Code: 39.0 (#61)

BenchmarkGemma 2BKimi K2.7 Code
Epoch Capabilities Index94.2149.97
SimpleBench—57.9%
CritPt—10%
Chess Puzzles—21%
LMArena Hard Prompts989—
Surface Evolver Bench—48.8%
BIG-Bench Hard35.2%—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Kimi K2.7 Code leads

Gemma 2B: 30.0 (#239), Kimi K2.7 Code: 52.9 (#48)

BenchmarkGemma 2BKimi K2.7 Code
FrontierMath (Tiers 1-3)—54%
FrontierMath Tier 4—12.2%
OTIS Mock AIME 2024-2025—95.6%
LMArena Math1009—
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, Kimi K2.7 Code: 53.5 (#57)

BenchmarkGemma 2BKimi K2.7 Code
GPQA Diamond—87.9%
SimpleQA Verified—36.5%
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multilingual Not comparable

Gemma 2B: 23.0 (#294), Kimi K2.7 Code: —

BenchmarkGemma 2BKimi K2.7 Code
LMArena Non-English958—
LMArena Chinese986—
LMArena Russian937—

Instruction Following Not comparable

Gemma 2B: 48.5 (#302), Kimi K2.7 Code: —

BenchmarkGemma 2BKimi K2.7 Code
LMArena Instruction Following970—

Long Context Not comparable

Gemma 2B: 29.9 (#291), Kimi K2.7 Code: —

BenchmarkGemma 2BKimi K2.7 Code
LMArena Longer Query981—

Writing & Preference Not comparable

Gemma 2B: 24.0 (#308), Kimi K2.7 Code: —

BenchmarkGemma 2BKimi K2.7 Code
LMArena Text1002—
LMArena Creative Writing987—
LMArena Multi-Turn945—

Frequently asked questions

Is Gemma 2B better than Kimi K2.7 Code?

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 29.6 on the Noometry Index.

Is Gemma 2B or Kimi K2.7 Code better for coding?

Kimi K2.7 Code scores higher on coding benchmarks: 42.9 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2B and Kimi K2.7 Code share?

1 benchmark has published results for both models. Gemma 2B has 23 scored results on Noometry and Kimi K2.7 Code has 19.

Related comparisons

Go deeper