Model comparison

Gemma 3 1B vs Kimi K3

Kimi K3 is the stronger model overall, scoring 59.5 to 21.1 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Kimi K3 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K3 leads 74.2 to 10.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 97.2% for Kimi K3.

Side by side

Gemma 3 1B and Kimi K3 specifications
Gemma 3 1BKimi K3
ProviderGoogleMoonshot AI
Noometry Index21.159.5
Released2025-03-122026-07-16
WeightsOpenOpen
Context window—1.05M
Max output—1.05M
Input $ / M tokens—$3
Output $ / M tokens—$15
Results tracked453

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Kimi K3: 61.0 (#10)

Coding benchmarks
BenchmarkGemma 3 1BKimi K3
DeepSWE—68.5%
FrontierCode—44.2%
LMArena WebDev—1654
FrontierSWE—25.9%
SciCode—59.5%
WeirdML—82.6%
LMArena Coding—1508
ALE-Bench—1,524

Agentic & Tool Use Kimi K3 leads

Gemma 3 1B: 13.7 (#152), Kimi K3: 41.8 (#20)

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BKimi K3
APEX-Agents—50.6%
Berkeley Function Calling Leaderboard7.2%—
τ²-bench Banking—37.1%
PostTrainBench—32%
GBAEval—48.3%
GDP.pdf—19%
Vending-Bench 2—5,165

Reasoning Kimi K3 leads

Gemma 3 1B: 19.2 (#264), Kimi K3: 63.0 (#17)

Reasoning benchmarks
BenchmarkGemma 3 1BKimi K3
Chess Puzzles0%39%
ARC-AGI-2—60.4%
SimpleBench—60.7%
NYT Connections (extended)—93.6%
ARC-AGI-1—94.5%
CritPt—23.4%
LMArena Hard Prompts—1496
Mystery Game Puzzles—26%
DTBench—91.2%
LMCA—52.7%
Surface Evolver Bench—95%
Epoch Capabilities Index—157.45
ForecastBench—61.1

Math Kimi K3 leads

Gemma 3 1B: 10.2 (#316), Kimi K3: 74.2 (#16)

Math benchmarks
BenchmarkGemma 3 1BKimi K3
OTIS Mock AIME 2024-20251.1%97.2%
FrontierMath (Tiers 1-3)—72.2%
FrontierMath Tier 4—39%
MathArena Final-Answer Competitions—87.8%
ProofBench—87%
LMArena Math—1491

Knowledge Kimi K3 leads

Gemma 3 1B: 7.0 (#314), Kimi K3: 63.2 (#21)

Knowledge benchmarks
BenchmarkGemma 3 1BKimi K3
GPQA Diamond19.9%93.1%
SimpleQA Verified—50.6%
LMArena Expert—1521

Multimodal Not comparable

Gemma 3 1B: —, Kimi K3: 37.8 (#70)

Multimodal benchmarks
BenchmarkGemma 3 1BKimi K3
Blueprint-Bench 2—29.5%
Furniture Assembly—34.2%

Multilingual Not comparable

Gemma 3 1B: —, Kimi K3: 56.3 (#21)

Multilingual benchmarks
BenchmarkGemma 3 1BKimi K3
LMArena Non-English—1466
LMArena Chinese—1529
LMArena French—1491
LMArena German—1488
LMArena Japanese—1487
LMArena Korean—1458
LMArena Russian—1482
LMArena Spanish—1472

Instruction Following Not comparable

Gemma 3 1B: —, Kimi K3: 77.7 (#14)

Instruction Following benchmarks
BenchmarkGemma 3 1BKimi K3
LMArena Instruction Following—1483

Long Context Not comparable

Gemma 3 1B: —, Kimi K3: 45.8 (#29)

Long Context benchmarks
BenchmarkGemma 3 1BKimi K3
LMArena Longer Query—1494

Writing & Preference Not comparable

Gemma 3 1B: —, Kimi K3: 76.6 (#4)

Writing & Preference benchmarks
BenchmarkGemma 3 1BKimi K3
LMArena Text—1476
LMArena Creative Writing—1454
EQ-Bench Creative Writing—2082
EQ-Bench 4—1339
LMArena Multi-Turn—1488

Frequently asked questions

Is Gemma 3 1B better than Kimi K3?

Kimi K3 is the stronger model overall, scoring 59.5 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Kimi K3 share?

3 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Kimi K3 has 53.

Related comparisons

Go deeper