Noometry

Model comparison

Gemini 1.5 Flash 8B vs Kimi K3

Kimi K3 is the stronger model overall, scoring 59.5 to 29.9 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Kimi K3 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K3 leads 74.2 to 14.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 97.2% for Kimi K3.
  • Kimi K3 has downloadable open weights; the other is API-only.

Side by side

Gemini 1.5 Flash 8BKimi K3
ProviderGoogleMoonshot AI
Noometry Index29.959.5
Released2024-10-032026-07-16
WeightsProprietaryOpen
Context window—1.05M
Max output—1.05M
Input $ / M tokens—$3
Output $ / M tokens—$15
Results tracked2153

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K3 leads

Gemini 1.5 Flash 8B: 35.5 (#225), Kimi K3: 61.0 (#10)

BenchmarkGemini 1.5 Flash 8BKimi K3
LMArena Coding12181508
DeepSWE—68.5%
FrontierCode—44.2%
LMArena WebDev—1654
FrontierSWE—25.9%
SciCode—59.5%
WeirdML—82.6%
ALE-Bench—1,524

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Kimi K3: 41.8 (#20)

BenchmarkGemini 1.5 Flash 8BKimi K3
APEX-Agents—50.6%
τ²-bench Banking—37.1%
PostTrainBench—32%
GBAEval—48.3%
GDP.pdf—19%
Vending-Bench 2—5,165

Reasoning Kimi K3 leads

Gemini 1.5 Flash 8B: 20.0 (#244), Kimi K3: 63.0 (#17)

BenchmarkGemini 1.5 Flash 8BKimi K3
LMArena Hard Prompts12091496
DTBench50%91.2%
ARC-AGI-2—60.4%
SimpleBench—60.7%
NYT Connections (extended)—93.6%
ARC-AGI-1—94.5%
CritPt—23.4%
Chess Puzzles—39%
Mystery Game Puzzles—26%
LMCA—52.7%
Surface Evolver Bench—95%
Epoch Capabilities Index—157.45
ForecastBench—61.1

Math Kimi K3 leads

Gemini 1.5 Flash 8B: 14.2 (#302), Kimi K3: 74.2 (#16)

BenchmarkGemini 1.5 Flash 8BKimi K3
OTIS Mock AIME 2024-20254.6%97.2%
LMArena Math12071491
FrontierMath (Tiers 1-3)—72.2%
FrontierMath Tier 4—39%
MathArena Final-Answer Competitions—87.8%
ProofBench—87%

Knowledge Kimi K3 leads

Gemini 1.5 Flash 8B: 16.0 (#289), Kimi K3: 63.2 (#21)

BenchmarkGemini 1.5 Flash 8BKimi K3
GPQA Diamond33%93.1%
LMArena Expert11851521
SimpleQA Verified—50.6%

Multimodal Kimi K3 leads

Gemini 1.5 Flash 8B: 28.2 (#115), Kimi K3: 37.8 (#70)

BenchmarkGemini 1.5 Flash 8BKimi K3
LMArena Vision1044—
Blueprint-Bench 2—29.5%
Furniture Assembly—34.2%

Multilingual Kimi K3 leads

Gemini 1.5 Flash 8B: 38.5 (#229), Kimi K3: 56.3 (#21)

BenchmarkGemini 1.5 Flash 8BKimi K3
LMArena Non-English12151466
LMArena Chinese12311529
LMArena French12341491
LMArena German12061488
LMArena Japanese11501487
LMArena Korean11401458
LMArena Russian12361482
LMArena Spanish12121472

Instruction Following Kimi K3 leads

Gemini 1.5 Flash 8B: 62.8 (#236), Kimi K3: 77.7 (#14)

BenchmarkGemini 1.5 Flash 8BKimi K3
LMArena Instruction Following11991483

Long Context Kimi K3 leads

Gemini 1.5 Flash 8B: 37.0 (#225), Kimi K3: 45.8 (#29)

BenchmarkGemini 1.5 Flash 8BKimi K3
LMArena Longer Query12191494

Writing & Preference Kimi K3 leads

Gemini 1.5 Flash 8B: 42.8 (#232), Kimi K3: 76.6 (#4)

BenchmarkGemini 1.5 Flash 8BKimi K3
LMArena Text12261476
LMArena Creative Writing12181454
LMArena Multi-Turn11851488
EQ-Bench Creative Writing—2082
EQ-Bench 4—1339

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Kimi K3?

Kimi K3 is the stronger model overall, scoring 59.5 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Kimi K3 better for coding?

Kimi K3 scores higher on coding benchmarks: 61.0 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Kimi K3 share?

20 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Kimi K3 has 53.

Related comparisons

Go deeper