Noometry

Model comparison

Gemini 1.0 Pro vs Kimi K3

Kimi K3 is the stronger model overall, scoring 59.5 to 27.3 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Kimi K3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K3 leads 74.2 to 9.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemini 1.0 Pro and 97.2% for Kimi K3.
  • Kimi K3 has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 ProKimi K3
ProviderGoogleMoonshot AI
Noometry Index27.359.5
Released2023-12-132026-07-16
WeightsProprietaryOpen
Context window—1.05M
Max output—1.05M
Input $ / M tokens—$3
Output $ / M tokens—$15
Results tracked2453

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K3 leads

Gemini 1.0 Pro: 32.2 (#275), Kimi K3: 61.0 (#10)

BenchmarkGemini 1.0 ProKimi K3
LMArena Coding11081508
DeepSWE—68.5%
FrontierCode—44.2%
LMArena WebDev—1654
FrontierSWE—25.9%
SciCode—59.5%
WeirdML—82.6%
ALE-Bench—1,524
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, Kimi K3: 41.8 (#20)

BenchmarkGemini 1.0 ProKimi K3
APEX-Agents—50.6%
τ²-bench Banking—37.1%
PostTrainBench—32%
GBAEval—48.3%
GDP.pdf—19%
Vending-Bench 2—5,165

Reasoning Kimi K3 leads

Gemini 1.0 Pro: 17.1 (#296), Kimi K3: 63.0 (#17)

BenchmarkGemini 1.0 ProKimi K3
LMArena Hard Prompts11091496
DTBench45.9%91.2%
Epoch Capabilities Index117.04157.45
ARC-AGI-2—60.4%
SimpleBench—60.7%
NYT Connections (extended)—93.6%
ARC-AGI-1—94.5%
CritPt—23.4%
Chess Puzzles—39%
Mystery Game Puzzles—26%
LMCA—52.7%
Surface Evolver Bench—95%
ForecastBench—61.1

Math Kimi K3 leads

Gemini 1.0 Pro: 9.3 (#321), Kimi K3: 74.2 (#16)

BenchmarkGemini 1.0 ProKimi K3
OTIS Mock AIME 2024-20251.1%97.2%
LMArena Math11321491
FrontierMath (Tiers 1-3)—72.2%
FrontierMath Tier 4—39%
MathArena Final-Answer Competitions—87.8%
ProofBench—87%
MATH Level 511.2%—

Knowledge Kimi K3 leads

Gemini 1.0 Pro: 15.6 (#291), Kimi K3: 63.2 (#21)

BenchmarkGemini 1.0 ProKimi K3
GPQA Diamond34%93.1%
LMArena Expert10591521
SimpleQA Verified—50.6%
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, Kimi K3: 37.8 (#70)

BenchmarkGemini 1.0 ProKimi K3
Blueprint-Bench 2—29.5%
Furniture Assembly—34.2%

Multilingual Kimi K3 leads

Gemini 1.0 Pro: 33.4 (#252), Kimi K3: 56.3 (#21)

BenchmarkGemini 1.0 ProKimi K3
LMArena Non-English11381466
LMArena Chinese11241529
LMArena French11451491
LMArena German11251488
LMArena Japanese10231487
LMArena Russian11861482
LMArena Spanish11191472
LMArena Korean—1458

Instruction Following Kimi K3 leads

Gemini 1.0 Pro: 57.6 (#267), Kimi K3: 77.7 (#14)

BenchmarkGemini 1.0 ProKimi K3
LMArena Instruction Following11141483

Long Context Kimi K3 leads

Gemini 1.0 Pro: 34.3 (#249), Kimi K3: 45.8 (#29)

BenchmarkGemini 1.0 ProKimi K3
LMArena Longer Query11321494

Writing & Preference Kimi K3 leads

Gemini 1.0 Pro: 36.0 (#264), Kimi K3: 76.6 (#4)

BenchmarkGemini 1.0 ProKimi K3
LMArena Text11491476
LMArena Creative Writing11311454
LMArena Multi-Turn11391488
EQ-Bench Creative Writing—2082
EQ-Bench 4—1339

Frequently asked questions

Is Gemini 1.0 Pro better than Kimi K3?

Kimi K3 is the stronger model overall, scoring 59.5 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Kimi K3 better for coding?

Kimi K3 scores higher on coding benchmarks: 61.0 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Kimi K3 share?

20 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Kimi K3 has 53.

Related comparisons

Go deeper