Model comparison

Kimi K3 vs Phi 3 Medium 4k Instruct

Kimi K3 is the stronger model overall, scoring 59.5 to 33.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Phi 3 Medium 4k Instruct Microsoft

33.0

Rank #250 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Kimi K3 scores higher in 8 categories and Phi 3 Medium 4k Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K3 leads 76.6 to 34.1.

Side by side

Kimi K3 and Phi 3 Medium 4k Instruct specifications
Kimi K3Phi 3 Medium 4k Instruct
ProviderMoonshot AIMicrosoft
Noometry Index59.533.0
Released2026-07-16—
WeightsOpenOpen
Context window1.05M—
Max output1.05M—
Input $ / M tokens$3—
Output $ / M tokens$15—
Results tracked5317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K3 leads

Kimi K3: 61.0 (#10), Phi 3 Medium 4k Instruct: 32.9 (#268)

Coding benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Coding15081130
DeepSWE68.5%—
FrontierCode44.2%—
LMArena WebDev1654—
FrontierSWE25.9%—
SciCode59.5%—
WeirdML82.6%—
ALE-Bench1,524—

Agentic & Tool Use Not comparable

Kimi K3: 41.8 (#20), Phi 3 Medium 4k Instruct: —

Agentic & Tool Use benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
APEX-Agents50.6%—
τ²-bench Banking37.1%—
PostTrainBench32%—
GBAEval48.3%—
GDP.pdf19%—
Vending-Bench 25,165—

Reasoning Kimi K3 leads

Kimi K3: 63.0 (#17), Phi 3 Medium 4k Instruct: 21.7 (#214)

Reasoning benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Hard Prompts14961127
ARC-AGI-260.4%—
SimpleBench60.7%—
NYT Connections (extended)93.6%—
ARC-AGI-194.5%—
CritPt23.4%—
Chess Puzzles39%—
Mystery Game Puzzles26%—
DTBench91.2%—
LMCA52.7%—
Surface Evolver Bench95%—
Epoch Capabilities Index157.45—
ForecastBench61.1—

Math Kimi K3 leads

Kimi K3: 74.2 (#16), Phi 3 Medium 4k Instruct: 33.4 (#202)

Math benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Math14911173
FrontierMath (Tiers 1-3)72.2%—
FrontierMath Tier 439%—
MathArena Final-Answer Competitions87.8%—
OTIS Mock AIME 2024-202597.2%—
ProofBench87%—

Knowledge Kimi K3 leads

Kimi K3: 63.2 (#21), Phi 3 Medium 4k Instruct: 30.2 (#229)

Knowledge benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Expert15211108
GPQA Diamond93.1%—
SimpleQA Verified50.6%—

Multimodal Not comparable

Kimi K3: 37.8 (#70), Phi 3 Medium 4k Instruct: —

Multimodal benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
Blueprint-Bench 229.5%—
Furniture Assembly34.2%—

Multilingual Kimi K3 leads

Kimi K3: 56.3 (#21), Phi 3 Medium 4k Instruct: 30.6 (#263)

Multilingual benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Non-English14661094
LMArena Chinese15291108
LMArena French14911110
LMArena German14881101
LMArena Japanese14871042
LMArena Korean1458954
LMArena Russian14821145
LMArena Spanish14721095

Instruction Following Kimi K3 leads

Kimi K3: 77.7 (#14), Phi 3 Medium 4k Instruct: 57.6 (#268)

Instruction Following benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Instruction Following14831113

Long Context Kimi K3 leads

Kimi K3: 45.8 (#29), Phi 3 Medium 4k Instruct: 34.0 (#255)

Long Context benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Longer Query14941120

Writing & Preference Kimi K3 leads

Kimi K3: 76.6 (#4), Phi 3 Medium 4k Instruct: 34.1 (#272)

Writing & Preference benchmarks
BenchmarkKimi K3Phi 3 Medium 4k Instruct
LMArena Text14761138
LMArena Creative Writing14541107
LMArena Multi-Turn14881088
EQ-Bench Creative Writing2082—
EQ-Bench 41339—

Frequently asked questions

Is Kimi K3 better than Phi 3 Medium 4k Instruct?

Kimi K3 is the stronger model overall, scoring 59.5 to 33.0 on the Noometry Index.

Is Kimi K3 or Phi 3 Medium 4k Instruct better for coding?

Kimi K3 scores higher on coding benchmarks: 61.0 versus 32.9 in the Noometry coding category.

How many benchmarks do Kimi K3 and Phi 3 Medium 4k Instruct share?

17 benchmarks have published results for both models. Kimi K3 has 53 scored results on Noometry and Phi 3 Medium 4k Instruct has 17.

Related comparisons

Go deeper