Model comparison

Kimi K2.5 Instant vs Phi 3 Medium 4k Instruct

Kimi K2.5 Instant is the stronger model overall, scoring 42.9 to 32.4 on the Noometry Index.

Last verified . 16 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

42.9

Rank #92 Confirmed

Phi 3 Medium 4k Instruct Microsoft

32.4

Rank #246 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 8 categories and Phi 3 Medium 4k Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.8 to 34.3.

Side by side

Kimi K2.5 Instant and Phi 3 Medium 4k Instruct specifications
Kimi K2.5 InstantPhi 3 Medium 4k Instruct
ProviderMoonshot AIMicrosoft
Noometry Index42.932.4
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.3 (#95), Phi 3 Medium 4k Instruct: 32.3 (#263)

Coding benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Coding14831130
LMArena WebDev1404—

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 28.5 (#88), Phi 3 Medium 4k Instruct: 20.8 (#214)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Hard Prompts14431127

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 36.6 (#105), Phi 3 Medium 4k Instruct: 30.9 (#202)

Math benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Math14431173

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.5 (#121), Phi 3 Medium 4k Instruct: 29.6 (#226)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Expert14381108

Multimodal Not comparable

Kimi K2.5 Instant: 39.5 (#47), Phi 3 Medium 4k Instruct: —

Multimodal benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Vision1254—

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.2 (#89), Phi 3 Medium 4k Instruct: 30.8 (#258)

Multilingual benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Non-English14061094
LMArena Chinese14501108
LMArena French14031109
LMArena German14131101
LMArena Korean1378954
LMArena Russian14041145
LMArena Spanish14481095
LMArena Japanese—1042

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.5 (#61), Phi 3 Medium 4k Instruct: 57.8 (#263)

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Instruction Following14301114

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.8 (#82), Phi 3 Medium 4k Instruct: 33.9 (#250)

Long Context benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Longer Query14351120

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.8 (#91), Phi 3 Medium 4k Instruct: 34.3 (#267)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantPhi 3 Medium 4k Instruct
LMArena Text14201138
LMArena Creative Writing13791106
LMArena Multi-Turn14271088

Frequently asked questions

Is Kimi K2.5 Instant better than Phi 3 Medium 4k Instruct?

Kimi K2.5 Instant is the stronger model overall, scoring 42.9 to 32.4 on the Noometry Index.

Is Kimi K2.5 Instant or Phi 3 Medium 4k Instruct better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.3 versus 32.3 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Phi 3 Medium 4k Instruct share?

16 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Phi 3 Medium 4k Instruct has 17.

Related comparisons

Go deeper