Noometry

Model comparison

Kimi K2 (Jul 2025) vs Qwen1.5-14B

Kimi K2 (Jul 2025) is the stronger model overall, scoring 41.2 to 32.7 on the Noometry Index.

Last verified . 16 shared benchmarks.

Kimi K2 (Jul 2025) Moonshot AI

41.2

Rank #140 Confirmed

Qwen1.5-14B Alibaba (Qwen)

32.7

Rank #253 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Kimi K2 (Jul 2025) scores higher in 8 categories and Qwen1.5-14B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2 (Jul 2025) leads 62.3 to 33.6.

Side by side

Kimi K2 (Jul 2025)Qwen1.5-14B
ProviderMoonshot AIAlibaba (Qwen)
Noometry Index41.232.7
Released2025-07-122024-02-04
WeightsOpenOpen
Context window262K—
Max output262K—
Input $ / M tokens$0.57—
Output $ / M tokens$2.30—
Results tracked4217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 42.4 (#102), Qwen1.5-14B: 33.1 (#263)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Coding13991138
SWE-bench Verified (bash only)63.4%—
Aider Polyglot59.1%—
GSO4.9%—
WeirdML42.8%—
ALE-Bench597.5—

Agentic & Tool Use Not comparable

Kimi K2 (Jul 2025): 32.4 (#64), Qwen1.5-14B: —

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
Terminal-Bench35.7%—
Berkeley Function Calling Leaderboard59.1%—
METR Time Horizons59.2%—

Reasoning Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 23.3 (#179), Qwen1.5-14B: 21.4 (#223)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Hard Prompts13841113
SimpleBench26.3%—
Kagi LLM Benchmark64.4%—
Epoch Capabilities Index146.01—
ForecastBench60.2—

Math Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 42.7 (#83), Qwen1.5-14B: 32.4 (#215)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Math13971125
Omni-MATH65.4%—
FrontierMath (Feb 2025 set)21.4%—
FrontierMath Tier 4 (v1)0%—

Knowledge Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 37.3 (#157), Qwen1.5-14B: 29.8 (#232)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Expert13651094
MMLU-Pro81.9%—
Confabulations20.4%—
Vectara Hallucination Rate17.9%—
GPQA (HELM)65.3%—
MMLU—68.6%

Multilingual Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 49.6 (#130), Qwen1.5-14B: 30.7 (#262)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Non-English13721095
LMArena Chinese14151147
LMArena French13791116
LMArena German13871043
LMArena Japanese13491019
LMArena Russian13851046
LMArena Spanish13861085
LMArena Korean1325—

Instruction Following Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 71.1 (#156), Qwen1.5-14B: 56.8 (#271)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Instruction Following13481102
IFEval85%—

Long Context Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 41.2 (#145), Qwen1.5-14B: 33.7 (#257)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Longer Query13531113
Fiction.LiveBench66.7%—
CL-bench17.6%—

Writing & Preference Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 62.3 (#78), Qwen1.5-14B: 33.6 (#276)

BenchmarkKimi K2 (Jul 2025)Qwen1.5-14B
LMArena Text13801128
LMArena Creative Writing13501091
LMArena Multi-Turn13711110
Short-Story Creative Writing85.6%—
EQ-Bench Creative Writing1666—
WildBench86.2%—

Frequently asked questions

Is Kimi K2 (Jul 2025) better than Qwen1.5-14B?

Kimi K2 (Jul 2025) is the stronger model overall, scoring 41.2 to 32.7 on the Noometry Index.

Is Kimi K2 (Jul 2025) or Qwen1.5-14B better for coding?

Kimi K2 (Jul 2025) scores higher on coding benchmarks: 42.4 versus 33.1 in the Noometry coding category.

How many benchmarks do Kimi K2 (Jul 2025) and Qwen1.5-14B share?

16 benchmarks have published results for both models. Kimi K2 (Jul 2025) has 42 scored results on Noometry and Qwen1.5-14B has 17.

Related comparisons

Go deeper