Model comparison

Kimi K3 vs Qwen2.5 14B Instruct

Kimi K3 has enough public results to be ranked (#15); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Summary

  • The widest gap is in coding, where Kimi K3 leads 61.0 to 37.7.
  • Qwen2.5 14B Instruct is cheaper at $0.35 / $1.40 per million input/output tokens, against $3 / $15 for Kimi K3.
  • Kimi K3 accepts more context: 1.05M tokens versus 131K.

Side by side

Kimi K3 and Qwen2.5 14B Instruct specifications
Kimi K3Qwen2.5 14B Instruct
ProviderMoonshot AIAlibaba (Qwen)
Noometry Index59.538.7
Released2026-07-162024-09
WeightsOpenOpen
Context window1.05M131K
Max output1.05M8K
Input $ / M tokens$3$0.35
Output $ / M tokens$15$1.40
Results tracked533

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K3 leads

Kimi K3: 61.0 (#10), Qwen2.5 14B Instruct: 37.7 (#191)

Coding benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
DeepSWE68.5%—
FrontierCode44.2%—
LMArena WebDev1654—
FrontierSWE25.9%—
SciCode59.5%—
WeirdML82.6%—
BigCodeBench Instruct—39.8%
LMArena Coding1508—
BigCodeBench Complete—52.2%
ALE-Bench1,524—

Agentic & Tool Use Not comparable

Kimi K3: 41.8 (#20), Qwen2.5 14B Instruct: —

Agentic & Tool Use benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
APEX-Agents50.6%—
τ²-bench Banking37.1%—
PostTrainBench32%—
GBAEval48.3%—
GDP.pdf19%—
Vending-Bench 25,165—

Reasoning Not comparable

Kimi K3: 63.0 (#17), Qwen2.5 14B Instruct: —

Reasoning benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
ARC-AGI-260.4%—
SimpleBench60.7%—
NYT Connections (extended)93.6%—
ARC-AGI-194.5%—
CritPt23.4%—
Chess Puzzles39%—
LMArena Hard Prompts1496—
Mystery Game Puzzles26%—
DTBench91.2%—
LMCA52.7%—
Surface Evolver Bench95%—
Epoch Capabilities Index157.45—
ForecastBench61.1—

Math Not comparable

Kimi K3: 74.2 (#16), Qwen2.5 14B Instruct: —

Math benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
FrontierMath (Tiers 1-3)72.2%—
FrontierMath Tier 439%—
MathArena Final-Answer Competitions87.8%—
OTIS Mock AIME 2024-202597.2%—
ProofBench87%—
LMArena Math1491—

Knowledge Not comparable

Kimi K3: 63.2 (#21), Qwen2.5 14B Instruct: —

Knowledge benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
GPQA Diamond93.1%—
SimpleQA Verified50.6%—
LMArena Expert1521—
MMLU—79.9%

Multimodal Not comparable

Kimi K3: 37.8 (#70), Qwen2.5 14B Instruct: —

Multimodal benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
Blueprint-Bench 229.5%—
Furniture Assembly34.2%—

Multilingual Not comparable

Kimi K3: 56.3 (#21), Qwen2.5 14B Instruct: —

Multilingual benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
LMArena Non-English1466—
LMArena Chinese1529—
LMArena French1491—
LMArena German1488—
LMArena Japanese1487—
LMArena Korean1458—
LMArena Russian1482—
LMArena Spanish1472—

Instruction Following Not comparable

Kimi K3: 77.7 (#14), Qwen2.5 14B Instruct: —

Instruction Following benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
LMArena Instruction Following1483—

Long Context Not comparable

Kimi K3: 45.8 (#29), Qwen2.5 14B Instruct: —

Long Context benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
LMArena Longer Query1494—

Writing & Preference Not comparable

Kimi K3: 76.6 (#4), Qwen2.5 14B Instruct: —

Writing & Preference benchmarks
BenchmarkKimi K3Qwen2.5 14B Instruct
LMArena Text1476—
LMArena Creative Writing1454—
EQ-Bench Creative Writing2082—
EQ-Bench 41339—
LMArena Multi-Turn1488—

Frequently asked questions

Is Kimi K3 better than Qwen2.5 14B Instruct?

Kimi K3 has enough public results to be ranked (#15); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Which is cheaper, Kimi K3 or Qwen2.5 14B Instruct?

Qwen2.5 14B Instruct is cheaper. It lists at $0.35 per million input tokens and $1.40 per million output tokens; Kimi K3 lists at $3 and $15.

Is Kimi K3 or Qwen2.5 14B Instruct better for coding?

Kimi K3 scores higher on coding benchmarks: 61.0 versus 37.7 in the Noometry coding category.

Which has the bigger context window?

Kimi K3 does, with 1.05M tokens against 131K.

How many benchmarks do Kimi K3 and Qwen2.5 14B Instruct share?

0 benchmarks have published results for both models. Kimi K3 has 53 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper