Model comparison

Kimi K2.5 vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.6 to 48.1 on the Noometry Index.

Last verified . 26 shared benchmarks.

Kimi K2.5 Moonshot AI

48.1

Rank #57 Confirmed

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Kimi K2.5 scores higher in 3 categories and Muse Spark in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 53.6.
  • The biggest single-benchmark swing is Humanity's Last Exam: 24.4% for Kimi K2.5 and 40.6% for Muse Spark.
  • Kimi K2.5 has downloadable open weights; the other is API-only.

Side by side

Kimi K2.5 and Muse Spark specifications
Kimi K2.5Muse Spark
ProviderMoonshot AIMeta
Noometry Index48.150.6
Released2026-01-272026-04-08
WeightsOpenProprietary
Context window262K—
Max output262K—
Input $ / M tokens$0.45—
Output $ / M tokens$2.25—
Results tracked5127

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 leads

Kimi K2.5: 48.8 (#53), Muse Spark: 46.2 (#69)

Coding benchmarks
BenchmarkKimi K2.5Muse Spark
SciCode49%51.5%
LMArena Coding14741481
SWE-bench Verified73.8%—
SWE-bench Verified (bash only)70.8%—
LMArena WebDev1437—
SWE-bench Multilingual67.3%—
WeirdML45.6%—
ALE-Bench821.65—

Agentic & Tool Use Not comparable

Kimi K2.5: 34.2 (#48), Muse Spark: —

Agentic & Tool Use benchmarks
BenchmarkKimi K2.5Muse Spark
Terminal-Bench43.2%—
OSWorld63.3%—
Vending-Bench 21,198—

Reasoning Muse Spark leads

Kimi K2.5: 31.2 (#80), Muse Spark: 35.9 (#67)

Reasoning benchmarks
BenchmarkKimi K2.5Muse Spark
CritPt3.1%11.3%
LMArena Hard Prompts14531474
Epoch Capabilities Index148.03152.04
ARC-AGI-211.8%—
SimpleBench46.8%—
Kagi LLM Benchmark78.5%—
NYT Connections (extended)69.9%—
ARC-AGI-165.3%—
Chess Puzzles12%—
EnigmaEval3.4%—
Thematic Generalization69.4%—

Math Kimi K2.5 leads

Kimi K2.5: 51.8 (#53), Muse Spark: 47.8 (#66)

Math benchmarks
BenchmarkKimi K2.5Muse Spark
OTIS Mock AIME 2024-202592.2%88.9%
LMArena Math14701455
FrontierMath (Feb 2025 set)27.9%39%
FrontierMath Tier 4 (v1)4.2%14.6%
MathArena Final-Answer Competitions62.3%—
ProofBench—17%

Knowledge Muse Spark leads

Kimi K2.5: 53.6 (#56), Muse Spark: 65.7 (#13)

Knowledge benchmarks
BenchmarkKimi K2.5Muse Spark
GPQA Diamond87.6%89.8%
Humanity's Last Exam24.4%40.6%
LMArena Expert14661457
SimpleQA Verified34.3%—
Vectara Hallucination Rate14.2%—

Multimodal Muse Spark leads

Kimi K2.5: 41.1 (#39), Muse Spark: 43.4 (#24)

Multimodal benchmarks
BenchmarkKimi K2.5Muse Spark
LMArena Vision12691306
LMArena Document14301444

Multilingual Muse Spark leads

Kimi K2.5: 53.9 (#53), Muse Spark: 56.1 (#24)

Multilingual benchmarks
BenchmarkKimi K2.5Muse Spark
LMArena Non-English14331464
LMArena Chinese14951509
LMArena French14541497
LMArena German14411497
LMArena Korean14101459
LMArena Russian14351466
LMArena Spanish14501472
LMArena Japanese1421—

Instruction Following Too close to call

Kimi K2.5: 75.3 (#64), Muse Spark: 75.9 (#51)

Instruction Following benchmarks
BenchmarkKimi K2.5Muse Spark
LMArena Instruction Following14311442

Long Context Kimi K2.5 leads

Kimi K2.5: 52.1 (#7), Muse Spark: 44.4 (#69)

Long Context benchmarks
BenchmarkKimi K2.5Muse Spark
LMArena Longer Query14451451
Fiction.LiveBench86.1%—
CL-bench19.3%—
CL-bench Life13.2%—

Writing & Preference Too close to call

Kimi K2.5: 65.1 (#53), Muse Spark: 66.0 (#39)

Writing & Preference benchmarks
BenchmarkKimi K2.5Muse Spark
LMArena Text14451474
LMArena Creative Writing14231459
LMArena Multi-Turn14441477
EQ-Bench Creative Writing1579—

Frequently asked questions

Is Kimi K2.5 better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.6 to 48.1 on the Noometry Index.

Is Kimi K2.5 or Muse Spark better for coding?

Kimi K2.5 scores higher on coding benchmarks: 48.8 versus 46.2 in the Noometry coding category.

How many benchmarks do Kimi K2.5 and Muse Spark share?

26 benchmarks have published results for both models. Kimi K2.5 has 51 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper