Model comparison

Mistral Small 3 vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.6 to 31.2 on the Noometry Index.

Last verified . 18 shared benchmarks.

Mistral Small 3 Mistral AI

31.2

Rank #278 Confirmed

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Mistral Small 3 scores higher in 0 categories and Muse Spark in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 25.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 6.7% for Mistral Small 3 and 88.9% for Muse Spark.
  • Mistral Small 3 has downloadable open weights; the other is API-only.

Side by side

Mistral Small 3 and Muse Spark specifications
Mistral Small 3Muse Spark
ProviderMistral AIMeta
Noometry Index31.250.6
Released2025-01-302026-04-08
WeightsOpenProprietary
Context window33K—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.08—
Results tracked2427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

Mistral Small 3: 36.5 (#207), Muse Spark: 46.2 (#69)

Coding benchmarks
BenchmarkMistral Small 3Muse Spark
LMArena Coding12461481
SciCode—51.5%
BigCodeBench Instruct45.3%—
BigCodeBench Complete50.4%—

Reasoning Muse Spark leads

Mistral Small 3: 18.9 (#273), Muse Spark: 35.9 (#67)

Reasoning benchmarks
BenchmarkMistral Small 3Muse Spark
LMArena Hard Prompts12331474
Epoch Capabilities Index127.07152.04
CritPt—11.3%
Chess Puzzles0%—

Math Muse Spark leads

Mistral Small 3: 16.3 (#295), Muse Spark: 47.8 (#66)

Math benchmarks
BenchmarkMistral Small 3Muse Spark
OTIS Mock AIME 2024-20256.7%88.9%
LMArena Math12401455
ProofBench—17%
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%

Knowledge Muse Spark leads

Mistral Small 3: 25.1 (#263), Muse Spark: 65.7 (#13)

Knowledge benchmarks
BenchmarkMistral Small 3Muse Spark
GPQA Diamond47.3%89.8%
LMArena Expert12021457
Humanity's Last Exam—40.6%
Confabulations25.2%—

Multimodal Not comparable

Mistral Small 3: —, Muse Spark: 43.4 (#24)

Multimodal benchmarks
BenchmarkMistral Small 3Muse Spark
LMArena Vision—1306
LMArena Document—1444

Multilingual Muse Spark leads

Mistral Small 3: 37.3 (#236), Muse Spark: 56.1 (#24)

Multilingual benchmarks
BenchmarkMistral Small 3Muse Spark
LMArena Non-English11981464
LMArena Chinese12041509
LMArena French12031497
LMArena German12111497
LMArena Korean11881459
LMArena Russian12161466
LMArena Japanese1111—
LMArena Spanish—1472

Instruction Following Muse Spark leads

Mistral Small 3: 63.7 (#229), Muse Spark: 75.9 (#51)

Instruction Following benchmarks
BenchmarkMistral Small 3Muse Spark
LMArena Instruction Following12141442

Long Context Muse Spark leads

Mistral Small 3: 37.8 (#211), Muse Spark: 44.4 (#69)

Long Context benchmarks
BenchmarkMistral Small 3Muse Spark
LMArena Longer Query12461451

Writing & Preference Muse Spark leads

Mistral Small 3: 32.2 (#280), Muse Spark: 66.0 (#39)

Writing & Preference benchmarks
BenchmarkMistral Small 3Muse Spark
LMArena Text12341474
LMArena Creative Writing11951459
LMArena Multi-Turn12171477
EQ-Bench Creative Writing707—

Frequently asked questions

Is Mistral Small 3 better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.6 to 31.2 on the Noometry Index.

Is Mistral Small 3 or Muse Spark better for coding?

Muse Spark scores higher on coding benchmarks: 46.2 versus 36.5 in the Noometry coding category.

How many benchmarks do Mistral Small 3 and Muse Spark share?

18 benchmarks have published results for both models. Mistral Small 3 has 24 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper