Model comparison

Mistral Medium vs Muse Spark 1.2

Muse Spark 1.2 is the stronger model overall, scoring 49.8 to 36.0 on the Noometry Index.

Last verified . 18 shared benchmarks.

Mistral Medium Mistral AI

36.0

Rank #211 Confirmed

Muse Spark 1.2 Meta

49.8

Rank #44 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Mistral Medium scores higher in 0 categories and Muse Spark 1.2 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark 1.2 leads 53.9 to 24.9.
  • The biggest single-benchmark swing is ProofBench: 9% for Mistral Medium and 43% for Muse Spark 1.2.
  • Muse Spark 1.2 is cheaper at $1.25 / $4.25 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium.
  • Muse Spark 1.2 accepts more context: 1.05M tokens versus 262K.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Mistral Medium and Muse Spark 1.2 specifications
Mistral MediumMuse Spark 1.2
ProviderMistral AIMeta
Noometry Index36.049.8
Released2023-12-112026-08-05
WeightsOpenProprietary
Context window262K1.05M
Max output262K131K
Input $ / M tokens$1.50$1.25
Output $ / M tokens$7.50$4.25
Results tracked3628

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.2 leads

Mistral Medium: 33.8 (#241), Muse Spark 1.2: 48.6 (#49)

Coding benchmarks
BenchmarkMistral MediumMuse Spark 1.2
SciCode40.2%56.4%
WeirdML43.7%60.3%
LMArena Coding14341497
DeepSWE—54.9%
FrontierCode8%—
LMArena WebDev—1532
FrontierSWE—12%
ALE-Bench763.98—

Agentic & Tool Use Muse Spark 1.2 leads

Mistral Medium: 28.1 (#84), Muse Spark 1.2: 29.5 (#77)

Agentic & Tool Use benchmarks
BenchmarkMistral MediumMuse Spark 1.2
APEX-Agents—36.4%
Berkeley Function Calling Leaderboard37.7%—
GDP.pdf—16%

Reasoning Muse Spark 1.2 leads

Mistral Medium: 23.3 (#165), Muse Spark 1.2: 50.4 (#32)

Reasoning benchmarks
BenchmarkMistral MediumMuse Spark 1.2
CritPt0%17.7%
LMArena Hard Prompts14261490
DTBench75.5%94.7%
LMCA26.1%48.4%
SimpleBench—74.5%
Kagi LLM Benchmark50%—
NYT Connections (extended)—79.2%
Surface Evolver Bench26.9%—
Epoch Capabilities Index—155.18

Math Muse Spark 1.2 leads

Mistral Medium: 27.2 (#238), Muse Spark 1.2: 43.8 (#68)

Math benchmarks
BenchmarkMistral MediumMuse Spark 1.2
ProofBench9%43%
OTIS Mock AIME 2024-202532.2%—
LMArena Math1409—
MATH Level 581.6%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Muse Spark 1.2 leads

Mistral Medium: 24.9 (#260), Muse Spark 1.2: 53.9 (#49)

Knowledge benchmarks
BenchmarkMistral MediumMuse Spark 1.2
LMArena Expert14081485
GPQA Diamond59.5%—
Humanity's Last Exam4.5%—
SimpleQA Verified—60.3%
Vectara Hallucination Rate22.7%—

Multimodal Muse Spark 1.2 leads

Mistral Medium: 34.6 (#82), Muse Spark 1.2: 42.6 (#24)

Multimodal benchmarks
BenchmarkMistral MediumMuse Spark 1.2
LMArena Vision11721304

Multilingual Muse Spark 1.2 leads

Mistral Medium: 52.3 (#86), Muse Spark 1.2: 57.4 (#10)

Multilingual benchmarks
BenchmarkMistral MediumMuse Spark 1.2
LMArena Non-English14081479
LMArena Chinese14481519
LMArena Russian14111494
LMArena French1460—
LMArena German1433—
LMArena Japanese1378—
LMArena Korean1382—
LMArena Spanish1433—

Instruction Following Muse Spark 1.2 leads

Mistral Medium: 73.9 (#111), Muse Spark 1.2: 77.1 (#30)

Instruction Following benchmarks
BenchmarkMistral MediumMuse Spark 1.2
LMArena Instruction Following13981466

Long Context Muse Spark 1.2 leads

Mistral Medium: 42.9 (#108), Muse Spark 1.2: 45.4 (#35)

Long Context benchmarks
BenchmarkMistral MediumMuse Spark 1.2
LMArena Longer Query14061483

Writing & Preference Muse Spark 1.2 leads

Mistral Medium: 60.2 (#97), Muse Spark 1.2: 72.6 (#14)

Writing & Preference benchmarks
BenchmarkMistral MediumMuse Spark 1.2
LMArena Text14241486
LMArena Creative Writing13911444
LMArena Multi-Turn14181504
Short-Story Creative Writing77.3%—
EQ-Bench Creative Writing—1840

Frequently asked questions

Is Mistral Medium better than Muse Spark 1.2?

Muse Spark 1.2 is the stronger model overall, scoring 49.8 to 36.0 on the Noometry Index.

Which is cheaper, Mistral Medium or Muse Spark 1.2?

Muse Spark 1.2 is cheaper. It lists at $1.25 per million input tokens and $4.25 per million output tokens; Mistral Medium lists at $1.50 and $7.50.

Is Mistral Medium or Muse Spark 1.2 better for coding?

Muse Spark 1.2 scores higher on coding benchmarks: 48.6 versus 33.8 in the Noometry coding category.

Which has the bigger context window?

Muse Spark 1.2 does, with 1.05M tokens against 262K.

How many benchmarks do Mistral Medium and Muse Spark 1.2 share?

18 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Muse Spark 1.2 has 28.

Related comparisons

Go deeper