Noometry

Model comparison

Devstral 2 vs Muse Spark 1.1

Muse Spark 1.1 has enough public results to be ranked (#43); Devstral 2 does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Devstral 2 Mistral AI

35.8

Unranked Sparse

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Summary

  • They share 1 benchmark with published results for both. Devstral 2 scores higher in 0 categories and Muse Spark 1.1 in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Muse Spark 1.1 leads 50.8 to 33.0.
  • Devstral 2 is cheaper at $0.40 / $2 per million input/output tokens, against $1.25 / $4.25 for Muse Spark 1.1.
  • Muse Spark 1.1 accepts more context: 1.05M tokens versus 262K.
  • Devstral 2 has downloadable open weights; the other is API-only.

Side by side

Devstral 2Muse Spark 1.1
ProviderMistral AIMeta
Noometry Index35.849.9
Released2025-12-092026-04-08
WeightsOpenProprietary
Context window262K1.05M
Max output262K131K
Input $ / M tokens$0.40$1.25
Output $ / M tokens$2$4.25
Results tracked236

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Devstral 2: 33.0 (#253), Muse Spark 1.1: 50.8 (#38)

BenchmarkDevstral 2Muse Spark 1.1
LMArena WebDev11961542
DeepSWE—53.3%
SWE-bench Verified (bash only)53.8%—
SciCode—58.8%
LMArena Coding—1497

Agentic & Tool Use Not comparable

Devstral 2: —, Muse Spark 1.1: 33.9 (#45)

BenchmarkDevstral 2Muse Spark 1.1
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Not comparable

Devstral 2: —, Muse Spark 1.1: 45.9 (#41)

BenchmarkDevstral 2Muse Spark 1.1
NYT Connections (extended)—84.9%
CritPt—15.1%
LMArena Hard Prompts—1486
DTBench—94.4%
LMCA—49.9%
Surface Evolver Bench—52.5%
Epoch Capabilities Index—154.32

Math Not comparable

Devstral 2: —, Muse Spark 1.1: 44.0 (#67)

BenchmarkDevstral 2Muse Spark 1.1
ProofBench—39%
LMArena Math—1477

Knowledge Not comparable

Devstral 2: —, Muse Spark 1.1: 52.8 (#55)

BenchmarkDevstral 2Muse Spark 1.1
SimpleQA Verified—57.8%
LMArena Expert—1480

Multimodal Not comparable

Devstral 2: —, Muse Spark 1.1: 41.9 (#28)

BenchmarkDevstral 2Muse Spark 1.1
LMArena Vision—1292
LMArena Document—1465

Multilingual Not comparable

Devstral 2: —, Muse Spark 1.1: 56.8 (#16)

BenchmarkDevstral 2Muse Spark 1.1
LMArena Non-English—1471
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1445
LMArena Korean—1459
LMArena Russian—1482
LMArena Spanish—1471

Instruction Following Not comparable

Devstral 2: —, Muse Spark 1.1: 76.8 (#36)

BenchmarkDevstral 2Muse Spark 1.1
LMArena Instruction Following—1457

Long Context Not comparable

Devstral 2: —, Muse Spark 1.1: 44.8 (#55)

BenchmarkDevstral 2Muse Spark 1.1
LMArena Longer Query—1463

Writing & Preference Not comparable

Devstral 2: —, Muse Spark 1.1: 73.6 (#11)

BenchmarkDevstral 2Muse Spark 1.1
LMArena Text—1479
LMArena Creative Writing—1440
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260
LMArena Multi-Turn—1484

Frequently asked questions

Is Devstral 2 better than Muse Spark 1.1?

Muse Spark 1.1 has enough public results to be ranked (#43); Devstral 2 does not yet, so treat this comparison as directional.

Which is cheaper, Devstral 2 or Muse Spark 1.1?

Devstral 2 is cheaper. It lists at $0.40 per million input tokens and $2 per million output tokens; Muse Spark 1.1 lists at $1.25 and $4.25.

Is Devstral 2 or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 50.8 versus 33.0 in the Noometry coding category.

Which has the bigger context window?

Muse Spark 1.1 does, with 1.05M tokens against 262K.

How many benchmarks do Devstral 2 and Muse Spark 1.1 share?

1 benchmark has published results for both models. Devstral 2 has 2 scored results on Noometry and Muse Spark 1.1 has 36.

Related comparisons

Go deeper