Model comparison

DeepSeek Coder 6.7B vs Muse Spark 1.1

Muse Spark 1.1 has enough public results to be ranked (#43); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

DeepSeek Coder 6.7B DeepSeek

37.1

Unranked Sparse

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Summary

  • They share 1 benchmark with published results for both. DeepSeek Coder 6.7B scores higher in 0 categories and Muse Spark 1.1 in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Muse Spark 1.1 leads 50.8 to 35.2.
  • DeepSeek Coder 6.7B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 6.7B and Muse Spark 1.1 specifications
DeepSeek Coder 6.7BMuse Spark 1.1
ProviderDeepSeekMeta
Noometry Index37.149.9
Released2023-11-022026-04-08
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked936

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

DeepSeek Coder 6.7B: 35.2 (#216), Muse Spark 1.1: 50.8 (#38)

Coding benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
BigCodeBench Instruct35.5%—
LMArena Coding—1497
BigCodeBench Complete43.8%—
HumanEval+71.3%—
MBPP+65.6%—

Agentic & Tool Use Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 33.9 (#45)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 45.9 (#41)

Reasoning benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
Epoch Capabilities Index88.88154.32
NYT Connections (extended)—84.9%
CritPt—15.1%
LMArena Hard Prompts—1486
DTBench—94.4%
LMCA—49.9%
Surface Evolver Bench—52.5%
WinoGrande57.6%—

Math Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 44.0 (#67)

Math benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
ProofBench—39%
LMArena Math—1477
GSM8K21.3%—

Knowledge Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 52.8 (#55)

Knowledge benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
SimpleQA Verified—57.8%
LMArena Expert—1480
ARC (AI2) Challenge36.4%—
MMLU36.4%—

Multimodal Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 41.9 (#28)

Multimodal benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
LMArena Vision—1292
LMArena Document—1465

Multilingual Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 56.8 (#16)

Multilingual benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
LMArena Non-English—1471
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1445
LMArena Korean—1459
LMArena Russian—1482
LMArena Spanish—1471

Instruction Following Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 76.8 (#36)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
LMArena Instruction Following—1457

Long Context Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 44.8 (#55)

Long Context benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
LMArena Longer Query—1463

Writing & Preference Not comparable

DeepSeek Coder 6.7B: —, Muse Spark 1.1: 73.6 (#11)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 6.7BMuse Spark 1.1
LMArena Text—1479
LMArena Creative Writing—1440
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260
LMArena Multi-Turn—1484

Frequently asked questions

Is DeepSeek Coder 6.7B better than Muse Spark 1.1?

Muse Spark 1.1 has enough public results to be ranked (#43); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 6.7B or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 50.8 versus 35.2 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 6.7B and Muse Spark 1.1 share?

1 benchmark has published results for both models. DeepSeek Coder 6.7B has 9 scored results on Noometry and Muse Spark 1.1 has 36.

Related comparisons

Go deeper