Model comparison
Claude Haiku 4.5 vs Muse Spark 1.1
Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 39.5 on the Noometry Index.
Last verified . 28 shared benchmarks.
MetaSummary
- They share 28 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 1 category and Muse Spark 1.1 in 9 categories; 9 gaps are clear of the uncertainty.
- The widest gap is in reasoning, where Muse Spark 1.1 leads 47.1 to 15.1.
- The biggest single-benchmark swing is NYT Connections (extended): 14.3% for Claude Haiku 4.5 and 84.9% for Muse Spark 1.1.
- Both cost about the same: $1 input and $5 output per million tokens.
- Muse Spark 1.1 accepts more context: 1.05M tokens versus 200K.
Side by side
| Claude Haiku 4.5 | Muse Spark 1.1 | |
|---|---|---|
| Provider | Anthropic | Meta |
| Noometry Index | 39.5 | 49.9 |
| Released | 2025-10-15 | 2026-04-08 |
| Weights | Proprietary | Proprietary |
| Context window | 200K | 1.05M |
| Max output | 64K | 131K |
| Input $ / M tokens | $1 | $1.25 |
| Output $ / M tokens | $5 | $4.25 |
| Results tracked | 53 | 37 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Muse Spark 1.1 leads
Claude Haiku 4.5: 44.0 (#78), Muse Spark 1.1: 51.3 (#40)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| LMArena WebDev | 1330 | 1542 |
| SciCode | 43.3% | 58.8% |
| LMArena Coding | 1453 | 1498 |
| DeepSWE | — | 53.3% |
| SWE-bench Verified (bash only) | 66.6% | — |
| SWE-bench Multilingual | 64.7% | — |
| WeirdML | 45.4% | — |
| ALE-Bench | 653.48 | — |
Agentic & Tool Use Claude Haiku 4.5 leads
Claude Haiku 4.5: 33.6 (#52), Muse Spark 1.1: 30.8 (#73)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| Vending-Bench 2 | 458.89 | 6,520 |
| Terminal-Bench | 35.5% | — |
| APEX-Agents | — | 31.8% |
| Berkeley Function Calling Leaderboard | 68.7% | — |
| τ²-bench Banking | — | 40.5% |
| DeepResearch Bench | 45.5% | — |
| BALROG | 31.2% | — |
| ExploitBench | 13.7% | — |
| GBAEval | — | 7.9% |
| GDP.pdf | — | 15% |
Reasoning Muse Spark 1.1 leads
Claude Haiku 4.5: 15.1 (#320), Muse Spark 1.1: 47.1 (#44)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| NYT Connections (extended) | 14.3% | 84.9% |
| CritPt | 0% | 15.1% |
| LMArena Hard Prompts | 1420 | 1486 |
| DTBench | 73.6% | 94.4% |
| LMCA | 30.9% | 49.9% |
| Epoch Capabilities Index | 142.41 | 154.21 |
| ARC-AGI-2 | 4% | — |
| ARC-AGI-1 | 47.7% | — |
| Chess Puzzles | 8% | — |
| Surface Evolver Bench | — | 52.5% |
| ForecastBench | 61.4 | — |
Math Too close to call
Claude Haiku 4.5: 44.9 (#78), Muse Spark 1.1: 45.5 (#76)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| LMArena Math | 1396 | 1483 |
| OTIS Mock AIME 2024-2025 | 66.7% | — |
| ProofBench | — | 39% |
| Omni-MATH | 56.1% | — |
| MATH Level 5 | 96.4% | — |
| FrontierMath (Feb 2025 set) | 5.9% | — |
| FrontierMath Tier 4 (v1) | 2.1% | — |
Knowledge Muse Spark 1.1 leads
Claude Haiku 4.5: 37.7 (#153), Muse Spark 1.1: 53.1 (#59)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| SimpleQA Verified | 13.2% | 57.8% |
| LMArena Expert | 1442 | 1478 |
| GPQA Diamond | 71.2% | — |
| MMLU-Pro | 77.7% | — |
| Vectara Hallucination Rate | 9.8% | — |
| GPQA (HELM) | 60.5% | — |
Multimodal Muse Spark 1.1 leads
Claude Haiku 4.5: 26.8 (#118), Muse Spark 1.1: 42.6 (#29)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| LMArena Document | 1420 | 1465 |
| LMArena Vision | — | 1293 |
| Blueprint-Bench 2 | 0% | — |
Multilingual Muse Spark 1.1 leads
Claude Haiku 4.5: 49.9 (#129), Muse Spark 1.1: 56.7 (#17)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| LMArena Non-English | 1377 | 1472 |
| LMArena Chinese | 1417 | 1518 |
| LMArena French | 1408 | 1494 |
| LMArena German | 1375 | 1466 |
| LMArena Japanese | 1339 | 1451 |
| LMArena Korean | 1347 | 1458 |
| LMArena Russian | 1381 | 1483 |
| LMArena Spanish | 1420 | 1464 |
Instruction Following Muse Spark 1.1 leads
Claude Haiku 4.5: 71.4 (#149), Muse Spark 1.1: 76.5 (#39)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| LMArena Instruction Following | 1414 | 1457 |
| IFEval | 80.1% | — |
Long Context Muse Spark 1.1 leads
Claude Haiku 4.5: 43.6 (#92), Muse Spark 1.1: 44.8 (#58)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| LMArena Longer Query | 1427 | 1462 |
Writing & Preference Muse Spark 1.1 leads
Claude Haiku 4.5: 57.9 (#123), Muse Spark 1.1: 73.4 (#11)
| Benchmark | Claude Haiku 4.5 | Muse Spark 1.1 |
|---|---|---|
| LMArena Text | 1396 | 1479 |
| LMArena Creative Writing | 1372 | 1437 |
| EQ-Bench 4 | 1064 | 1260 |
| LMArena Multi-Turn | 1409 | 1485 |
| EQ-Bench Creative Writing | — | 1927 |
| WildBench | 83.9% | — |
Frequently asked questions
Is Claude Haiku 4.5 better than Muse Spark 1.1?
Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 39.5 on the Noometry Index.
Which is cheaper, Claude Haiku 4.5 or Muse Spark 1.1?
Muse Spark 1.1 is cheaper. It lists at $1.25 per million input tokens and $4.25 per million output tokens; Claude Haiku 4.5 lists at $1 and $5.
Is Claude Haiku 4.5 or Muse Spark 1.1 better for coding?
Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 44.0 in the Noometry coding category.
Which has the bigger context window?
Muse Spark 1.1 does, with 1.05M tokens against 200K.
How many benchmarks do Claude Haiku 4.5 and Muse Spark 1.1 share?
28 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and Muse Spark 1.1 has 37.