Model comparison

Muse Spark 1.2 vs Phi-2

Muse Spark 1.2 has enough public results to be ranked (#48); Phi-2 does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Muse Spark 1.2 Meta

50.3

Rank #48 Confirmed

Phi-2 Microsoft

—

Unranked

Summary

  • They share 1 benchmark with published results for both.
  • Phi-2 has downloadable open weights; the other is API-only.

Side by side

Muse Spark 1.2 and Phi-2 specifications
Muse Spark 1.2Phi-2
ProviderMetaMicrosoft
Noometry Index50.3—
Released2026-08-052023-12-12
WeightsProprietaryOpen
Context window1.05M—
Max output131K—
Input $ / M tokens$1.25—
Output $ / M tokens$4.25—
Results tracked3111

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Muse Spark 1.2: 49.2 (#51), Phi-2: —

Coding benchmarks
BenchmarkMuse Spark 1.2Phi-2
DeepSWE54.9%—
LMArena WebDev1533—
FrontierSWE12%—
SciCode56.4%—
WeirdML60.3%—
LMArena Coding1495—
HumanEval+—45.1%
MBPP+—54.2%

Agentic & Tool Use Not comparable

Muse Spark 1.2: 29.4 (#87), Phi-2: —

Agentic & Tool Use benchmarks
BenchmarkMuse Spark 1.2Phi-2
APEX-Agents36.4%—
GDP.pdf16%—

Reasoning Not comparable

Muse Spark 1.2: 51.3 (#34), Phi-2: —

Reasoning benchmarks
BenchmarkMuse Spark 1.2Phi-2
Epoch Capabilities Index154.87107.94
SimpleBench74.5%—
NYT Connections (extended)79.2%—
CritPt17.7%—
LMArena Hard Prompts1486—
DTBench94.7%—
LMCA48.4%—
Adversarial NLI—42.5%
BIG-Bench Hard—59.4%
HellaSwag—53.6%
WinoGrande—54.7%

Math Not comparable

Muse Spark 1.2: 46.4 (#70), Phi-2: —

Math benchmarks
BenchmarkMuse Spark 1.2Phi-2
ProofBench43%—
LMArena Math1471—

Knowledge Not comparable

Muse Spark 1.2: 54.1 (#53), Phi-2: —

Knowledge benchmarks
BenchmarkMuse Spark 1.2Phi-2
SimpleQA Verified60.3%—
LMArena Expert1480—
ARC (AI2) Challenge—75.9%
MMLU—58.4%
OpenBookQA—73.6%
TriviaQA—45.2%

Multimodal Not comparable

Muse Spark 1.2: 43.4 (#25), Phi-2: —

Multimodal benchmarks
BenchmarkMuse Spark 1.2Phi-2
LMArena Vision1305—

Multilingual Not comparable

Muse Spark 1.2: 57.1 (#11), Phi-2: —

Multilingual benchmarks
BenchmarkMuse Spark 1.2Phi-2
LMArena Non-English1478—
LMArena Chinese1511—
LMArena French1513—
LMArena Russian1487—
LMArena Spanish1498—

Instruction Following Not comparable

Muse Spark 1.2: 76.7 (#36), Phi-2: —

Instruction Following benchmarks
BenchmarkMuse Spark 1.2Phi-2
LMArena Instruction Following1461—

Long Context Not comparable

Muse Spark 1.2: 45.2 (#48), Phi-2: —

Long Context benchmarks
BenchmarkMuse Spark 1.2Phi-2
LMArena Longer Query1475—

Writing & Preference Not comparable

Muse Spark 1.2: 72.3 (#14), Phi-2: —

Writing & Preference benchmarks
BenchmarkMuse Spark 1.2Phi-2
LMArena Text1482—
LMArena Creative Writing1449—
EQ-Bench Creative Writing1840—
LMArena Multi-Turn1494—

Frequently asked questions

Is Muse Spark 1.2 better than Phi-2?

Muse Spark 1.2 has enough public results to be ranked (#48); Phi-2 does not yet, so treat this comparison as directional.

How many benchmarks do Muse Spark 1.2 and Phi-2 share?

1 benchmark has published results for both models. Muse Spark 1.2 has 31 scored results on Noometry and Phi-2 has 11.

Related comparisons

Go deeper