Noometry

Model comparison

Gemma 2B vs Muse Spark 1.3

Muse Spark 1.3 is the stronger model overall, scoring 54.8 to 29.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

Muse Spark 1.3 Meta

54.8

Rank #27 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 2B scores higher in 0 categories and Muse Spark 1.3 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.3 leads 73.6 to 24.0.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemma 2BMuse Spark 1.3
ProviderGoogleMeta
Noometry Index29.654.8
Released2024-02-212026-09-02
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked2337

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.3 leads

Gemma 2B: 29.4 (#305), Muse Spark 1.3: 56.6 (#21)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Coding10101514
CursorBench—41.6%
LMArena WebDev—1657
SciCode—59.7%
HumanEval+20.7%—
MBPP+34.1%—

Agentic & Tool Use Not comparable

Gemma 2B: —, Muse Spark 1.3: 38.6 (#30)

BenchmarkGemma 2BMuse Spark 1.3
APEX-Agents—57.8%
GDP.pdf—27.6%

Reasoning Muse Spark 1.3 leads

Gemma 2B: 18.8 (#275), Muse Spark 1.3: 54.0 (#27)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Hard Prompts9891503
Epoch Capabilities Index94.2156.75
NYT Connections (extended)—85.1%
CritPt—26%
Chess Puzzles—38%
Mystery Game Puzzles—25%
DTBench—96.5%
LMCA—53.9%
Bench to the Future 3—0.14
BIG-Bench Hard35.2%—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Muse Spark 1.3 leads

Gemma 2B: 30.0 (#239), Muse Spark 1.3: 73.1 (#21)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Math10091494
FrontierMath (Tiers 1-3)—74.4%
FrontierMath Tier 4—46.3%
OTIS Mock AIME 2024-2025—99.2%
ProofBench—58%
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, Muse Spark 1.3: 42.6 (#95)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Expert—1516
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multimodal Not comparable

Gemma 2B: —, Muse Spark 1.3: 43.7 (#22)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Vision—1309
LMArena Document—1471

Multilingual Muse Spark 1.3 leads

Gemma 2B: 23.0 (#294), Muse Spark 1.3: 57.4 (#8)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Non-English9581481
LMArena Chinese9861529
LMArena Russian9371490
LMArena French—1524
LMArena German—1515
LMArena Japanese—1474
LMArena Korean—1501
LMArena Spanish—1490

Instruction Following Muse Spark 1.3 leads

Gemma 2B: 48.5 (#302), Muse Spark 1.3: 77.5 (#22)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Instruction Following9701477

Long Context Muse Spark 1.3 leads

Gemma 2B: 29.9 (#291), Muse Spark 1.3: 45.6 (#32)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Longer Query9811488

Writing & Preference Muse Spark 1.3 leads

Gemma 2B: 24.0 (#308), Muse Spark 1.3: 73.6 (#9)

BenchmarkGemma 2BMuse Spark 1.3
LMArena Text10021490
LMArena Creative Writing9871455
LMArena Multi-Turn9451482
EQ-Bench Creative Writing—1906

Frequently asked questions

Is Gemma 2B better than Muse Spark 1.3?

Muse Spark 1.3 is the stronger model overall, scoring 54.8 to 29.6 on the Noometry Index.

Is Gemma 2B or Muse Spark 1.3 better for coding?

Muse Spark 1.3 scores higher on coding benchmarks: 56.6 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2B and Muse Spark 1.3 share?

12 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and Muse Spark 1.3 has 37.

Related comparisons

Go deeper