Noometry

Model comparison

Gemma 1.1 2b IT vs Muse Spark 1.3

Muse Spark 1.3 is the stronger model overall, scoring 54.8 to 29.3 on the Noometry Index.

Last verified . 14 shared benchmarks.

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

Muse Spark 1.3 Meta

54.8

Rank #27 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Gemma 1.1 2b IT scores higher in 0 categories and Muse Spark 1.3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.3 leads 73.6 to 25.1.
  • Gemma 1.1 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 1.1 2b ITMuse Spark 1.3
ProviderGoogleMeta
Noometry Index29.354.8
Released—2026-09-02
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked1637

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.3 leads

Gemma 1.1 2b IT: 30.1 (#299), Muse Spark 1.3: 56.6 (#21)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Coding10341514
CursorBench—41.6%
LMArena WebDev—1657
SciCode—59.7%
HumanEval+17.7%—
MBPP+23.3%—

Agentic & Tool Use Not comparable

Gemma 1.1 2b IT: —, Muse Spark 1.3: 38.6 (#30)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
APEX-Agents—57.8%
GDP.pdf—27.6%

Reasoning Muse Spark 1.3 leads

Gemma 1.1 2b IT: 19.1 (#270), Muse Spark 1.3: 54.0 (#27)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Hard Prompts10051503
NYT Connections (extended)—85.1%
CritPt—26%
Chess Puzzles—38%
Mystery Game Puzzles—25%
DTBench—96.5%
LMCA—53.9%
Bench to the Future 3—0.14
Epoch Capabilities Index—156.75

Math Muse Spark 1.3 leads

Gemma 1.1 2b IT: 30.8 (#232), Muse Spark 1.3: 73.1 (#21)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Math10471494
FrontierMath (Tiers 1-3)—74.4%
FrontierMath Tier 4—46.3%
OTIS Mock AIME 2024-2025—99.2%
ProofBench—58%

Knowledge Muse Spark 1.3 leads

Gemma 1.1 2b IT: 26.5 (#258), Muse Spark 1.3: 42.6 (#95)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Expert9701516

Multimodal Not comparable

Gemma 1.1 2b IT: —, Muse Spark 1.3: 43.7 (#22)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Vision—1309
LMArena Document—1471

Multilingual Muse Spark 1.3 leads

Gemma 1.1 2b IT: 24.6 (#289), Muse Spark 1.3: 57.4 (#8)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Non-English9881481
LMArena Chinese10121529
LMArena German9441515
LMArena Korean8991501
LMArena Russian9901490
LMArena French—1524
LMArena Japanese—1474
LMArena Spanish—1490

Instruction Following Muse Spark 1.3 leads

Gemma 1.1 2b IT: 49.9 (#299), Muse Spark 1.3: 77.5 (#22)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Instruction Following9921477

Long Context Muse Spark 1.3 leads

Gemma 1.1 2b IT: 30.6 (#286), Muse Spark 1.3: 45.6 (#32)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Longer Query10031488

Writing & Preference Muse Spark 1.3 leads

Gemma 1.1 2b IT: 25.1 (#306), Muse Spark 1.3: 73.6 (#9)

BenchmarkGemma 1.1 2b ITMuse Spark 1.3
LMArena Text10221490
LMArena Creative Writing9981455
LMArena Multi-Turn9591482
EQ-Bench Creative Writing—1906

Frequently asked questions

Is Gemma 1.1 2b IT better than Muse Spark 1.3?

Muse Spark 1.3 is the stronger model overall, scoring 54.8 to 29.3 on the Noometry Index.

Is Gemma 1.1 2b IT or Muse Spark 1.3 better for coding?

Muse Spark 1.3 scores higher on coding benchmarks: 56.6 versus 30.1 in the Noometry coding category.

How many benchmarks do Gemma 1.1 2b IT and Muse Spark 1.3 share?

14 benchmarks have published results for both models. Gemma 1.1 2b IT has 16 scored results on Noometry and Muse Spark 1.3 has 37.

Related comparisons

Go deeper