Model comparison

Gemini 1.5 Flash 8B vs Muse Spark 1.3

Muse Spark 1.3 is the stronger model overall, scoring 54.8 to 29.9 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Muse Spark 1.3 Meta

54.8

Rank #27 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Muse Spark 1.3 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Muse Spark 1.3 leads 73.1 to 14.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 99.2% for Muse Spark 1.3.

Side by side

Gemini 1.5 Flash 8B and Muse Spark 1.3 specifications
Gemini 1.5 Flash 8BMuse Spark 1.3
ProviderGoogleMeta
Noometry Index29.954.8
Released2024-10-032026-09-02
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked2137

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 35.5 (#225), Muse Spark 1.3: 56.6 (#21)

Coding benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Coding12181514
CursorBench—41.6%
LMArena WebDev—1657
SciCode—59.7%

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Muse Spark 1.3: 38.6 (#30)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
APEX-Agents—57.8%
GDP.pdf—27.6%

Reasoning Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 20.0 (#244), Muse Spark 1.3: 54.0 (#27)

Reasoning benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Hard Prompts12091503
DTBench50%96.5%
NYT Connections (extended)—85.1%
CritPt—26%
Chess Puzzles—38%
Mystery Game Puzzles—25%
LMCA—53.9%
Bench to the Future 3—0.14
Epoch Capabilities Index—156.75

Math Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 14.2 (#302), Muse Spark 1.3: 73.1 (#21)

Math benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
OTIS Mock AIME 2024-20254.6%99.2%
LMArena Math12071494
FrontierMath (Tiers 1-3)—74.4%
FrontierMath Tier 4—46.3%
ProofBench—58%

Knowledge Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 16.0 (#289), Muse Spark 1.3: 42.6 (#95)

Knowledge benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Expert11851516
GPQA Diamond33%—

Multimodal Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 28.2 (#115), Muse Spark 1.3: 43.7 (#22)

Multimodal benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Vision10441309
LMArena Document—1471

Multilingual Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 38.5 (#229), Muse Spark 1.3: 57.4 (#8)

Multilingual benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Non-English12151481
LMArena Chinese12311529
LMArena French12341524
LMArena German12061515
LMArena Japanese11501474
LMArena Korean11401501
LMArena Russian12361490
LMArena Spanish12121490

Instruction Following Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 62.8 (#236), Muse Spark 1.3: 77.5 (#22)

Instruction Following benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Instruction Following11991477

Long Context Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 37.0 (#225), Muse Spark 1.3: 45.6 (#32)

Long Context benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Longer Query12191488

Writing & Preference Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 42.8 (#232), Muse Spark 1.3: 73.6 (#9)

Writing & Preference benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Text12261490
LMArena Creative Writing12181455
LMArena Multi-Turn11851482
EQ-Bench Creative Writing—1906

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Muse Spark 1.3?

Muse Spark 1.3 is the stronger model overall, scoring 54.8 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Muse Spark 1.3 better for coding?

Muse Spark 1.3 scores higher on coding benchmarks: 56.6 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Muse Spark 1.3 share?

20 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Muse Spark 1.3 has 37.

Related comparisons

Go deeper