Noometry

Model comparison

Gemini 2.5 Flash vs Muse Glimmer

Muse Glimmer is the stronger model overall, scoring 41.3 to 39.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemini 2.5 Flash Google

39.0

Rank #162 Confirmed

Muse Glimmer Meta

41.3

Rank #128 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 4 categories and Muse Glimmer in 4 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Glimmer leads 27.2 to 18.2.
  • Muse Glimmer has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 FlashMuse Glimmer
ProviderGoogleMeta
Noometry Index39.041.3
Released2025-04-17—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5413

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Glimmer leads

Gemini 2.5 Flash: 35.5 (#210), Muse Glimmer: 38.7 (#157)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Coding14241417
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
LMArena WebDev—1355
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.6 (#67), Muse Glimmer: —

BenchmarkGemini 2.5 FlashMuse Glimmer
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Muse Glimmer leads

Gemini 2.5 Flash: 18.2 (#271), Muse Glimmer: 27.2 (#111)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Hard Prompts14221395
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.04—
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 38.1 (#87), Muse Glimmer: 36.1 (#128)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Math14151419
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Muse Glimmer leads

Gemini 2.5 Flash: 36.1 (#162), Muse Glimmer: 37.9 (#140)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Expert14261388
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.2 (#31), Muse Glimmer: —

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Vision1254—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Gemini 2.5 Flash leads

Gemini 2.5 Flash: 52.5 (#83), Muse Glimmer: 50.6 (#117)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Non-English14101384
LMArena Chinese14501412
LMArena Russian14151393
LMArena French1433—
LMArena German1419—
LMArena Japanese1403—
LMArena Korean1385—
LMArena Spanish1421—

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.9 (#50), Muse Glimmer: 72.7 (#134)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Instruction Following14051374
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#16), Muse Glimmer: 42.1 (#124)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Longer Query14191381
Fiction.LiveBench77.8%—

Writing & Preference Muse Glimmer leads

Gemini 2.5 Flash: 54.0 (#153), Muse Glimmer: 57.7 (#122)

BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Text14171389
LMArena Creative Writing14001338
LMArena Multi-Turn14081398
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Muse Glimmer?

Muse Glimmer is the stronger model overall, scoring 41.3 to 39.0 on the Noometry Index.

Is Gemini 2.5 Flash or Muse Glimmer better for coding?

Muse Glimmer scores higher on coding benchmarks: 38.7 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Muse Glimmer share?

12 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Muse Glimmer has 13.

Related comparisons

Go deeper