Noometry

Model comparison

Claude Fable 5.1 vs Gemma 3n E4b IT

Claude Fable 5.1 is the stronger model overall, scoring 69.0 to 37.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude Fable 5.1 Anthropic

69.0

Rank #2 Confirmed

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Claude Fable 5.1 scores higher in 8 categories and Gemma 3n E4b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Fable 5.1 leads 76.7 to 19.9.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Claude Fable 5.1Gemma 3n E4b IT
ProviderAnthropicGoogle
Noometry Index69.037.3
Released2026-09-01—
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$10—
Output $ / M tokens$50—
Results tracked5218

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Fable 5.1 leads

Claude Fable 5.1: 74.7 (#1), Gemma 3n E4b IT: 37.0 (#198)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Coding15281268
FrontierCode50.9%—
CursorBench51.8%—
LMArena WebDev1744—
FrontierSWE56.3%—
SciCode63.1%—
GSO88.2%—
WeirdML92.9%—
MirrorCode73.3%—
ALE-Bench2,143—

Agentic & Tool Use Not comparable

Claude Fable 5.1: 50.7 (#5), Gemma 3n E4b IT: —

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
APEX-Agents68.6%—
Remote Labor Index17.9%—
GDP.pdf29.6%—
Vending-Bench 25,422—

Reasoning Claude Fable 5.1 leads

Claude Fable 5.1: 76.7 (#7), Gemma 3n E4b IT: 19.9 (#247)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Hard Prompts15261284
ARC-AGI-290%—
Kagi LLM Benchmark—31.5%
NYT Connections (extended)90%—
ARC-AGI-197.5%—
CritPt31.1%—
Chess Puzzles47%—
EBR-Bench57.1%—
Mystery Game Puzzles58%—
DTBench97.6%—
LMCA65.5%—
Epoch Capabilities Index164.7—

Math Claude Fable 5.1 leads

Claude Fable 5.1: 89.6 (#4), Gemma 3n E4b IT: 35.1 (#188)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Math15251251
FrontierMath (Tiers 1-3)90.2%—
FrontierMath Tier 487.8%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
FrontierMath Erdős0%—

Knowledge Claude Fable 5.1 leads

Claude Fable 5.1: 69.6 (#6), Gemma 3n E4b IT: 34.2 (#198)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Expert15351246
Humanity's Last Exam46.5%—
SimpleQA Verified70.8%—

Multimodal Not comparable

Claude Fable 5.1: 53.9 (#4), Gemma 3n E4b IT: —

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Vision1318—
Blueprint-Bench 241.9%—
Furniture Assembly70%—
LMArena Document1513—

Multilingual Claude Fable 5.1 leads

Claude Fable 5.1: 59.1 (#3), Gemma 3n E4b IT: 43.4 (#183)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Non-English15071285
LMArena Chinese15861309
LMArena French15251330
LMArena German15001311
LMArena Japanese15431272
LMArena Korean15341259
LMArena Russian15211288
LMArena Spanish15161305

Instruction Following Claude Fable 5.1 leads

Claude Fable 5.1: 79.2 (#6), Gemma 3n E4b IT: 66.1 (#210)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Instruction Following15171255

Long Context Claude Fable 5.1 leads

Claude Fable 5.1: 46.7 (#20), Gemma 3n E4b IT: 38.7 (#191)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Longer Query15221276

Writing & Preference Claude Fable 5.1 leads

Claude Fable 5.1: 79.2 (#2), Gemma 3n E4b IT: 50.1 (#186)

BenchmarkClaude Fable 5.1Gemma 3n E4b IT
LMArena Text15101306
LMArena Creative Writing15071287
LMArena Multi-Turn14921276
EQ-Bench Creative Writing2162—

Frequently asked questions

Is Claude Fable 5.1 better than Gemma 3n E4b IT?

Claude Fable 5.1 is the stronger model overall, scoring 69.0 to 37.3 on the Noometry Index.

Is Claude Fable 5.1 or Gemma 3n E4b IT better for coding?

Claude Fable 5.1 scores higher on coding benchmarks: 74.7 versus 37.0 in the Noometry coding category.

How many benchmarks do Claude Fable 5.1 and Gemma 3n E4b IT share?

17 benchmarks have published results for both models. Claude Fable 5.1 has 52 scored results on Noometry and Gemma 3n E4b IT has 18.

Related comparisons

Go deeper