Model comparison

Claude Sonnet 5.5 vs Gemma 3n E4b IT

Claude Sonnet 5.5 is the stronger model overall, scoring 60.5 to 36.7 on the Noometry Index. Gemma 3n E4b IT costs 53× less per token, which makes it the better buy when Claude Sonnet 5.5's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Claude Sonnet 5.5 Anthropic

60.5

Rank #10 Confirmed

Gemma 3n E4b IT Google

36.7

Rank #203 Confirmed

Summary

  • The widest gap is in math, where Claude Sonnet 5.5 leads 88.7 to 32.5.
  • Gemma 3n E4b IT is cheaper at $0.06 / $0.12 per million input/output tokens, against $2 / $10 for Claude Sonnet 5.5.
  • Claude Sonnet 5.5 accepts more context: 1M tokens versus 33K.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 5.5 and Gemma 3n E4b IT specifications
Claude Sonnet 5.5Gemma 3n E4b IT
ProviderAnthropicGoogle
Noometry Index60.536.7
Released2026-09-282025-05-20
WeightsProprietaryOpen
Context window1M33K
Max output128K33K
Input $ / M tokens$2$0.06
Output $ / M tokens$10$0.12
Results tracked1618

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 65.5 (#6), Gemma 3n E4b IT: 36.4 (#193)

Coding benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
FrontierCode52.1%—
CursorBench55.5%—
LMArena WebDev1699—
FrontierSWE61.9%—
SciCode61%—
LMArena Coding—1269
ALE-Bench1,819—

Agentic & Tool Use Not comparable

Claude Sonnet 5.5: 44.9 (#14), Gemma 3n E4b IT: —

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
APEX-Agents75.5%—

Reasoning Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 52.4 (#29), Gemma 3n E4b IT: 19.2 (#239)

Reasoning benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
Kagi LLM Benchmark—31.5%
CritPt31.4%—
LMArena Hard Prompts—1284
Mystery Game Puzzles65%—

Math Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 88.7 (#4), Gemma 3n E4b IT: 32.5 (#186)

Math benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
FrontierMath (Tiers 1-3)88.8%—
FrontierMath Tier 480.5%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
LMArena Math—1251

Knowledge Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#11), Gemma 3n E4b IT: 33.6 (#193)

Knowledge benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
GPQA Diamond95.6%—
SimpleQA Verified46.5%—
LMArena Expert—1245

Multimodal Not comparable

Claude Sonnet 5.5: 53.2 (#5), Gemma 3n E4b IT: —

Multimodal benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
Furniture Assembly75%—

Multilingual Not comparable

Claude Sonnet 5.5: —, Gemma 3n E4b IT: 43.5 (#179)

Multilingual benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Non-English—1285
LMArena Chinese—1310
LMArena French—1330
LMArena German—1312
LMArena Japanese—1274
LMArena Korean—1259
LMArena Russian—1288
LMArena Spanish—1305

Instruction Following Not comparable

Claude Sonnet 5.5: —, Gemma 3n E4b IT: 66.3 (#205)

Instruction Following benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Instruction Following—1255

Long Context Not comparable

Claude Sonnet 5.5: —, Gemma 3n E4b IT: 38.8 (#185)

Long Context benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Longer Query—1277

Writing & Preference Not comparable

Claude Sonnet 5.5: —, Gemma 3n E4b IT: 50.3 (#181)

Writing & Preference benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Text—1306
LMArena Creative Writing—1287
LMArena Multi-Turn—1276

Frequently asked questions

Is Claude Sonnet 5.5 better than Gemma 3n E4b IT?

Claude Sonnet 5.5 is the stronger model overall, scoring 60.5 to 36.7 on the Noometry Index. Gemma 3n E4b IT costs 53× less per token, which makes it the better buy when Claude Sonnet 5.5's lead doesn't matter for your workload.

Which is cheaper, Claude Sonnet 5.5 or Gemma 3n E4b IT?

Gemma 3n E4b IT is cheaper. It lists at $0.06 per million input tokens and $0.12 per million output tokens; Claude Sonnet 5.5 lists at $2 and $10.

Is Claude Sonnet 5.5 or Gemma 3n E4b IT better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 65.5 versus 36.4 in the Noometry coding category.

Which has the bigger context window?

Claude Sonnet 5.5 does, with 1M tokens against 33K.

How many benchmarks do Claude Sonnet 5.5 and Gemma 3n E4b IT share?

0 benchmarks have published results for both models. Claude Sonnet 5.5 has 16 scored results on Noometry and Gemma 3n E4b IT has 18.

Related comparisons

Go deeper