Model comparison

Gemma 3n E4b IT vs GPT-5.6 Luna

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 37.3 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

GPT-5.6 Luna OpenAI

54.6

Rank #30 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemma 3n E4b IT scores higher in 0 categories and GPT-5.6 Luna in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Luna leads 77.7 to 35.1.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 31.5% for Gemma 3n E4b IT and 49.1% for GPT-5.6 Luna.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 3n E4b IT and GPT-5.6 Luna specifications
Gemma 3n E4b ITGPT-5.6 Luna
ProviderGoogleOpenAI
Noometry Index37.354.6
Released—2026-07-09
WeightsOpenProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$0.20
Output $ / M tokens—$1.20
Results tracked1852

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Luna leads

Gemma 3n E4b IT: 37.0 (#198), GPT-5.6 Luna: 54.5 (#28)

Coding benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Coding12681466
DeepSWE—67.2%
FrontierCode—39.8%
CursorBench—35.9%
LMArena WebDev—1519
SciCode—53.6%
WeirdML—60.9%
ALE-Bench—1,667

Agentic & Tool Use Not comparable

Gemma 3n E4b IT: —, GPT-5.6 Luna: 34.4 (#45)

Agentic & Tool Use benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
APEX-Agents—43%
BALROG—45.6%
GDP.pdf—22.7%
Vending-Bench 2—4,095

Reasoning GPT-5.6 Luna leads

Gemma 3n E4b IT: 19.9 (#247), GPT-5.6 Luna: 47.6 (#43)

Reasoning benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
Kagi LLM Benchmark31.5%49.1%
LMArena Hard Prompts12841451
ARC-AGI-2—59.5%
SimpleBench—46.8%
NYT Connections (extended)—69.4%
ARC-AGI-1—88%
CritPt—20.6%
Chess Puzzles—40%
Mystery Game Puzzles—21%
DTBench—89.1%
LMCA—48.5%
Surface Evolver Bench—61.9%
Epoch Capabilities Index—156.39

Math GPT-5.6 Luna leads

Gemma 3n E4b IT: 35.1 (#188), GPT-5.6 Luna: 77.7 (#14)

Math benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Math12511458
FrontierMath (Tiers 1-3)—82.1%
FrontierMath Tier 4—61%
OTIS Mock AIME 2024-2025—98.3%
ProofBench—60%

Knowledge GPT-5.6 Luna leads

Gemma 3n E4b IT: 34.2 (#198), GPT-5.6 Luna: 58.5 (#34)

Knowledge benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Expert12461478
GPQA Diamond—91.6%
SimpleQA Verified—41%

Multimodal Not comparable

Gemma 3n E4b IT: —, GPT-5.6 Luna: 42.7 (#28)

Multimodal benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Vision—1258
Blueprint-Bench 2—22.6%
Furniture Assembly—42.5%
LMArena Document—1457

Multilingual GPT-5.6 Luna leads

Gemma 3n E4b IT: 43.4 (#183), GPT-5.6 Luna: 52.8 (#78)

Multilingual benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Non-English12851417
LMArena Chinese13091470
LMArena French13301456
LMArena German13111454
LMArena Japanese12721411
LMArena Korean12591415
LMArena Russian12881428
LMArena Spanish13051448

Instruction Following GPT-5.6 Luna leads

Gemma 3n E4b IT: 66.1 (#210), GPT-5.6 Luna: 75.6 (#57)

Instruction Following benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Instruction Following12551437

Long Context GPT-5.6 Luna leads

Gemma 3n E4b IT: 38.7 (#191), GPT-5.6 Luna: 43.9 (#82)

Long Context benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Longer Query12761436

Writing & Preference GPT-5.6 Luna leads

Gemma 3n E4b IT: 50.1 (#186), GPT-5.6 Luna: 68.0 (#29)

Writing & Preference benchmarks
BenchmarkGemma 3n E4b ITGPT-5.6 Luna
LMArena Text13061431
LMArena Creative Writing12871396
LMArena Multi-Turn12761434
EQ-Bench Creative Writing—1829
EQ-Bench 4—1156

Frequently asked questions

Is Gemma 3n E4b IT better than GPT-5.6 Luna?

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 37.3 on the Noometry Index.

Is Gemma 3n E4b IT or GPT-5.6 Luna better for coding?

GPT-5.6 Luna scores higher on coding benchmarks: 54.5 versus 37.0 in the Noometry coding category.

How many benchmarks do Gemma 3n E4b IT and GPT-5.6 Luna share?

18 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and GPT-5.6 Luna has 52.

Related comparisons

Go deeper