Noometry

Model comparison

Gemma 1.1 2b IT vs GPT-5.6 Luna

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 29.3 on the Noometry Index.

Last verified . 14 shared benchmarks.

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

GPT-5.6 Luna OpenAI

54.6

Rank #30 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Gemma 1.1 2b IT scores higher in 0 categories and GPT-5.6 Luna in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Luna leads 77.7 to 30.8.
  • Gemma 1.1 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 1.1 2b ITGPT-5.6 Luna
ProviderGoogleOpenAI
Noometry Index29.354.6
Released—2026-07-09
WeightsOpenProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$0.20
Output $ / M tokens—$1.20
Results tracked1652

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Luna leads

Gemma 1.1 2b IT: 30.1 (#299), GPT-5.6 Luna: 54.5 (#28)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Coding10341466
DeepSWE—67.2%
FrontierCode—39.8%
CursorBench—35.9%
LMArena WebDev—1519
SciCode—53.6%
WeirdML—60.9%
ALE-Bench—1,667
HumanEval+17.7%—
MBPP+23.3%—

Agentic & Tool Use Not comparable

Gemma 1.1 2b IT: —, GPT-5.6 Luna: 34.4 (#45)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
APEX-Agents—43%
BALROG—45.6%
GDP.pdf—22.7%
Vending-Bench 2—4,095

Reasoning GPT-5.6 Luna leads

Gemma 1.1 2b IT: 19.1 (#270), GPT-5.6 Luna: 47.6 (#43)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Hard Prompts10051451
ARC-AGI-2—59.5%
SimpleBench—46.8%
Kagi LLM Benchmark—49.1%
NYT Connections (extended)—69.4%
ARC-AGI-1—88%
CritPt—20.6%
Chess Puzzles—40%
Mystery Game Puzzles—21%
DTBench—89.1%
LMCA—48.5%
Surface Evolver Bench—61.9%
Epoch Capabilities Index—156.39

Math GPT-5.6 Luna leads

Gemma 1.1 2b IT: 30.8 (#232), GPT-5.6 Luna: 77.7 (#14)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Math10471458
FrontierMath (Tiers 1-3)—82.1%
FrontierMath Tier 4—61%
OTIS Mock AIME 2024-2025—98.3%
ProofBench—60%

Knowledge GPT-5.6 Luna leads

Gemma 1.1 2b IT: 26.5 (#258), GPT-5.6 Luna: 58.5 (#34)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Expert9701478
GPQA Diamond—91.6%
SimpleQA Verified—41%

Multimodal Not comparable

Gemma 1.1 2b IT: —, GPT-5.6 Luna: 42.7 (#28)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Vision—1258
Blueprint-Bench 2—22.6%
Furniture Assembly—42.5%
LMArena Document—1457

Multilingual GPT-5.6 Luna leads

Gemma 1.1 2b IT: 24.6 (#289), GPT-5.6 Luna: 52.8 (#78)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Non-English9881417
LMArena Chinese10121470
LMArena German9441454
LMArena Korean8991415
LMArena Russian9901428
LMArena French—1456
LMArena Japanese—1411
LMArena Spanish—1448

Instruction Following GPT-5.6 Luna leads

Gemma 1.1 2b IT: 49.9 (#299), GPT-5.6 Luna: 75.6 (#57)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Instruction Following9921437

Long Context GPT-5.6 Luna leads

Gemma 1.1 2b IT: 30.6 (#286), GPT-5.6 Luna: 43.9 (#82)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Longer Query10031436

Writing & Preference GPT-5.6 Luna leads

Gemma 1.1 2b IT: 25.1 (#306), GPT-5.6 Luna: 68.0 (#29)

BenchmarkGemma 1.1 2b ITGPT-5.6 Luna
LMArena Text10221431
LMArena Creative Writing9981396
LMArena Multi-Turn9591434
EQ-Bench Creative Writing—1829
EQ-Bench 4—1156

Frequently asked questions

Is Gemma 1.1 2b IT better than GPT-5.6 Luna?

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 29.3 on the Noometry Index.

Is Gemma 1.1 2b IT or GPT-5.6 Luna better for coding?

GPT-5.6 Luna scores higher on coding benchmarks: 54.5 versus 30.1 in the Noometry coding category.

How many benchmarks do Gemma 1.1 2b IT and GPT-5.6 Luna share?

14 benchmarks have published results for both models. Gemma 1.1 2b IT has 16 scored results on Noometry and GPT-5.6 Luna has 52.

Related comparisons

Go deeper