Noometry

Model comparison

Gemma 3n E4b IT vs GPT-4.5

Gemma 3n E4b IT and GPT-4.5 score almost the same on the Noometry Index (37.3 vs 37.2), so choose on price, context window or the category you care about most.

Last verified . 16 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

GPT-4.5 OpenAI

37.2

Rank #208 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemma 3n E4b IT scores higher in 3 categories and GPT-4.5 in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where GPT-4.5 leads 52.5 to 43.4.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 3n E4b ITGPT-4.5
ProviderGoogleOpenAI
Noometry Index37.337.2
Released—2025-02-27
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1842

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.5 leads

Gemma 3n E4b IT: 37.0 (#198), GPT-4.5: 42.2 (#109)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Coding12681396
Aider Polyglot—44.9%
WeirdML—39.4%
LiveBench Coding—75.2%

Agentic & Tool Use Not comparable

Gemma 3n E4b IT: —, GPT-4.5: 27.9 (#97)

BenchmarkGemma 3n E4b ITGPT-4.5
Cybench—17.5%

Reasoning Gemma 3n E4b IT leads

Gemma 3n E4b IT: 19.9 (#247), GPT-4.5: 13.9 (#330)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Hard Prompts12841403
ARC-AGI-2—0.8%
SimpleBench—34.5%
Kagi LLM Benchmark31.5%—
ARC-AGI-1—10.3%
EnigmaEval—3.2%
LiveBench Reasoning—71.1%
LiveBench Data Analysis—64.3%
Epoch Capabilities Index—136.74
ForecastBench—61.7
LiveBench—69%

Math Gemma 3n E4b IT leads

Gemma 3n E4b IT: 35.1 (#188), GPT-4.5: 32.6 (#211)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Math12511412
OTIS Mock AIME 2024-2025—37.8%
LiveBench Math—69.3%
MATH Level 5—78.6%

Knowledge Gemma 3n E4b IT leads

Gemma 3n E4b IT: 34.2 (#198), GPT-4.5: 32.5 (#211)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Expert12461394
GPQA Diamond—68.7%
Humanity's Last Exam—5.4%
Confabulations—13.6%

Multimodal Not comparable

Gemma 3n E4b IT: —, GPT-4.5: 37.6 (#71)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Vision—1195
VPCT—45%

Multilingual GPT-4.5 leads

Gemma 3n E4b IT: 43.4 (#183), GPT-4.5: 52.5 (#83)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Non-English12851413
LMArena Chinese13091421
LMArena French13301418
LMArena German13111457
LMArena Japanese12721416
LMArena Korean12591392
LMArena Russian12881419
LMArena Spanish1305—

Instruction Following GPT-4.5 leads

Gemma 3n E4b IT: 66.1 (#210), GPT-4.5: 72.6 (#134)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Instruction Following12551404
LiveBench Instruction Following—72.3%

Long Context GPT-4.5 leads

Gemma 3n E4b IT: 38.7 (#191), GPT-4.5: 40.4 (#155)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Longer Query12761406
Fiction.LiveBench—63.9%

Writing & Preference GPT-4.5 leads

Gemma 3n E4b IT: 50.1 (#186), GPT-4.5: 56.9 (#134)

BenchmarkGemma 3n E4b ITGPT-4.5
LMArena Text13061417
LMArena Creative Writing12871394
LMArena Multi-Turn12761444
Short-Story Creative Writing—75.6%
EQ-Bench Creative Writing—1258
LiveBench Language—61.5%

Frequently asked questions

Is Gemma 3n E4b IT better than GPT-4.5?

Gemma 3n E4b IT and GPT-4.5 score almost the same on the Noometry Index (37.3 vs 37.2), so choose on price, context window or the category you care about most.

Is Gemma 3n E4b IT or GPT-4.5 better for coding?

GPT-4.5 scores higher on coding benchmarks: 42.2 versus 37.0 in the Noometry coding category.

How many benchmarks do Gemma 3n E4b IT and GPT-4.5 share?

16 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and GPT-4.5 has 42.

Related comparisons

Go deeper