Noometry

Model comparison

Gemma 3n E4b IT vs Molmo 2 8b

Molmo 2 8b is the stronger model overall, scoring 39.1 to 37.3 on the Noometry Index.

Last verified . 4 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Molmo 2 8b Allen Institute for AI (Ai2)

39.1

Rank #174 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Gemma 3n E4b IT scores higher in 2 categories and Molmo 2 8b in 2 categories; one gap is clear of the uncertainty.
  • The widest gap is in reasoning, where Molmo 2 8b leads 25.6 to 19.9.

Side by side

Gemma 3n E4b ITMolmo 2 8b
ProviderGoogleAllen Institute for AI (Ai2)
Noometry Index37.339.1
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked185

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3n E4b IT: 37.0 (#198), Molmo 2 8b: —

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Coding1268—

Reasoning Molmo 2 8b leads

Gemma 3n E4b IT: 19.9 (#247), Molmo 2 8b: 25.6 (#146)

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Hard Prompts12841287
Kagi LLM Benchmark31.5%—

Math Not comparable

Gemma 3n E4b IT: 35.1 (#188), Molmo 2 8b: —

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Math1251—

Knowledge Not comparable

Gemma 3n E4b IT: 34.2 (#198), Molmo 2 8b: —

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Expert1246—

Multimodal Not comparable

Gemma 3n E4b IT: —, Molmo 2 8b: 30.2 (#112)

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Vision—1081

Multilingual Too close to call

Gemma 3n E4b IT: 43.4 (#183), Molmo 2 8b: 42.7 (#190)

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Non-English12851276
LMArena Chinese1309—
LMArena French1330—
LMArena German1311—
LMArena Japanese1272—
LMArena Korean1259—
LMArena Russian1288—
LMArena Spanish1305—

Instruction Following Too close to call

Gemma 3n E4b IT: 66.1 (#210), Molmo 2 8b: 67.0 (#201)

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Instruction Following12551270

Long Context Not comparable

Gemma 3n E4b IT: 38.7 (#191), Molmo 2 8b: —

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Longer Query1276—

Writing & Preference Too close to call

Gemma 3n E4b IT: 50.1 (#186), Molmo 2 8b: 49.4 (#191)

BenchmarkGemma 3n E4b ITMolmo 2 8b
LMArena Text13061288
LMArena Creative Writing1287—
LMArena Multi-Turn1276—

Frequently asked questions

Is Gemma 3n E4b IT better than Molmo 2 8b?

Molmo 2 8b is the stronger model overall, scoring 39.1 to 37.3 on the Noometry Index.

How many benchmarks do Gemma 3n E4b IT and Molmo 2 8b share?

4 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Molmo 2 8b has 5.

Related comparisons

Go deeper