Model comparison

Gemma 7B vs Laguna M.1

Laguna M.1 is the stronger model overall, scoring 31.9 to 29.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 7B Google

29.5

Rank #295 Confirmed

Laguna M.1 Poolside

31.9

Rank #252 Reported

Summary

  • The widest gap is in math, where Gemma 7B leads 28.7 to 20.3.

Side by side

Gemma 7B and Laguna M.1 specifications
Gemma 7BLaguna M.1
ProviderGooglePoolside
Noometry Index29.531.9
Released2024-02-212026-04-28
WeightsOpenOpen
Context window—262K
Max output—33K
Input $ / M tokens——
Output $ / M tokens——
Results tracked273

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Laguna M.1 leads

Gemma 7B: 29.9 (#290), Laguna M.1: 36.4 (#195)

Coding benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena WebDev—1348
LMArena Coding1048—
HumanEval+28.7%—
MBPP+43.4%—

Reasoning Laguna M.1 leads

Gemma 7B: 19.0 (#247), Laguna M.1: 21.9 (#187)

Reasoning benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Hard Prompts1042—
Surface Evolver Bench—15.6%
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
Epoch Capabilities Index111.74—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Gemma 7B leads

Gemma 7B: 28.7 (#225), Laguna M.1: 20.3 (#276)

Math benchmarks
BenchmarkGemma 7BLaguna M.1
ProofBench—0%
LMArena Math1066—
GSM8K46.4%—

Knowledge Not comparable

Gemma 7B: 26.8 (#248), Laguna M.1: —

Knowledge benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Expert1002—
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Not comparable

Gemma 7B: 25.3 (#282), Laguna M.1: —

Multilingual benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Non-English999—
LMArena Chinese1035—
LMArena French1024—
LMArena Russian993—

Instruction Following Not comparable

Gemma 7B: 51.7 (#290), Laguna M.1: —

Instruction Following benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Instruction Following1017—

Long Context Not comparable

Gemma 7B: 31.1 (#277), Laguna M.1: —

Long Context benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Longer Query1022—

Writing & Preference Not comparable

Gemma 7B: 27.2 (#297), Laguna M.1: —

Writing & Preference benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Text1056—
LMArena Creative Writing1024—
LMArena Multi-Turn963—

Frequently asked questions

Is Gemma 7B better than Laguna M.1?

Laguna M.1 is the stronger model overall, scoring 31.9 to 29.5 on the Noometry Index.

Is Gemma 7B or Laguna M.1 better for coding?

Laguna M.1 scores higher on coding benchmarks: 36.4 versus 29.9 in the Noometry coding category.

How many benchmarks do Gemma 7B and Laguna M.1 share?

0 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Laguna M.1 has 3.

Related comparisons

Go deeper