Noometry

Model comparison

Gemma 2B vs Grok 4.6

Grok 4.6 is the stronger model overall, scoring 56.9 to 29.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 2B scores higher in 0 categories and Grok 4.6 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.6 leads 61.4 to 18.8.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemma 2BGrok 4.6
ProviderGooglexAI
Noometry Index29.656.9
Released2024-02-212026-08-12
WeightsOpenProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked2349

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.6 leads

Gemma 2B: 29.4 (#305), Grok 4.6: 58.5 (#16)

BenchmarkGemma 2BGrok 4.6
LMArena Coding10101465
DeepSWE—67.5%
FrontierCode—48%
CursorBench—41.4%
LMArena WebDev—1617
FrontierSWE—25.3%
SciCode—56.5%
WeirdML—67.3%
ALE-Bench—1,508
HumanEval+20.7%—
MBPP+34.1%—

Agentic & Tool Use Not comparable

Gemma 2B: —, Grok 4.6: 39.4 (#27)

BenchmarkGemma 2BGrok 4.6
APEX-Agents—65.3%
GDP.pdf—17.2%
Vending-Bench 2—9,047

Reasoning Grok 4.6 leads

Gemma 2B: 18.8 (#275), Grok 4.6: 61.4 (#20)

BenchmarkGemma 2BGrok 4.6
LMArena Hard Prompts9891447
Epoch Capabilities Index94.2156.44
ARC-AGI-2—67.1%
SimpleBench—75.9%
NYT Connections (extended)—80%
ARC-AGI-1—87.5%
CritPt—19.7%
Chess Puzzles—40%
EBR-Bench—30.5%
Mystery Game Puzzles—34%
DTBench—97.3%
LMCA—48.5%
BIG-Bench Hard35.2%—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Grok 4.6 leads

Gemma 2B: 30.0 (#239), Grok 4.6: 67.0 (#24)

BenchmarkGemma 2BGrok 4.6
LMArena Math10091423
FrontierMath (Tiers 1-3)—66%
FrontierMath Tier 4—31.7%
OTIS Mock AIME 2024-2025—99.2%
ProofBench—51%
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, Grok 4.6: 63.3 (#20)

BenchmarkGemma 2BGrok 4.6
GPQA Diamond—94%
SimpleQA Verified—49.3%
LMArena Expert—1467
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multimodal Not comparable

Gemma 2B: —, Grok 4.6: 43.6 (#23)

BenchmarkGemma 2BGrok 4.6
LMArena Vision—1263
Blueprint-Bench 2—33.2%
Furniture Assembly—40%
LMArena Document—1452

Multilingual Grok 4.6 leads

Gemma 2B: 23.0 (#294), Grok 4.6: 53.0 (#74)

BenchmarkGemma 2BGrok 4.6
LMArena Non-English9581420
LMArena Chinese9861480
LMArena Russian9371422
LMArena French—1461
LMArena German—1431
LMArena Japanese—1376
LMArena Korean—1397
LMArena Spanish—1404

Instruction Following Grok 4.6 leads

Gemma 2B: 48.5 (#302), Grok 4.6: 75.4 (#63)

BenchmarkGemma 2BGrok 4.6
LMArena Instruction Following9701431

Long Context Grok 4.6 leads

Gemma 2B: 29.9 (#291), Grok 4.6: 44.5 (#66)

BenchmarkGemma 2BGrok 4.6
LMArena Longer Query9811454

Writing & Preference Grok 4.6 leads

Gemma 2B: 24.0 (#308), Grok 4.6: 62.3 (#80)

BenchmarkGemma 2BGrok 4.6
LMArena Text10021428
LMArena Creative Writing9871428
LMArena Multi-Turn9451425

Frequently asked questions

Is Gemma 2B better than Grok 4.6?

Grok 4.6 is the stronger model overall, scoring 56.9 to 29.6 on the Noometry Index.

Is Gemma 2B or Grok 4.6 better for coding?

Grok 4.6 scores higher on coding benchmarks: 58.5 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2B and Grok 4.6 share?

12 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and Grok 4.6 has 49.

Related comparisons

Go deeper