Noometry

Model comparison

Gemma 3 1B vs Grok 4.6

Grok 4.6 is the stronger model overall, scoring 56.9 to 21.1 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Grok 4.6 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.6 leads 67.0 to 10.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 99.2% for Grok 4.6.
  • Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 1BGrok 4.6
ProviderGooglexAI
Noometry Index21.156.9
Released2025-03-122026-08-12
WeightsOpenProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked449

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Grok 4.6: 58.5 (#16)

BenchmarkGemma 3 1BGrok 4.6
DeepSWE—67.5%
FrontierCode—48%
CursorBench—41.4%
LMArena WebDev—1617
FrontierSWE—25.3%
SciCode—56.5%
WeirdML—67.3%
LMArena Coding—1465
ALE-Bench—1,508

Agentic & Tool Use Grok 4.6 leads

Gemma 3 1B: 13.7 (#152), Grok 4.6: 39.4 (#27)

BenchmarkGemma 3 1BGrok 4.6
APEX-Agents—65.3%
Berkeley Function Calling Leaderboard7.2%—
GDP.pdf—17.2%
Vending-Bench 2—9,047

Reasoning Grok 4.6 leads

Gemma 3 1B: 19.2 (#264), Grok 4.6: 61.4 (#20)

BenchmarkGemma 3 1BGrok 4.6
Chess Puzzles0%40%
ARC-AGI-2—67.1%
SimpleBench—75.9%
NYT Connections (extended)—80%
ARC-AGI-1—87.5%
CritPt—19.7%
EBR-Bench—30.5%
LMArena Hard Prompts—1447
Mystery Game Puzzles—34%
DTBench—97.3%
LMCA—48.5%
Epoch Capabilities Index—156.44

Math Grok 4.6 leads

Gemma 3 1B: 10.2 (#316), Grok 4.6: 67.0 (#24)

BenchmarkGemma 3 1BGrok 4.6
OTIS Mock AIME 2024-20251.1%99.2%
FrontierMath (Tiers 1-3)—66%
FrontierMath Tier 4—31.7%
ProofBench—51%
LMArena Math—1423

Knowledge Grok 4.6 leads

Gemma 3 1B: 7.0 (#314), Grok 4.6: 63.3 (#20)

BenchmarkGemma 3 1BGrok 4.6
GPQA Diamond19.9%94%
SimpleQA Verified—49.3%
LMArena Expert—1467

Multimodal Not comparable

Gemma 3 1B: —, Grok 4.6: 43.6 (#23)

BenchmarkGemma 3 1BGrok 4.6
LMArena Vision—1263
Blueprint-Bench 2—33.2%
Furniture Assembly—40%
LMArena Document—1452

Multilingual Not comparable

Gemma 3 1B: —, Grok 4.6: 53.0 (#74)

BenchmarkGemma 3 1BGrok 4.6
LMArena Non-English—1420
LMArena Chinese—1480
LMArena French—1461
LMArena German—1431
LMArena Japanese—1376
LMArena Korean—1397
LMArena Russian—1422
LMArena Spanish—1404

Instruction Following Not comparable

Gemma 3 1B: —, Grok 4.6: 75.4 (#63)

BenchmarkGemma 3 1BGrok 4.6
LMArena Instruction Following—1431

Long Context Not comparable

Gemma 3 1B: —, Grok 4.6: 44.5 (#66)

BenchmarkGemma 3 1BGrok 4.6
LMArena Longer Query—1454

Writing & Preference Not comparable

Gemma 3 1B: —, Grok 4.6: 62.3 (#80)

BenchmarkGemma 3 1BGrok 4.6
LMArena Text—1428
LMArena Creative Writing—1428
LMArena Multi-Turn—1425

Frequently asked questions

Is Gemma 3 1B better than Grok 4.6?

Grok 4.6 is the stronger model overall, scoring 56.9 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Grok 4.6 share?

3 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Grok 4.6 has 49.

Related comparisons

Go deeper