Noometry

Model comparison

Grok-3 mini vs Llama 4 Scout

Grok-3 mini is the stronger model overall, scoring 41.0 to 27.4 on the Noometry Index.

Last verified . 31 shared benchmarks.

Grok-3 mini xAI

41.0

Rank #130 Confirmed

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Summary

  • They share 31 benchmarks with published results for both. Grok-3 mini scores higher in 8 categories and Llama 4 Scout in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok-3 mini leads 40.3 to 18.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 77.8% for Grok-3 mini and 7.8% for Llama 4 Scout.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Grok-3 miniLlama 4 Scout
ProviderxAIMeta
Noometry Index41.027.4
Released2025-04-092025-04-05
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked3543

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok-3 mini leads

Grok-3 mini: 40.4 (#126), Llama 4 Scout: 19.9 (#334)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Coding13801286
SWE-bench Verified (bash only)—9.1%
Aider Polyglot49.3%—
SciCode—17%
WeirdML42.6%—
BigCodeBench Complete—43.1%

Agentic & Tool Use Not comparable

Grok-3 mini: —, Llama 4 Scout: 24.4 (#109)

BenchmarkGrok-3 miniLlama 4 Scout
Berkeley Function Calling Leaderboard—28.1%

Reasoning Grok-3 mini leads

Grok-3 mini: 13.8 (#323), Llama 4 Scout: 9.2 (#339)

BenchmarkGrok-3 miniLlama 4 Scout
ARC-AGI-20.4%0%
Kagi LLM Benchmark61.3%36.9%
ARC-AGI-116.5%0.5%
LMArena Hard Prompts13741266
Epoch Capabilities Index140.35129.64
CritPt—0%
DTBench—57.9%
LMCA—12%
ForecastBench—57.5

Math Grok-3 mini leads

Grok-3 mini: 40.3 (#78), Llama 4 Scout: 18.4 (#280)

BenchmarkGrok-3 miniLlama 4 Scout
OTIS Mock AIME 2024-202577.8%7.8%
Omni-MATH31.8%37.3%
LMArena Math13861286
MATH Level 590.9%62.3%
FrontierMath (Feb 2025 set)5.9%0%

Knowledge Grok-3 mini leads

Grok-3 mini: 46.3 (#75), Llama 4 Scout: 31.8 (#208)

BenchmarkGrok-3 miniLlama 4 Scout
GPQA Diamond76.3%51.8%
MMLU-Pro79.9%74.2%
GPQA (HELM)67.5%50.7%
LMArena Expert13951236
Confabulations10.8%—
Vectara Hallucination Rate—7.7%

Multimodal Not comparable

Grok-3 mini: —, Llama 4 Scout: 31.6 (#98)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual Grok-3 mini leads

Grok-3 mini: 48.3 (#141), Llama 4 Scout: 41.3 (#207)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Non-English13521253
LMArena Chinese13871256
LMArena French13571283
LMArena German13501274
LMArena Japanese13431209
LMArena Korean13361207
LMArena Russian13521263
LMArena Spanish13791277

Instruction Following Grok-3 mini leads

Grok-3 mini: 78.7 (#8), Llama 4 Scout: 66.0 (#212)

BenchmarkGrok-3 miniLlama 4 Scout
IFEval95.1%81.8%
LMArena Instruction Following13561248

Long Context Grok-3 mini leads

Grok-3 mini: 41.0 (#142), Llama 4 Scout: 27.5 (#289)

BenchmarkGrok-3 miniLlama 4 Scout
Fiction.LiveBench66.7%36%
LMArena Longer Query13721265

Writing & Preference Grok-3 mini leads

Grok-3 mini: 52.7 (#163), Llama 4 Scout: 37.1 (#256)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Text13701279
LMArena Creative Writing13421249
WildBench65.1%78%
LMArena Multi-Turn13551281
Short-Story Creative Writing73.5%—
EQ-Bench Creative Writing—783

Frequently asked questions

Is Grok-3 mini better than Llama 4 Scout?

Grok-3 mini is the stronger model overall, scoring 41.0 to 27.4 on the Noometry Index.

Is Grok-3 mini or Llama 4 Scout better for coding?

Grok-3 mini scores higher on coding benchmarks: 40.4 versus 19.9 in the Noometry coding category.

How many benchmarks do Grok-3 mini and Llama 4 Scout share?

31 benchmarks have published results for both models. Grok-3 mini has 35 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper