Noometry

Model comparison

Gemini 4 Argon vs Llama 3.1-8B

Gemini 4 Argon is the stronger model overall, scoring 56.5 to 23.0 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemini 4 Argon Google

56.5

Rank #24 Confirmed

Llama 3.1-8B Meta

23.0

Rank #352 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemini 4 Argon scores higher in 9 categories and Llama 3.1-8B in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 4 Argon leads 73.9 to 10.2.
  • The biggest single-benchmark swing is SciCode: 61.8% for Gemini 4 Argon and 13.2% for Llama 3.1-8B.
  • Llama 3.1-8B has downloadable open weights; the other is API-only.

Side by side

Gemini 4 ArgonLlama 3.1-8B
ProviderGoogleMeta
Noometry Index56.523.0
Released2026-09-302024-07-23
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.08
Results tracked2143

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 4 Argon leads

Gemini 4 Argon: 62.0 (#9), Llama 3.1-8B: 20.2 (#340)

BenchmarkGemini 4 ArgonLlama 3.1-8B
SciCode61.8%13.2%
LMArena Coding15501195
LMArena WebDev1678—
FrontierSWE55%—
WeirdML—1.7%
BigCodeBench Instruct—32.8%
BigCodeBench Complete—40.5%
HumanEval+—62.8%
MBPP+—55.6%

Agentic & Tool Use Gemini 4 Argon leads

Gemini 4 Argon: 49.2 (#8), Llama 3.1-8B: 22.5 (#131)

BenchmarkGemini 4 ArgonLlama 3.1-8B
APEX-Agents82.2%—
Berkeley Function Calling Leaderboard—25.8%
BALROG—15.1%
Vending-Bench 213,718—

Reasoning Gemini 4 Argon leads

Gemini 4 Argon: 44.2 (#47), Llama 3.1-8B: 14.9 (#321)

BenchmarkGemini 4 ArgonLlama 3.1-8B
CritPt27.1%0%
LMArena Hard Prompts15481175
Chess Puzzles—0%
DTBench—50.9%
LMCA—5.4%
Epoch Capabilities Index—116.57
PIQA—81.2%

Math Gemini 4 Argon leads

Gemini 4 Argon: 73.9 (#17), Llama 3.1-8B: 10.2 (#317)

BenchmarkGemini 4 ArgonLlama 3.1-8B
LMArena Math15361179
OTIS Mock AIME 2024-2025—1.7%
ProofBench99%—
Omni-MATH—13.7%
MATH Level 5—22.9%
GSM8K—82.4%

Knowledge Gemini 4 Argon leads

Gemini 4 Argon: 43.9 (#89), Llama 3.1-8B: 8.0 (#307)

BenchmarkGemini 4 ArgonLlama 3.1-8B
LMArena Expert15531144
GPQA Diamond—27%
MMLU-Pro—40.6%
GPQA (HELM)—24.7%
BoolQ—82.8%
MMLU—56.1%

Multimodal Not comparable

Gemini 4 Argon: 46.5 (#14), Llama 3.1-8B: —

BenchmarkGemini 4 ArgonLlama 3.1-8B
Blueprint-Bench 254.4%—

Multilingual Gemini 4 Argon leads

Gemini 4 Argon: 60.3 (#1), Llama 3.1-8B: 34.0 (#249)

BenchmarkGemini 4 ArgonLlama 3.1-8B
LMArena Non-English15231148
LMArena Chinese16101151
LMArena Russian15371158
LMArena Spanish14971169
LMArena French—1177
LMArena German—1144
LMArena Japanese—1061
LMArena Korean—1053

Instruction Following Gemini 4 Argon leads

Gemini 4 Argon: 80.1 (#2), Llama 3.1-8B: 58.9 (#258)

BenchmarkGemini 4 ArgonLlama 3.1-8B
LMArena Instruction Following15381159
IFEval—74.3%

Long Context Gemini 4 Argon leads

Gemini 4 Argon: 47.6 (#15), Llama 3.1-8B: 35.8 (#238)

BenchmarkGemini 4 ArgonLlama 3.1-8B
LMArena Longer Query15491182

Writing & Preference Gemini 4 Argon leads

Gemini 4 Argon: 71.4 (#19), Llama 3.1-8B: 29.7 (#290)

BenchmarkGemini 4 ArgonLlama 3.1-8B
LMArena Text15341187
LMArena Creative Writing15311154
LMArena Multi-Turn15571172
EQ-Bench Creative Writing—713
WildBench—68.7%

Frequently asked questions

Is Gemini 4 Argon better than Llama 3.1-8B?

Gemini 4 Argon is the stronger model overall, scoring 56.5 to 23.0 on the Noometry Index.

Is Gemini 4 Argon or Llama 3.1-8B better for coding?

Gemini 4 Argon scores higher on coding benchmarks: 62.0 versus 20.2 in the Noometry coding category.

How many benchmarks do Gemini 4 Argon and Llama 3.1-8B share?

15 benchmarks have published results for both models. Gemini 4 Argon has 21 scored results on Noometry and Llama 3.1-8B has 43.

Related comparisons

Go deeper