Model comparison

Llama 3.2 3B vs Ministral 8B

Llama 3.2 3B and Ministral 8B score almost the same on the Noometry Index (28.9 vs 28.2), so choose on price, context window or the category you care about most.

Last verified . 13 shared benchmarks.

Llama 3.2 3B Meta

28.9

Rank #321 Confirmed

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Llama 3.2 3B scores higher in 4 categories and Ministral 8B in 5 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Llama 3.2 3B leads 29.7 to 12.6.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 21.9% for Llama 3.2 3B and 11.1% for Ministral 8B.
  • Llama 3.2 3B is cheaper at $0.05 / $0.33 per million input/output tokens, against $0.15 / $0.15 for Ministral 8B.
  • Ministral 8B accepts more context: 262K tokens versus 131K.

Side by side

Llama 3.2 3B and Ministral 8B specifications
Llama 3.2 3BMinistral 8B
ProviderMetaMistral AI
Noometry Index28.928.2
Released2024-09-242024-10-01
WeightsOpenOpen
Context window131K262K
Max output118K262K
Input $ / M tokens$0.05$0.15
Output $ / M tokens$0.33$0.15
Results tracked1817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Ministral 8B leads

Llama 3.2 3B: 27.6 (#319), Ministral 8B: 35.0 (#230)

Coding benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Coding10981202
BigCodeBench Instruct23.4%—
BigCodeBench Complete28.3%—

Agentic & Tool Use Llama 3.2 3B leads

Llama 3.2 3B: 20.1 (#143), Ministral 8B: 16.4 (#148)

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
Berkeley Function Calling Leaderboard21.9%11.1%
BALROG10.1%—

Reasoning Llama 3.2 3B leads

Llama 3.2 3B: 21.0 (#228), Ministral 8B: 18.4 (#281)

Reasoning benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Hard Prompts10951191
DTBench—45.7%

Math Llama 3.2 3B leads

Llama 3.2 3B: 32.4 (#214), Ministral 8B: 25.7 (#267)

Math benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Math11261188
MATH Level 5—14.9%

Knowledge Llama 3.2 3B leads

Llama 3.2 3B: 29.7 (#235), Ministral 8B: 12.6 (#297)

Knowledge benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Expert10901170
GPQA Diamond—27.1%
Vectara Hallucination Rate—7.4%

Multilingual Ministral 8B leads

Llama 3.2 3B: 26.2 (#281), Ministral 8B: 35.1 (#247)

Multilingual benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Non-English10191165
LMArena Chinese10171193
LMArena Russian9491195
LMArena German1056—

Instruction Following Ministral 8B leads

Llama 3.2 3B: 56.0 (#275), Ministral 8B: 60.5 (#250)

Instruction Following benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Instruction Following10891161

Long Context Ministral 8B leads

Llama 3.2 3B: 33.4 (#261), Ministral 8B: 36.7 (#227)

Long Context benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Longer Query11001212

Writing & Preference Ministral 8B leads

Llama 3.2 3B: 24.7 (#307), Ministral 8B: 39.6 (#246)

Writing & Preference benchmarks
BenchmarkLlama 3.2 3BMinistral 8B
LMArena Text11101191
LMArena Creative Writing10941175
LMArena Multi-Turn11051166
EQ-Bench Creative Writing595—

Frequently asked questions

Is Llama 3.2 3B better than Ministral 8B?

Llama 3.2 3B and Ministral 8B score almost the same on the Noometry Index (28.9 vs 28.2), so choose on price, context window or the category you care about most.

Which is cheaper, Llama 3.2 3B or Ministral 8B?

Llama 3.2 3B is cheaper. It lists at $0.05 per million input tokens and $0.33 per million output tokens; Ministral 8B lists at $0.15 and $0.15.

Is Llama 3.2 3B or Ministral 8B better for coding?

Ministral 8B scores higher on coding benchmarks: 35.0 versus 27.6 in the Noometry coding category.

Which has the bigger context window?

Ministral 8B does, with 262K tokens against 131K.

How many benchmarks do Llama 3.2 3B and Ministral 8B share?

13 benchmarks have published results for both models. Llama 3.2 3B has 18 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper