Noometry

Model comparison

Llama 3.2 1B vs Mistral Small 3

Mistral Small 3 is the stronger model overall, scoring 30.9 to 19.9 on the Noometry Index.

Last verified . 20 shared benchmarks.

Llama 3.2 1B Meta

19.9

Rank #349 Confirmed

Mistral Small 3 Mistral AI

30.9

Rank #268 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Llama 3.2 1B scores higher in 0 categories and Mistral Small 3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Mistral Small 3 leads 25.0 to 7.2.
  • The biggest single-benchmark swing is BigCodeBench Complete: 11.3% for Llama 3.2 1B and 50.4% for Mistral Small 3.
  • Mistral Small 3 is cheaper at $0.05 / $0.08 per million input/output tokens, against $0.027 / $0.20 for Llama 3.2 1B.
  • Llama 3.2 1B accepts more context: 60K tokens versus 33K.

Side by side

Llama 3.2 1BMistral Small 3
ProviderMetaMistral AI
Noometry Index19.930.9
Released2024-09-242025-01-30
WeightsOpenOpen
Context window60K33K
Max output54K16K
Input $ / M tokens$0.027$0.05
Output $ / M tokens$0.20$0.08
Results tracked2224

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3 leads

Llama 3.2 1B: 20.6 (#333), Mistral Small 3: 36.0 (#203)

BenchmarkLlama 3.2 1BMistral Small 3
BigCodeBench Instruct8.2%45.3%
LMArena Coding10711246
BigCodeBench Complete11.3%50.4%

Agentic & Tool Use Not comparable

Llama 3.2 1B: 14.5 (#142), Mistral Small 3: —

BenchmarkLlama 3.2 1BMistral Small 3
Berkeley Function Calling Leaderboard10.8%—
BALROG6.6%—

Reasoning Mistral Small 3 leads

Llama 3.2 1B: 15.6 (#304), Mistral Small 3: 18.2 (#269)

BenchmarkLlama 3.2 1BMistral Small 3
Chess Puzzles0%0%
LMArena Hard Prompts10441233
Epoch Capabilities Index101.95127.06

Math Mistral Small 3 leads

Llama 3.2 1B: 9.7 (#308), Mistral Small 3: 15.3 (#290)

BenchmarkLlama 3.2 1BMistral Small 3
OTIS Mock AIME 2024-20250.6%6.7%
LMArena Math10861240

Knowledge Mistral Small 3 leads

Llama 3.2 1B: 7.2 (#307), Mistral Small 3: 25.0 (#258)

BenchmarkLlama 3.2 1BMistral Small 3
GPQA Diamond23.9%47.3%
LMArena Expert10071202
Confabulations—25.2%

Multilingual Mistral Small 3 leads

Llama 3.2 1B: 23.9 (#287), Mistral Small 3: 37.5 (#231)

BenchmarkLlama 3.2 1BMistral Small 3
LMArena Non-English9731198
LMArena Chinese9581204
LMArena German10141211
LMArena Russian9411216
LMArena French—1202
LMArena Japanese—1111
LMArena Korean—1188

Instruction Following Mistral Small 3 leads

Llama 3.2 1B: 52.6 (#285), Mistral Small 3: 63.9 (#224)

BenchmarkLlama 3.2 1BMistral Small 3
LMArena Instruction Following10311214

Long Context Mistral Small 3 leads

Llama 3.2 1B: 31.9 (#269), Mistral Small 3: 37.8 (#206)

BenchmarkLlama 3.2 1BMistral Small 3
LMArena Longer Query10501246

Writing & Preference Mistral Small 3 leads

Llama 3.2 1B: 21.4 (#305), Mistral Small 3: 32.4 (#275)

BenchmarkLlama 3.2 1BMistral Small 3
LMArena Text10551234
LMArena Creative Writing10331195
EQ-Bench Creative Writing200707
LMArena Multi-Turn10301217

Frequently asked questions

Is Llama 3.2 1B better than Mistral Small 3?

Mistral Small 3 is the stronger model overall, scoring 30.9 to 19.9 on the Noometry Index.

Which is cheaper, Llama 3.2 1B or Mistral Small 3?

Mistral Small 3 is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; Llama 3.2 1B lists at $0.027 and $0.20.

Is Llama 3.2 1B or Mistral Small 3 better for coding?

Mistral Small 3 scores higher on coding benchmarks: 36.0 versus 20.6 in the Noometry coding category.

Which has the bigger context window?

Llama 3.2 1B does, with 60K tokens against 33K.

How many benchmarks do Llama 3.2 1B and Mistral Small 3 share?

20 benchmarks have published results for both models. Llama 3.2 1B has 22 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper