Model comparison

Ministral 3B vs Mistral Nemo

Ministral 3B and Mistral Nemo score almost the same on the Noometry Index (26.2 vs 26.4), so choose on price, context window or the category you care about most.

Last verified . 4 shared benchmarks.

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Ministral 3B scores higher in 1 category and Mistral Nemo in 2 categories; 3 gaps are clear of the uncertainty.
  • Ministral 3B is cheaper at $0.10 / $0.10 per million input/output tokens, against $0.15 / $0.15 for Mistral Nemo.
  • Ministral 3B accepts more context: 131K tokens versus 128K.

Side by side

Ministral 3B and Mistral Nemo specifications
Ministral 3BMistral Nemo
ProviderMistral AIMistral AI
Noometry Index26.226.4
Released2024-10-012024-07-01
WeightsOpenOpen
Context window131K128K
Max output262K128K
Input $ / M tokens$0.10$0.15
Output $ / M tokens$0.10$0.15
Results tracked610

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Ministral 3B: —, Mistral Nemo: 23.5 (#125)

Agentic & Tool Use benchmarks
BenchmarkMinistral 3BMistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%

Reasoning Mistral Nemo leads

Ministral 3B: 18.4 (#282), Mistral Nemo: 20.7 (#232)

Reasoning benchmarks
BenchmarkMinistral 3BMistral Nemo
DTBench51.7%48.6%
Epoch Capabilities Index118.1118.68
LMCA5.5%—
PIQA—83.5%

Math Ministral 3B leads

Ministral 3B: 26.6 (#258), Mistral Nemo: 25.5 (#268)

Math benchmarks
BenchmarkMinistral 3BMistral Nemo
MATH Level 514.4%10.8%
GSM8K—84.2%

Knowledge Mistral Nemo leads

Ministral 3B: 10.4 (#302), Mistral Nemo: 12.3 (#298)

Knowledge benchmarks
BenchmarkMinistral 3BMistral Nemo
GPQA Diamond25.3%29.9%
Vectara Hallucination Rate7.3%—
BoolQ—82.5%

Writing & Preference Not comparable

Ministral 3B: —, Mistral Nemo: 28.5 (#296)

Writing & Preference benchmarks
BenchmarkMinistral 3BMistral Nemo
EQ-Bench Creative Writing—881

Frequently asked questions

Is Ministral 3B better than Mistral Nemo?

Ministral 3B and Mistral Nemo score almost the same on the Noometry Index (26.2 vs 26.4), so choose on price, context window or the category you care about most.

Which is cheaper, Ministral 3B or Mistral Nemo?

Ministral 3B is cheaper. It lists at $0.10 per million input tokens and $0.10 per million output tokens; Mistral Nemo lists at $0.15 and $0.15.

Which has the bigger context window?

Ministral 3B does, with 131K tokens against 128K.

How many benchmarks do Ministral 3B and Mistral Nemo share?

4 benchmarks have published results for both models. Ministral 3B has 6 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper