Noometry

Model comparison

Granite 3.0 8b Instruct vs Mistral Small 3.1

Granite 3.0 8b Instruct and Mistral Small 3.1 score almost the same on the Noometry Index (31.6 vs 31.7), so choose on price, context window or the category you care about most.

Last verified . 12 shared benchmarks.

Granite 3.0 8b Instruct IBM

31.6

Rank #270 Confirmed

Mistral Small 3.1 Mistral AI

31.7

Rank #269 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 3.0 8b Instruct scores higher in 3 categories and Mistral Small 3.1 in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Granite 3.0 8b Instruct leads 32.8 to 14.7.

Side by side

Granite 3.0 8b InstructMistral Small 3.1
ProviderIBMMistral AI
Noometry Index31.631.7
Released—2025-03-17
WeightsOpenOpen
Context window—128K
Max output—102K
Input $ / M tokens—$0.35
Output $ / M tokens—$0.56
Results tracked1428

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3.1 leads

Granite 3.0 8b Instruct: 29.7 (#301), Mistral Small 3.1: 38.3 (#179)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Coding11121309
BigCodeBench Instruct29.3%—
BigCodeBench Complete35.4%—

Reasoning Granite 3.0 8b Instruct leads

Granite 3.0 8b Instruct: 20.9 (#230), Mistral Small 3.1: 19.7 (#254)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Hard Prompts10921278
Chess Puzzles—1%
Epoch Capabilities Index—127.48

Math Granite 3.0 8b Instruct leads

Granite 3.0 8b Instruct: 32.8 (#210), Mistral Small 3.1: 14.7 (#301)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Math11431262
OTIS Mock AIME 2024-2025—3.9%
Omni-MATH—24.8%

Knowledge Granite 3.0 8b Instruct leads

Granite 3.0 8b Instruct: 29.6 (#236), Mistral Small 3.1: 22.6 (#271)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Expert10871257
GPQA Diamond—41.9%
MMLU-Pro—61%
GPQA (HELM)—39.2%

Multimodal Not comparable

Granite 3.0 8b Instruct: —, Mistral Small 3.1: 33.2 (#99)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Vision—1136

Multilingual Mistral Small 3.1 leads

Granite 3.0 8b Instruct: 27.2 (#276), Mistral Small 3.1: 41.2 (#209)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Non-English10371255
LMArena Chinese10631253
LMArena Russian10601263
LMArena French—1273
LMArena German—1266
LMArena Japanese—1208
LMArena Korean—1206
LMArena Spanish—1283

Instruction Following Mistral Small 3.1 leads

Granite 3.0 8b Instruct: 56.0 (#276), Mistral Small 3.1: 63.6 (#230)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Instruction Following10881264
IFEval—75%

Long Context Mistral Small 3.1 leads

Granite 3.0 8b Instruct: 34.0 (#252), Mistral Small 3.1: 39.5 (#178)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Longer Query11221299

Writing & Preference Mistral Small 3.1 leads

Granite 3.0 8b Instruct: 31.1 (#285), Mistral Small 3.1: 37.0 (#259)

BenchmarkGranite 3.0 8b InstructMistral Small 3.1
LMArena Text10961277
LMArena Creative Writing10711253
LMArena Multi-Turn10631270
EQ-Bench Creative Writing—761
WildBench—78.8%

Frequently asked questions

Is Granite 3.0 8b Instruct better than Mistral Small 3.1?

Granite 3.0 8b Instruct and Mistral Small 3.1 score almost the same on the Noometry Index (31.6 vs 31.7), so choose on price, context window or the category you care about most.

Is Granite 3.0 8b Instruct or Mistral Small 3.1 better for coding?

Mistral Small 3.1 scores higher on coding benchmarks: 38.3 versus 29.7 in the Noometry coding category.

How many benchmarks do Granite 3.0 8b Instruct and Mistral Small 3.1 share?

12 benchmarks have published results for both models. Granite 3.0 8b Instruct has 14 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper