Model comparison

Granite 3.0 8b Instruct vs Mistral Medium 3.1

Granite 3.0 8b Instruct and Mistral Medium 3.1 score almost the same on the Noometry Index (31.6 vs 31.9), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Granite 3.0 8b Instruct IBM

31.6

Rank #270 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 31.1.
  • Granite 3.0 8b Instruct has downloadable open weights; the other is API-only.

Side by side

Granite 3.0 8b Instruct and Mistral Medium 3.1 specifications
Granite 3.0 8b InstructMistral Medium 3.1
ProviderIBMMistral AI
Noometry Index31.631.9
Released——
WeightsOpenProprietary
Context window—131K
Max output—105K
Input $ / M tokens—$0.40
Output $ / M tokens—$2
Results tracked143

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 3.0 8b Instruct: 29.7 (#301), Mistral Medium 3.1: —

Coding benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
BigCodeBench Instruct29.3%—
LMArena Coding1112—
BigCodeBench Complete35.4%—

Reasoning Granite 3.0 8b Instruct leads

Granite 3.0 8b Instruct: 20.9 (#230), Mistral Medium 3.1: 10.6 (#341)

Reasoning benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
NYT Connections (extended)—6.5%
Thematic Generalization—20.3%
LMArena Hard Prompts1092—

Math Not comparable

Granite 3.0 8b Instruct: 32.8 (#210), Mistral Medium 3.1: —

Math benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
LMArena Math1143—

Knowledge Not comparable

Granite 3.0 8b Instruct: 29.6 (#236), Mistral Medium 3.1: —

Knowledge benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
LMArena Expert1087—

Multilingual Not comparable

Granite 3.0 8b Instruct: 27.2 (#276), Mistral Medium 3.1: —

Multilingual benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
LMArena Non-English1037—
LMArena Chinese1063—
LMArena Russian1060—

Instruction Following Not comparable

Granite 3.0 8b Instruct: 56.0 (#276), Mistral Medium 3.1: —

Instruction Following benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
LMArena Instruction Following1088—

Long Context Not comparable

Granite 3.0 8b Instruct: 34.0 (#252), Mistral Medium 3.1: —

Long Context benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
LMArena Longer Query1122—

Writing & Preference Mistral Medium 3.1 leads

Granite 3.0 8b Instruct: 31.1 (#285), Mistral Medium 3.1: 55.5 (#145)

Writing & Preference benchmarks
BenchmarkGranite 3.0 8b InstructMistral Medium 3.1
LMArena Text1096—
LMArena Creative Writing1071—
EQ-Bench Creative Writing—1476
LMArena Multi-Turn1063—

Frequently asked questions

Is Granite 3.0 8b Instruct better than Mistral Medium 3.1?

Granite 3.0 8b Instruct and Mistral Medium 3.1 score almost the same on the Noometry Index (31.6 vs 31.9), so choose on price, context window or the category you care about most.

How many benchmarks do Granite 3.0 8b Instruct and Mistral Medium 3.1 share?

0 benchmarks have published results for both models. Granite 3.0 8b Instruct has 14 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper