Noometry

Model comparison

Granite 4.1 8b vs Mistral Medium

Granite 4.1 8b and Mistral Medium score almost the same on the Noometry Index (36.8 vs 36.0), so choose on price, context window or the category you care about most.

Last verified . 12 shared benchmarks.

Granite 4.1 8b IBM

36.8

Rank #202 Confirmed

Mistral Medium Mistral AI

36.0

Rank #211 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 4.1 8b scores higher in 3 categories and Mistral Medium in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium leads 60.2 to 48.3.

Side by side

Granite 4.1 8bMistral Medium
ProviderIBMMistral AI
Noometry Index36.836.0
Released—2023-12-11
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked1336

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium leads

Granite 4.1 8b: 29.9 (#291), Mistral Medium: 33.8 (#241)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Coding13131434
FrontierCode—8%
LMArena WebDev1190—
SciCode—40.2%
WeirdML—43.7%
ALE-Bench—763.98

Agentic & Tool Use Not comparable

Granite 4.1 8b: —, Mistral Medium: 28.1 (#84)

BenchmarkGranite 4.1 8bMistral Medium
Berkeley Function Calling Leaderboard—37.7%

Reasoning Granite 4.1 8b leads

Granite 4.1 8b: 24.6 (#142), Mistral Medium: 23.3 (#165)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Hard Prompts12941426
Kagi LLM Benchmark—50%
CritPt—0%
DTBench—75.5%
LMCA—26.1%
Surface Evolver Bench—26.9%

Math Granite 4.1 8b leads

Granite 4.1 8b: 33.8 (#167), Mistral Medium: 27.2 (#238)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Math13111409
OTIS Mock AIME 2024-2025—32.2%
ProofBench—9%
MATH Level 5—81.6%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Granite 4.1 8b leads

Granite 4.1 8b: 35.5 (#171), Mistral Medium: 24.9 (#260)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Expert13101408
GPQA Diamond—59.5%
Humanity's Last Exam—4.5%
Vectara Hallucination Rate—22.7%

Multimodal Not comparable

Granite 4.1 8b: —, Mistral Medium: 34.6 (#82)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Vision—1172

Multilingual Mistral Medium leads

Granite 4.1 8b: 41.8 (#199), Mistral Medium: 52.3 (#86)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Non-English12611408
LMArena Chinese13351448
LMArena Russian12381411
LMArena French—1460
LMArena German—1433
LMArena Japanese—1378
LMArena Korean—1382
LMArena Spanish—1433

Instruction Following Mistral Medium leads

Granite 4.1 8b: 67.0 (#198), Mistral Medium: 73.9 (#111)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Instruction Following12681398

Long Context Mistral Medium leads

Granite 4.1 8b: 38.7 (#188), Mistral Medium: 42.9 (#108)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Longer Query12751406

Writing & Preference Mistral Medium leads

Granite 4.1 8b: 48.3 (#199), Mistral Medium: 60.2 (#97)

BenchmarkGranite 4.1 8bMistral Medium
LMArena Text12911424
LMArena Creative Writing12491391
LMArena Multi-Turn12691418
Short-Story Creative Writing—77.3%

Frequently asked questions

Is Granite 4.1 8b better than Mistral Medium?

Granite 4.1 8b and Mistral Medium score almost the same on the Noometry Index (36.8 vs 36.0), so choose on price, context window or the category you care about most.

Is Granite 4.1 8b or Mistral Medium better for coding?

Mistral Medium scores higher on coding benchmarks: 33.8 versus 29.9 in the Noometry coding category.

How many benchmarks do Granite 4.1 8b and Mistral Medium share?

12 benchmarks have published results for both models. Granite 4.1 8b has 13 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper