Model comparison

Mistral Medium vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 36.3 on the Noometry Index.

Last verified . 18 shared benchmarks.

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Mistral Medium scores higher in 3 categories and Mistral Medium 3.5 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Mistral Medium 3.5 leads 40.0 to 25.0.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 50% for Mistral Medium and 41.4% for Mistral Medium 3.5.
  • Both cost about the same: $1.50 input and $7.50 output per million tokens.

Side by side

Mistral Medium and Mistral Medium 3.5 specifications
Mistral MediumMistral Medium 3.5
ProviderMistral AIMistral AI
Noometry Index36.340.2
Released2023-12-11—
WeightsOpenOpen
Context window262K262K
Max output262K210K
Input $ / M tokens$1.50$1.50
Output $ / M tokens$7.50$7.50
Results tracked3622

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium 3.5 leads

Mistral Medium: 34.2 (#243), Mistral Medium 3.5: 36.0 (#213)

Coding benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Coding14341461
FrontierCode8%—
LMArena WebDev—1264
SciCode40.2%—
WeirdML43.7%—
ALE-Bench763.98—

Agentic & Tool Use Not comparable

Mistral Medium: 28.3 (#90), Mistral Medium 3.5: —

Agentic & Tool Use benchmarks
BenchmarkMistral MediumMistral Medium 3.5
Berkeley Function Calling Leaderboard37.7%—

Reasoning Mistral Medium leads

Mistral Medium: 24.0 (#167), Mistral Medium 3.5: 17.3 (#295)

Reasoning benchmarks
BenchmarkMistral MediumMistral Medium 3.5
Kagi LLM Benchmark50%41.4%
LMArena Hard Prompts14261436
NYT Connections (extended)—12.9%
CritPt0%—
DTBench75.5%—
LMCA26.1%—
Surface Evolver Bench26.9%—
Epoch Capabilities Index—141.35

Math Mistral Medium 3.5 leads

Mistral Medium: 28.1 (#245), Mistral Medium 3.5: 39.1 (#113)

Math benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Math14081431
OTIS Mock AIME 2024-202532.2%—
ProofBench9%—
MATH Level 581.6%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Mistral Medium 3.5 leads

Mistral Medium: 25.0 (#265), Mistral Medium 3.5: 40.0 (#126)

Knowledge benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Expert14081432
GPQA Diamond59.5%—
Humanity's Last Exam4.5%—
Vectara Hallucination Rate22.7%—

Multimodal Mistral Medium 3.5 leads

Mistral Medium: 35.3 (#88), Mistral Medium 3.5: 38.3 (#65)

Multimodal benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Vision11721223

Multilingual Too close to call

Mistral Medium: 52.1 (#91), Mistral Medium 3.5: 51.9 (#100)

Multilingual benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Non-English14081404
LMArena Chinese14471442
LMArena French14591448
LMArena German14321451
LMArena Korean13801385
LMArena Russian14111395
LMArena Spanish14331409
LMArena Japanese1378—

Instruction Following Too close to call

Mistral Medium: 73.7 (#116), Mistral Medium 3.5: 74.6 (#90)

Instruction Following benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Instruction Following13981415

Long Context Too close to call

Mistral Medium: 42.9 (#114), Mistral Medium 3.5: 43.2 (#103)

Long Context benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Longer Query14061415

Writing & Preference Mistral Medium leads

Mistral Medium: 60.0 (#103), Mistral Medium 3.5: 58.5 (#117)

Writing & Preference benchmarks
BenchmarkMistral MediumMistral Medium 3.5
LMArena Text14241421
LMArena Creative Writing13911374
LMArena Multi-Turn14181423
Short-Story Creative Writing77.3%—
EQ-Bench 4—993

Frequently asked questions

Is Mistral Medium better than Mistral Medium 3.5?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 36.3 on the Noometry Index.

Which is cheaper, Mistral Medium or Mistral Medium 3.5?

Mistral Medium 3.5 is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Mistral Medium lists at $1.50 and $7.50.

Is Mistral Medium or Mistral Medium 3.5 better for coding?

Mistral Medium 3.5 scores higher on coding benchmarks: 36.0 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

Both accept 262K tokens.

How many benchmarks do Mistral Medium and Mistral Medium 3.5 share?

18 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper