Model comparison

Mistral Medium 3.5 vs Pixtral Large

Mistral Medium 3.5 is the stronger model overall, scoring 39.6 to 31.7 on the Noometry Index.

Last verified . 1 shared benchmarks.

Mistral Medium 3.5 Mistral AI

39.6

Rank #151 Confirmed

Pixtral Large Mistral AI

31.7

Rank #257 Reported

Summary

  • They share 1 benchmark with published results for both. Mistral Medium 3.5 scores higher in 2 categories and Pixtral Large in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium 3.5 leads 58.6 to 32.9.
  • Both cost about the same: $1.50 input and $7.50 output per million tokens.
  • Mistral Medium 3.5 accepts more context: 262K tokens versus 128K.

Side by side

Mistral Medium 3.5 and Pixtral Large specifications
Mistral Medium 3.5Pixtral Large
ProviderMistral AIMistral AI
Noometry Index39.631.7
Released—2024-11-01
WeightsOpenOpen
Context window262K128K
Max output210K128K
Input $ / M tokens$1.50$2
Output $ / M tokens$7.50$6
Results tracked223

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.5: 35.7 (#208), Pixtral Large: —

Coding benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena WebDev1263—
LMArena Coding1461—

Reasoning Pixtral Large leads

Mistral Medium 3.5: 16.6 (#290), Pixtral Large: 20.9 (#208)

Reasoning benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
Kagi LLM Benchmark41.4%—
NYT Connections (extended)12.9%—
EnigmaEval—0.8%
LMArena Hard Prompts1436—
Epoch Capabilities Index141.42—

Math Not comparable

Mistral Medium 3.5: 36.4 (#113), Pixtral Large: —

Math benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena Math1432—

Knowledge Not comparable

Mistral Medium 3.5: 39.3 (#123), Pixtral Large: —

Knowledge benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena Expert1431—

Multimodal Mistral Medium 3.5 leads

Mistral Medium 3.5: 37.6 (#64), Pixtral Large: 30.0 (#105)

Multimodal benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena Vision12221089

Multilingual Not comparable

Mistral Medium 3.5: 52.1 (#93), Pixtral Large: —

Multilingual benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena Non-English1405—
LMArena Chinese1443—
LMArena French1448—
LMArena German1453—
LMArena Korean1387—
LMArena Russian1396—
LMArena Spanish1406—

Instruction Following Not comparable

Mistral Medium 3.5: 74.7 (#87), Pixtral Large: —

Instruction Following benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena Instruction Following1414—

Long Context Not comparable

Mistral Medium 3.5: 43.2 (#101), Pixtral Large: —

Long Context benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena Longer Query1414—

Writing & Preference Mistral Medium 3.5 leads

Mistral Medium 3.5: 58.6 (#113), Pixtral Large: 32.9 (#273)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.5Pixtral Large
LMArena Text1421—
LMArena Creative Writing1372—
EQ-Bench Creative Writing—988
EQ-Bench 4993—
LMArena Multi-Turn1423—

Frequently asked questions

Is Mistral Medium 3.5 better than Pixtral Large?

Mistral Medium 3.5 is the stronger model overall, scoring 39.6 to 31.7 on the Noometry Index.

Which is cheaper, Mistral Medium 3.5 or Pixtral Large?

Pixtral Large is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Which has the bigger context window?

Mistral Medium 3.5 does, with 262K tokens against 128K.

How many benchmarks do Mistral Medium 3.5 and Pixtral Large share?

1 benchmark has published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper