Model comparison

Mistral Medium 3.5 vs Qwen3.8 Max

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 40.2 on the Noometry Index.

Last verified . 20 shared benchmarks.

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Qwen3.8 Max Alibaba (Qwen)

56.8

Rank #22 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Mistral Medium 3.5 scores higher in 1 category and Qwen3.8 Max in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.8 Max leads 54.4 to 17.3.
  • The biggest single-benchmark swing is NYT Connections (extended): 12.9% for Mistral Medium 3.5 and 88.3% for Qwen3.8 Max.
  • Both cost about the same: $1.50 input and $7.50 output per million tokens.
  • Qwen3.8 Max accepts more context: 1M tokens versus 262K.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.5 and Qwen3.8 Max specifications
Mistral Medium 3.5Qwen3.8 Max
ProviderMistral AIAlibaba (Qwen)
Noometry Index40.256.8
Released—2026-08-02
WeightsOpenProprietary
Context window262K1M
Max output210K131K
Input $ / M tokens$1.50$2
Output $ / M tokens$7.50$6
Results tracked2239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 Max leads

Mistral Medium 3.5: 36.0 (#213), Qwen3.8 Max: 53.5 (#29)

Coding benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena WebDev12641674
LMArena Coding14611502
DeepSWE—57.5%
FrontierSWE—17.8%
SciCode—53.2%

Agentic & Tool Use Not comparable

Mistral Medium 3.5: —, Qwen3.8 Max: 45.4 (#14)

Agentic & Tool Use benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
APEX-Agents—63.3%
τ²-bench Banking—55.1%
GDP.pdf—23.2%

Reasoning Qwen3.8 Max leads

Mistral Medium 3.5: 17.3 (#295), Qwen3.8 Max: 54.4 (#26)

Reasoning benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
NYT Connections (extended)12.9%88.3%
LMArena Hard Prompts14361496
Epoch Capabilities Index141.35156.41
Kagi LLM Benchmark41.4%—
CritPt—20%
Chess Puzzles—40%
Mystery Game Puzzles—38%
DTBench—92%
LMCA—46.2%

Math Qwen3.8 Max leads

Mistral Medium 3.5: 39.1 (#113), Qwen3.8 Max: 73.2 (#20)

Math benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena Math14311499
FrontierMath (Tiers 1-3)—74.7%
FrontierMath Tier 4—46.3%
OTIS Mock AIME 2024-2025—100%
ProofBench—58%

Knowledge Qwen3.8 Max leads

Mistral Medium 3.5: 40.0 (#126), Qwen3.8 Max: 61.7 (#27)

Knowledge benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena Expert14321507
GPQA Diamond—92.7%
SimpleQA Verified—47.3%

Multimodal Mistral Medium 3.5 leads

Mistral Medium 3.5: 38.3 (#65), Qwen3.8 Max: 37.2 (#75)

Multimodal benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena Vision12231314
Furniture Assembly—20%

Multilingual Qwen3.8 Max leads

Mistral Medium 3.5: 51.9 (#100), Qwen3.8 Max: 56.7 (#18)

Multilingual benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena Non-English14041472
LMArena Chinese14421538
LMArena French14481503
LMArena German14511483
LMArena Korean13851461
LMArena Russian13951481
LMArena Spanish14091492
LMArena Japanese—1467

Instruction Following Qwen3.8 Max leads

Mistral Medium 3.5: 74.6 (#90), Qwen3.8 Max: 77.6 (#17)

Instruction Following benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena Instruction Following14151479

Long Context Qwen3.8 Max leads

Mistral Medium 3.5: 43.2 (#103), Qwen3.8 Max: 45.6 (#31)

Long Context benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena Longer Query14151489

Writing & Preference Qwen3.8 Max leads

Mistral Medium 3.5: 58.5 (#117), Qwen3.8 Max: 67.1 (#30)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.5Qwen3.8 Max
LMArena Text14211483
LMArena Creative Writing13741479
LMArena Multi-Turn14231489
EQ-Bench 4993—

Frequently asked questions

Is Mistral Medium 3.5 better than Qwen3.8 Max?

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 40.2 on the Noometry Index.

Which is cheaper, Mistral Medium 3.5 or Qwen3.8 Max?

Qwen3.8 Max is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Is Mistral Medium 3.5 or Qwen3.8 Max better for coding?

Qwen3.8 Max scores higher on coding benchmarks: 53.5 versus 36.0 in the Noometry coding category.

Which has the bigger context window?

Qwen3.8 Max does, with 1M tokens against 262K.

How many benchmarks do Mistral Medium 3.5 and Qwen3.8 Max share?

20 benchmarks have published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and Qwen3.8 Max has 39.

Related comparisons

Go deeper