Model comparison

Magistral Small vs Qwen1.5-32B

Magistral Small and Qwen1.5-32B score almost the same on the Noometry Index (30.2 vs 30.5), so choose on price, context window or the category you care about most.

Last verified . 1 shared benchmarks.

Magistral Small Mistral AI

30.2

Rank #296 Confirmed

Qwen1.5-32B Alibaba (Qwen)

30.5

Rank #293 Confirmed

Summary

  • They share 1 benchmark with published results for both. Magistral Small scores higher in 2 categories and Qwen1.5-32B in 2 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Magistral Small leads 30.9 to 13.5.
  • The biggest single-benchmark swing is GPQA Diamond: 56.1% for Magistral Small and 30.7% for Qwen1.5-32B.

Side by side

Magistral Small and Qwen1.5-32B specifications
Magistral SmallQwen1.5-32B
ProviderMistral AIAlibaba (Qwen)
Noometry Index30.230.5
Released2025-06-102024-02-04
WeightsOpenOpen
Context window128K—
Max output40K—
Input $ / M tokens$0.50—
Output $ / M tokens$1.50—
Results tracked1021

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Small leads

Magistral Small: 38.4 (#176), Qwen1.5-32B: 31.7 (#282)

Coding benchmarks
BenchmarkMagistral SmallQwen1.5-32B
SciCode35.2%—
BigCodeBench Instruct—32.3%
LMArena Coding—1155
BigCodeBench Complete—42%

Reasoning Qwen1.5-32B leads

Magistral Small: 6.8 (#350), Qwen1.5-32B: 21.8 (#212)

Reasoning benchmarks
BenchmarkMagistral SmallQwen1.5-32B
ARC-AGI-20%—
Kagi LLM Benchmark6.3%—
ARC-AGI-15%—
CritPt0.3%—
Chess Puzzles3%—
LMArena Hard Prompts—1130
DTBench61.3%—
Epoch Capabilities Index133.19—

Math Qwen1.5-32B leads

Magistral Small: 26.2 (#261), Qwen1.5-32B: 33.0 (#207)

Math benchmarks
BenchmarkMagistral SmallQwen1.5-32B
OTIS Mock AIME 2024-202530%—
LMArena Math—1155

Knowledge Magistral Small leads

Magistral Small: 30.9 (#223), Qwen1.5-32B: 13.5 (#296)

Knowledge benchmarks
BenchmarkMagistral SmallQwen1.5-32B
GPQA Diamond56.1%30.7%
LMArena Expert—1126
MMLU—74.4%

Multilingual Not comparable

Magistral Small: —, Qwen1.5-32B: 31.4 (#259)

Multilingual benchmarks
BenchmarkMagistral SmallQwen1.5-32B
LMArena Non-English—1106
LMArena Chinese—1177
LMArena French—1101
LMArena German—1058
LMArena Japanese—1027
LMArena Korean—1008
LMArena Russian—1073
LMArena Spanish—1089

Instruction Following Not comparable

Magistral Small: —, Qwen1.5-32B: 57.7 (#265)

Instruction Following benchmarks
BenchmarkMagistral SmallQwen1.5-32B
LMArena Instruction Following—1116

Long Context Not comparable

Magistral Small: —, Qwen1.5-32B: 34.7 (#246)

Long Context benchmarks
BenchmarkMagistral SmallQwen1.5-32B
LMArena Longer Query—1146

Writing & Preference Not comparable

Magistral Small: —, Qwen1.5-32B: 34.2 (#271)

Writing & Preference benchmarks
BenchmarkMagistral SmallQwen1.5-32B
LMArena Text—1137
LMArena Creative Writing—1083
LMArena Multi-Turn—1140

Frequently asked questions

Is Magistral Small better than Qwen1.5-32B?

Magistral Small and Qwen1.5-32B score almost the same on the Noometry Index (30.2 vs 30.5), so choose on price, context window or the category you care about most.

Is Magistral Small or Qwen1.5-32B better for coding?

Magistral Small scores higher on coding benchmarks: 38.4 versus 31.7 in the Noometry coding category.

How many benchmarks do Magistral Small and Qwen1.5-32B share?

1 benchmark has published results for both models. Magistral Small has 10 scored results on Noometry and Qwen1.5-32B has 21.

Related comparisons

Go deeper