Noometry

Model comparison

Mistral Small vs QwQ-32B

QwQ-32B is the stronger model overall, scoring 39.8 to 33.4 on the Noometry Index.

Last verified . 28 shared benchmarks.

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

QwQ-32B Alibaba (Qwen)

39.8

Rank #159 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Mistral Small scores higher in 2 categories and QwQ-32B in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where QwQ-32B leads 38.0 to 16.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 5.8% for Mistral Small and 59.2% for QwQ-32B.

Side by side

Mistral SmallQwQ-32B
ProviderMistral AIAlibaba (Qwen)
Noometry Index33.439.8
Released2024-02-262024-11-28
WeightsOpenOpen
Context window262K—
Max output256K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.60—
Results tracked3936

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding QwQ-32B leads

Mistral Small: 34.0 (#247), QwQ-32B: 35.4 (#226)

BenchmarkMistral SmallQwQ-32B
BigCodeBench Instruct36.1%44.6%
LiveBench Coding36.2%72.2%
LMArena Coding13621333
BigCodeBench Complete46.6%54.4%
Aider Polyglot—20.9%
SciCode26.5%—
ALE-Bench497.62—

Agentic & Tool Use Not comparable

Mistral Small: 28.1 (#93), QwQ-32B: —

BenchmarkMistral SmallQwQ-32B
Berkeley Function Calling Leaderboard37.1%—

Reasoning QwQ-32B leads

Mistral Small: 19.8 (#250), QwQ-32B: 23.7 (#174)

BenchmarkMistral SmallQwQ-32B
LiveBench Reasoning44.8%83.5%
LMArena Hard Prompts13351325
LiveBench Data Analysis53.7%65%
LiveBench44%72%
Kagi LLM Benchmark37.8%—
CritPt0%—
Chess Puzzles—5%
DTBench70.9%—
LMCA20.6%—
Epoch Capabilities Index—137.6
ForecastBench—58.3

Math QwQ-32B leads

Mistral Small: 16.4 (#293), QwQ-32B: 38.0 (#143)

BenchmarkMistral SmallQwQ-32B
OTIS Mock AIME 2024-20255.8%59.2%
LiveBench Math39.9%77.8%
LMArena Math13411359
MATH Level 546.8%—

Knowledge QwQ-32B leads

Mistral Small: 31.0 (#222), QwQ-32B: 37.2 (#158)

BenchmarkMistral SmallQwQ-32B
GPQA Diamond47.5%65.3%
LMArena Expert12911324
Confabulations—15.6%
Vectara Hallucination Rate5.1%—
MMLU68.7%—

Multimodal Not comparable

Mistral Small: 33.5 (#96), QwQ-32B: —

BenchmarkMistral SmallQwQ-32B
LMArena Vision1142—

Multilingual Too close to call

Mistral Small: 45.5 (#169), QwQ-32B: 44.8 (#176)

BenchmarkMistral SmallQwQ-32B
LMArena Non-English13151305
LMArena Chinese13401378
LMArena French13371336
LMArena German13401313
LMArena Japanese12751262
LMArena Korean12591279
LMArena Russian13241297
LMArena Spanish13461354

Instruction Following QwQ-32B leads

Mistral Small: 66.4 (#209), QwQ-32B: 72.6 (#137)

BenchmarkMistral SmallQwQ-32B
LiveBench Instruction Following63.7%81.8%
LMArena Instruction Following13101297

Long Context QwQ-32B leads

Mistral Small: 40.4 (#156), QwQ-32B: 49.0 (#11)

BenchmarkMistral SmallQwQ-32B
LMArena Longer Query13271308
Fiction.LiveBench—83.3%

Writing & Preference Mistral Small leads

Mistral Small: 52.5 (#171), QwQ-32B: 50.6 (#180)

BenchmarkMistral SmallQwQ-32B
LMArena Text13381329
LMArena Creative Writing13051288
LMArena Multi-Turn13441314
LiveBench Language30.5%51.4%
Short-Story Creative Writing—80.2%
EQ-Bench Creative Writing—1257

Frequently asked questions

Is Mistral Small better than QwQ-32B?

QwQ-32B is the stronger model overall, scoring 39.8 to 33.4 on the Noometry Index.

Is Mistral Small or QwQ-32B better for coding?

QwQ-32B scores higher on coding benchmarks: 35.4 versus 34.0 in the Noometry coding category.

How many benchmarks do Mistral Small and QwQ-32B share?

28 benchmarks have published results for both models. Mistral Small has 39 scored results on Noometry and QwQ-32B has 36.

Related comparisons

Go deeper