Noometry

Model comparison

Mistral Small 3.2 vs Yi-34B

Mistral Small 3.2 is the stronger model overall, scoring 31.2 to 27.8 on the Noometry Index.

Last verified . 2 shared benchmarks.

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Mistral Small 3.2 scores higher in 3 categories and Yi-34B in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Mistral Small 3.2 leads 26.7 to 7.5.
  • The biggest single-benchmark swing is GPQA Diamond: 49.1% for Mistral Small 3.2 and 14.7% for Yi-34B.

Side by side

Mistral Small 3.2Yi-34B
ProviderMistral AI01.AI
Noometry Index31.227.8
Released2025-06-202023-11-02
WeightsOpenOpen
Context window256K—
Max output16K—
Input $ / M tokens$0.0938—
Output $ / M tokens$0.25—
Results tracked623

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Small 3.2: —, Yi-34B: 32.3 (#274)

BenchmarkMistral Small 3.2Yi-34B
LMArena Coding—1112

Reasoning Yi-34B leads

Mistral Small 3.2: 18.1 (#287), Yi-34B: 21.2 (#226)

BenchmarkMistral Small 3.2Yi-34B
Epoch Capabilities Index131.74117.39
Kagi LLM Benchmark40.4%—
Chess Puzzles1%—
LMArena Hard Prompts—1104
BIG-Bench Hard—71.7%

Math Mistral Small 3.2 leads

Mistral Small 3.2: 26.3 (#260), Yi-34B: 21.6 (#282)

BenchmarkMistral Small 3.2Yi-34B
OTIS Mock AIME 2024-202530.3%—
LMArena Math—1114
MATH Level 5—5.1%
GSM8K—76%

Knowledge Mistral Small 3.2 leads

Mistral Small 3.2: 26.7 (#256), Yi-34B: 7.5 (#309)

BenchmarkMistral Small 3.2Yi-34B
GPQA Diamond49.1%14.7%
LMArena Expert—1061
MMLU—76.3%

Multilingual Not comparable

Mistral Small 3.2: —, Yi-34B: 29.7 (#264)

BenchmarkMistral Small 3.2Yi-34B
LMArena Non-English—1079
LMArena Chinese—1176
LMArena French—1081
LMArena German—1042
LMArena Japanese—993
LMArena Korean—959
LMArena Russian—1050
LMArena Spanish—1070

Instruction Following Not comparable

Mistral Small 3.2: —, Yi-34B: 56.2 (#274)

BenchmarkMistral Small 3.2Yi-34B
LMArena Instruction Following—1091

Long Context Not comparable

Mistral Small 3.2: —, Yi-34B: 33.2 (#264)

BenchmarkMistral Small 3.2Yi-34B
LMArena Longer Query—1094

Writing & Preference Mistral Small 3.2 leads

Mistral Small 3.2: 45.0 (#224), Yi-34B: 34.1 (#273)

BenchmarkMistral Small 3.2Yi-34B
LMArena Text—1129
LMArena Creative Writing—1108
EQ-Bench Creative Writing1255—
LMArena Multi-Turn—1113

Frequently asked questions

Is Mistral Small 3.2 better than Yi-34B?

Mistral Small 3.2 is the stronger model overall, scoring 31.2 to 27.8 on the Noometry Index.

How many benchmarks do Mistral Small 3.2 and Yi-34B share?

2 benchmarks have published results for both models. Mistral Small 3.2 has 6 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper