Model comparison

Mistral Small 3.2 vs Phi 3 Mini 4k Instruct June 2024

Mistral Small 3.2 and Phi 3 Mini 4k Instruct June 2024 score almost the same on the Noometry Index (31.2 vs 31.3), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Summary

  • The widest gap is in writing & preference, where Mistral Small 3.2 leads 45.0 to 29.6.

Side by side

Mistral Small 3.2 and Phi 3 Mini 4k Instruct June 2024 specifications
Mistral Small 3.2Phi 3 Mini 4k Instruct June 2024
ProviderMistral AIMicrosoft
Noometry Index31.231.3
Released2025-06-20—
WeightsOpenOpen
Context window256K—
Max output16K—
Input $ / M tokens$0.0938—
Output $ / M tokens$0.25—
Results tracked615

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Small 3.2: —, Phi 3 Mini 4k Instruct June 2024: 31.8 (#279)

Coding benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
LMArena Coding—1093

Reasoning Phi 3 Mini 4k Instruct June 2024 leads

Mistral Small 3.2: 18.1 (#287), Phi 3 Mini 4k Instruct June 2024: 20.8 (#231)

Reasoning benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
Kagi LLM Benchmark40.4%—
Chess Puzzles1%—
LMArena Hard Prompts—1087
Epoch Capabilities Index131.74—

Math Phi 3 Mini 4k Instruct June 2024 leads

Mistral Small 3.2: 26.3 (#260), Phi 3 Mini 4k Instruct June 2024: 33.0 (#208)

Math benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
OTIS Mock AIME 2024-202530.3%—
LMArena Math—1152

Knowledge Phi 3 Mini 4k Instruct June 2024 leads

Mistral Small 3.2: 26.7 (#256), Phi 3 Mini 4k Instruct June 2024: 28.6 (#244)

Knowledge benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
GPQA Diamond49.1%—
LMArena Expert—1051

Multilingual Not comparable

Mistral Small 3.2: —, Phi 3 Mini 4k Instruct June 2024: 25.9 (#282)

Multilingual benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
LMArena Non-English—1013
LMArena Chinese—1033
LMArena German—1031
LMArena Japanese—954
LMArena Korean—880
LMArena Russian—1019

Instruction Following Not comparable

Mistral Small 3.2: —, Phi 3 Mini 4k Instruct June 2024: 54.1 (#282)

Instruction Following benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
LMArena Instruction Following—1058

Long Context Not comparable

Mistral Small 3.2: —, Phi 3 Mini 4k Instruct June 2024: 31.7 (#277)

Long Context benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
LMArena Longer Query—1042

Writing & Preference Mistral Small 3.2 leads

Mistral Small 3.2: 45.0 (#224), Phi 3 Mini 4k Instruct June 2024: 29.6 (#294)

Writing & Preference benchmarks
BenchmarkMistral Small 3.2Phi 3 Mini 4k Instruct June 2024
LMArena Text—1080
LMArena Creative Writing—1045
EQ-Bench Creative Writing1255—
LMArena Multi-Turn—1049

Frequently asked questions

Is Mistral Small 3.2 better than Phi 3 Mini 4k Instruct June 2024?

Mistral Small 3.2 and Phi 3 Mini 4k Instruct June 2024 score almost the same on the Noometry Index (31.2 vs 31.3), so choose on price, context window or the category you care about most.

How many benchmarks do Mistral Small 3.2 and Phi 3 Mini 4k Instruct June 2024 share?

0 benchmarks have published results for both models. Mistral Small 3.2 has 6 scored results on Noometry and Phi 3 Mini 4k Instruct June 2024 has 15.

Related comparisons

Go deeper