Model comparison

phi-3-medium 14B vs Qwen3 32B

Qwen3 32B is the stronger model overall, scoring 38.8 to 29.1 on the Noometry Index.

Last verified . 2 shared benchmarks.

phi-3-medium 14B Microsoft

29.1

Rank #306 Reported

Qwen3 32B Alibaba (Qwen)

38.8

Rank #166 Confirmed

Summary

  • They share 2 benchmarks with published results for both. phi-3-medium 14B scores higher in 0 categories and Qwen3 32B in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3 32B leads 40.0 to 9.1.
  • The biggest single-benchmark swing is GPQA Diamond: 27.6% for phi-3-medium 14B and 65.7% for Qwen3 32B.

Side by side

phi-3-medium 14B and Qwen3 32B specifications
phi-3-medium 14BQwen3 32B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index29.138.8
Released2024-04-232025-04
WeightsOpenOpen
Context window—131K
Max output—16K
Input $ / M tokens—$0.70
Output $ / M tokens—$2.80
Results tracked1326

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 32B leads

phi-3-medium 14B: 36.3 (#198), Qwen3 32B: 37.3 (#184)

Coding benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
Aider Polyglot—40%
SciCode—35.4%
BigCodeBench Instruct37.6%—
LMArena Coding—1358
BigCodeBench Complete48.7%—

Agentic & Tool Use Not comparable

phi-3-medium 14B: —, Qwen3 32B: 32.3 (#58)

Agentic & Tool Use benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
Berkeley Function Calling Leaderboard—48.7%

Reasoning Not comparable

phi-3-medium 14B: —, Qwen3 32B: 19.6 (#233)

Reasoning benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
Epoch Capabilities Index121.18138.51
Kagi LLM Benchmark—54.9%
CritPt—0.3%
Chess Puzzles—5%
LMArena Hard Prompts—1335
DTBench—67.5%
LMCA—17.3%
Adversarial NLI55.8%—
BIG-Bench Hard81.4%—
HellaSwag82.4%—
WinoGrande81.5%—

Math Qwen3 32B leads

phi-3-medium 14B: 25.2 (#249), Qwen3 32B: 37.9 (#89)

Math benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
OTIS Mock AIME 2024-2025—66.9%
LMArena Math—1399
MATH Level 517.6%—

Knowledge Qwen3 32B leads

phi-3-medium 14B: 9.1 (#301), Qwen3 32B: 40.0 (#112)

Knowledge benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
GPQA Diamond27.6%65.7%
Vectara Hallucination Rate—5.9%
LMArena Expert—1362
ARC (AI2) Challenge91.6%—
MMLU78%—
OpenBookQA87.4%—
TriviaQA73.9%—

Multilingual Not comparable

phi-3-medium 14B: —, Qwen3 32B: 45.8 (#162)

Multilingual benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
LMArena Non-English—1317
LMArena Chinese—1357
LMArena German—1341
LMArena Russian—1311

Instruction Following Not comparable

phi-3-medium 14B: —, Qwen3 32B: 69.1 (#174)

Instruction Following benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
LMArena Instruction Following—1305

Long Context Not comparable

phi-3-medium 14B: —, Qwen3 32B: 43.7 (#83)

Long Context benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
Fiction.LiveBench—74.2%
LMArena Longer Query—1327

Writing & Preference Not comparable

phi-3-medium 14B: —, Qwen3 32B: 53.1 (#158)

Writing & Preference benchmarks
Benchmarkphi-3-medium 14BQwen3 32B
LMArena Text—1340
LMArena Creative Writing—1297
LMArena Multi-Turn—1331

Frequently asked questions

Is phi-3-medium 14B better than Qwen3 32B?

Qwen3 32B is the stronger model overall, scoring 38.8 to 29.1 on the Noometry Index.

Is phi-3-medium 14B or Qwen3 32B better for coding?

Qwen3 32B scores higher on coding benchmarks: 37.3 versus 36.3 in the Noometry coding category.

How many benchmarks do phi-3-medium 14B and Qwen3 32B share?

2 benchmarks have published results for both models. phi-3-medium 14B has 13 scored results on Noometry and Qwen3 32B has 26.

Related comparisons

Go deeper