Noometry

Model comparison

phi-3-medium 14B vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.0 to 29.1 on the Noometry Index.

Last verified . 2 shared benchmarks.

phi-3-medium 14B Microsoft

29.1

Rank #306 Reported

Qwen3.7 Plus Alibaba (Qwen)

45.0

Rank #66 Confirmed

Summary

  • They share 2 benchmarks with published results for both. phi-3-medium 14B scores higher in 1 category and Qwen3.7 Plus in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Plus leads 54.9 to 9.1.
  • The biggest single-benchmark swing is GPQA Diamond: 27.6% for phi-3-medium 14B and 87.9% for Qwen3.7 Plus.
  • phi-3-medium 14B has downloadable open weights; the other is API-only.

Side by side

phi-3-medium 14BQwen3.7 Plus
ProviderMicrosoftAlibaba (Qwen)
Noometry Index29.145.0
Released2024-04-232026-06-02
WeightsOpenProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.60
Results tracked1332

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

phi-3-medium 14B: 36.3 (#198), Qwen3.7 Plus: 36.1 (#200)

Benchmarkphi-3-medium 14BQwen3.7 Plus
FrontierCode—10.2%
SciCode—45.5%
BigCodeBench Instruct37.6%—
LMArena Coding—1473
BigCodeBench Complete48.7%—

Agentic & Tool Use Not comparable

phi-3-medium 14B: —, Qwen3.7 Plus: 21.2 (#130)

Benchmarkphi-3-medium 14BQwen3.7 Plus
OSWorld 2.0—2.8%

Reasoning Not comparable

phi-3-medium 14B: —, Qwen3.7 Plus: 38.4 (#54)

Benchmarkphi-3-medium 14BQwen3.7 Plus
Epoch Capabilities Index121.18147.39
NYT Connections (extended)—74.8%
CritPt—9.1%
Chess Puzzles—24%
LMArena Hard Prompts—1460
Mystery Game Puzzles—17%
DTBench—84%
LMCA—37.6%
Adversarial NLI55.8%—
BIG-Bench Hard81.4%—
HellaSwag82.4%—
WinoGrande81.5%—

Math Qwen3.7 Plus leads

phi-3-medium 14B: 25.2 (#249), Qwen3.7 Plus: 49.3 (#47)

Benchmarkphi-3-medium 14BQwen3.7 Plus
FrontierMath (Tiers 1-3)—34.4%
OTIS Mock AIME 2024-2025—93.3%
LMArena Math—1467
MATH Level 517.6%—

Knowledge Qwen3.7 Plus leads

phi-3-medium 14B: 9.1 (#301), Qwen3.7 Plus: 54.9 (#46)

Benchmarkphi-3-medium 14BQwen3.7 Plus
GPQA Diamond27.6%87.9%
LMArena Expert—1467
ARC (AI2) Challenge91.6%—
MMLU78%—
OpenBookQA87.4%—
TriviaQA73.9%—

Multimodal Not comparable

phi-3-medium 14B: —, Qwen3.7 Plus: 41.2 (#30)

Benchmarkphi-3-medium 14BQwen3.7 Plus
LMArena Vision—1281
LMArena Document—1444

Multilingual Not comparable

phi-3-medium 14B: —, Qwen3.7 Plus: 55.0 (#36)

Benchmarkphi-3-medium 14BQwen3.7 Plus
LMArena Non-English—1445
LMArena Chinese—1510
LMArena French—1471
LMArena German—1471
LMArena Japanese—1411
LMArena Korean—1416
LMArena Russian—1457
LMArena Spanish—1453

Instruction Following Not comparable

phi-3-medium 14B: —, Qwen3.7 Plus: 75.9 (#49)

Benchmarkphi-3-medium 14BQwen3.7 Plus
LMArena Instruction Following—1439

Long Context Not comparable

phi-3-medium 14B: —, Qwen3.7 Plus: 44.5 (#61)

Benchmarkphi-3-medium 14BQwen3.7 Plus
LMArena Longer Query—1454

Writing & Preference Not comparable

phi-3-medium 14B: —, Qwen3.7 Plus: 64.5 (#54)

Benchmarkphi-3-medium 14BQwen3.7 Plus
LMArena Text—1454
LMArena Creative Writing—1439
LMArena Multi-Turn—1459

Frequently asked questions

Is phi-3-medium 14B better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.0 to 29.1 on the Noometry Index.

Is phi-3-medium 14B or Qwen3.7 Plus better for coding?

They score almost the same on coding (36.3 vs 36.1); test both on your own repository before choosing.

How many benchmarks do phi-3-medium 14B and Qwen3.7 Plus share?

2 benchmarks have published results for both models. phi-3-medium 14B has 13 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper