Model comparison

DeepSeek-R1-Distill-Qwen-14B vs Phi 3 Medium 4k Instruct

DeepSeek-R1-Distill-Qwen-14B and Phi 3 Medium 4k Instruct score almost the same on the Noometry Index (32.7 vs 33.0), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

DeepSeek-R1-Distill-Qwen-14B DeepSeek

32.7

Rank #252 Confirmed

Phi 3 Medium 4k Instruct Microsoft

33.0

Rank #250 Confirmed

Summary

  • The widest gap is in knowledge, where Phi 3 Medium 4k Instruct leads 30.2 to 24.1.

Side by side

DeepSeek-R1-Distill-Qwen-14B and Phi 3 Medium 4k Instruct specifications
DeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
ProviderDeepSeekMicrosoft
Noometry Index32.733.0
Released2025-01-20—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked717

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-R1-Distill-Qwen-14B leads

DeepSeek-R1-Distill-Qwen-14B: 36.9 (#200), Phi 3 Medium 4k Instruct: 32.9 (#268)

Coding benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
BigCodeBench Instruct38.1%—
LMArena Coding—1130
BigCodeBench Complete48.4%—

Reasoning Phi 3 Medium 4k Instruct leads

DeepSeek-R1-Distill-Qwen-14B: 19.2 (#263), Phi 3 Medium 4k Instruct: 21.7 (#214)

Reasoning benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
Chess Puzzles1%—
LMArena Hard Prompts—1127
Epoch Capabilities Index135.43—

Math DeepSeek-R1-Distill-Qwen-14B leads

DeepSeek-R1-Distill-Qwen-14B: 35.5 (#184), Phi 3 Medium 4k Instruct: 33.4 (#202)

Math benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
OTIS Mock AIME 2024-202550.6%—
LMArena Math—1173
MATH Level 587.1%—

Knowledge Phi 3 Medium 4k Instruct leads

DeepSeek-R1-Distill-Qwen-14B: 24.1 (#270), Phi 3 Medium 4k Instruct: 30.2 (#229)

Knowledge benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
GPQA Diamond44.7%—
LMArena Expert—1108

Multilingual Not comparable

DeepSeek-R1-Distill-Qwen-14B: —, Phi 3 Medium 4k Instruct: 30.6 (#263)

Multilingual benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
LMArena Non-English—1094
LMArena Chinese—1108
LMArena French—1110
LMArena German—1101
LMArena Japanese—1042
LMArena Korean—954
LMArena Russian—1145
LMArena Spanish—1095

Instruction Following Not comparable

DeepSeek-R1-Distill-Qwen-14B: —, Phi 3 Medium 4k Instruct: 57.6 (#268)

Instruction Following benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
LMArena Instruction Following—1113

Long Context Not comparable

DeepSeek-R1-Distill-Qwen-14B: —, Phi 3 Medium 4k Instruct: 34.0 (#255)

Long Context benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
LMArena Longer Query—1120

Writing & Preference Not comparable

DeepSeek-R1-Distill-Qwen-14B: —, Phi 3 Medium 4k Instruct: 34.1 (#272)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-14BPhi 3 Medium 4k Instruct
LMArena Text—1138
LMArena Creative Writing—1107
LMArena Multi-Turn—1088

Frequently asked questions

Is DeepSeek-R1-Distill-Qwen-14B better than Phi 3 Medium 4k Instruct?

DeepSeek-R1-Distill-Qwen-14B and Phi 3 Medium 4k Instruct score almost the same on the Noometry Index (32.7 vs 33.0), so choose on price, context window or the category you care about most.

Is DeepSeek-R1-Distill-Qwen-14B or Phi 3 Medium 4k Instruct better for coding?

DeepSeek-R1-Distill-Qwen-14B scores higher on coding benchmarks: 36.9 versus 32.9 in the Noometry coding category.

How many benchmarks do DeepSeek-R1-Distill-Qwen-14B and Phi 3 Medium 4k Instruct share?

0 benchmarks have published results for both models. DeepSeek-R1-Distill-Qwen-14B has 7 scored results on Noometry and Phi 3 Medium 4k Instruct has 17.

Related comparisons

Go deeper