Noometry

Model comparison

Deepseek Coder v2 vs Mercury 2.5

Deepseek Coder v2 is the stronger model overall, scoring 35.9 to 33.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Deepseek Coder v2 DeepSeek

35.9

Rank #220 Confirmed

Mercury 2.5 Inception

33.5

Rank #242 Reported

Summary

  • The widest gap is in math, where Deepseek Coder v2 leads 34.9 to 23.3.
  • Deepseek Coder v2 has downloadable open weights; the other is API-only.

Side by side

Deepseek Coder v2Mercury 2.5
ProviderDeepSeekInception
Noometry Index35.933.5
Released2024-06-172026-09-08
WeightsOpenProprietary
Context window—260K
Max output—66K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.15
Results tracked244

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mercury 2.5 leads

Deepseek Coder v2: 38.1 (#183), Mercury 2.5: 39.5 (#156)

BenchmarkDeepseek Coder v2Mercury 2.5
SciCode—38.5%
BigCodeBench Instruct48.2%—
LMArena Coding1251—
BigCodeBench Complete59.7%—
ALE-Bench—301.65
HumanEval+82.3%—
MBPP+75.1%—

Reasoning Deepseek Coder v2 leads

Deepseek Coder v2: 23.6 (#176), Mercury 2.5: 22.4 (#193)

BenchmarkDeepseek Coder v2Mercury 2.5
CritPt—0%
LMArena Hard Prompts1207—
WinoGrande83.7%—

Math Deepseek Coder v2 leads

Deepseek Coder v2: 34.9 (#190), Mercury 2.5: 23.3 (#272)

BenchmarkDeepseek Coder v2Mercury 2.5
ProofBench—3%
LMArena Math1241—
GSM8K94.5%—

Knowledge Not comparable

Deepseek Coder v2: 32.3 (#212), Mercury 2.5: —

BenchmarkDeepseek Coder v2Mercury 2.5
LMArena Expert1181—
ARC (AI2) Challenge64.3%—

Multilingual Not comparable

Deepseek Coder v2: 36.3 (#240), Mercury 2.5: —

BenchmarkDeepseek Coder v2Mercury 2.5
LMArena Non-English1182—
LMArena Chinese1201—
LMArena French1185—
LMArena German1164—
LMArena Japanese1126—
LMArena Korean1104—
LMArena Russian1188—
LMArena Spanish1153—

Instruction Following Not comparable

Deepseek Coder v2: 61.7 (#242), Mercury 2.5: —

BenchmarkDeepseek Coder v2Mercury 2.5
LMArena Instruction Following1180—

Long Context Not comparable

Deepseek Coder v2: 37.0 (#224), Mercury 2.5: —

BenchmarkDeepseek Coder v2Mercury 2.5
LMArena Longer Query1219—

Writing & Preference Not comparable

Deepseek Coder v2: 38.2 (#253), Mercury 2.5: —

BenchmarkDeepseek Coder v2Mercury 2.5
LMArena Text1191—
LMArena Creative Writing1120—
LMArena Multi-Turn1177—

Frequently asked questions

Is Deepseek Coder v2 better than Mercury 2.5?

Deepseek Coder v2 is the stronger model overall, scoring 35.9 to 33.5 on the Noometry Index.

Is Deepseek Coder v2 or Mercury 2.5 better for coding?

Mercury 2.5 scores higher on coding benchmarks: 39.5 versus 38.1 in the Noometry coding category.

How many benchmarks do Deepseek Coder v2 and Mercury 2.5 share?

0 benchmarks have published results for both models. Deepseek Coder v2 has 24 scored results on Noometry and Mercury 2.5 has 4.

Related comparisons

Go deeper