Model comparison

Deepseek Coder v2 vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 35.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Deepseek Coder v2 DeepSeek

35.9

Rank #220 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 34.9.

Side by side

Deepseek Coder v2 and Step 3.7 Flash specifications
Deepseek Coder v2Step 3.7 Flash
ProviderDeepSeekStepFun
Noometry Index35.937.3
Released2024-06-172026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked245

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Deepseek Coder v2: 38.1 (#183), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
SciCode—40%
BigCodeBench Instruct48.2%—
LMArena Coding1251—
BigCodeBench Complete59.7%—
ALE-Bench—694.12
HumanEval+82.3%—
MBPP+75.1%—

Reasoning Deepseek Coder v2 leads

Deepseek Coder v2: 23.6 (#176), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1207—
WinoGrande83.7%—

Math Step 3.7 Flash leads

Deepseek Coder v2: 34.9 (#190), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1241—
GSM8K94.5%—

Knowledge Not comparable

Deepseek Coder v2: 32.3 (#212), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
LMArena Expert1181—
ARC (AI2) Challenge64.3%—

Multilingual Not comparable

Deepseek Coder v2: 36.3 (#240), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
LMArena Non-English1182—
LMArena Chinese1201—
LMArena French1185—
LMArena German1164—
LMArena Japanese1126—
LMArena Korean1104—
LMArena Russian1188—
LMArena Spanish1153—

Instruction Following Not comparable

Deepseek Coder v2: 61.7 (#242), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
LMArena Instruction Following1180—

Long Context Not comparable

Deepseek Coder v2: 37.0 (#224), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
LMArena Longer Query1219—

Writing & Preference Not comparable

Deepseek Coder v2: 38.2 (#253), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkDeepseek Coder v2Step 3.7 Flash
LMArena Text1191—
LMArena Creative Writing1120—
LMArena Multi-Turn1177—

Frequently asked questions

Is Deepseek Coder v2 better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 35.9 on the Noometry Index.

Is Deepseek Coder v2 or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 38.1 in the Noometry coding category.

How many benchmarks do Deepseek Coder v2 and Step 3.7 Flash share?

0 benchmarks have published results for both models. Deepseek Coder v2 has 24 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper