Model comparison

Llama 3.1 Nemotron 70b Instruct vs Step 3.7 Flash

Llama 3.1 Nemotron 70b Instruct and Step 3.7 Flash score almost the same on the Noometry Index (37.6 vs 37.3), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 35.5.

Side by side

Llama 3.1 Nemotron 70b Instruct and Step 3.7 Flash specifications
Llama 3.1 Nemotron 70b InstructStep 3.7 Flash
ProviderNVIDIAStepFun
Noometry Index37.637.3
Released2024-12-182026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked145

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Llama 3.1 Nemotron 70b Instruct: 35.9 (#216), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
SciCode—40%
BigCodeBench Instruct38.7%—
LMArena Coding1272—
BigCodeBench Complete48.2%—
ALE-Bench—694.12

Reasoning Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 25.0 (#152), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1266—

Math Step 3.7 Flash leads

Llama 3.1 Nemotron 70b Instruct: 35.5 (#182), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1271—

Knowledge Not comparable

Llama 3.1 Nemotron 70b Instruct: 34.1 (#199), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
LMArena Expert1242—

Multilingual Not comparable

Llama 3.1 Nemotron 70b Instruct: 40.5 (#217), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
LMArena Non-English1245—
LMArena Chinese1263—
LMArena Russian1227—

Instruction Following Not comparable

Llama 3.1 Nemotron 70b Instruct: 65.9 (#213), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
LMArena Instruction Following1252—

Long Context Not comparable

Llama 3.1 Nemotron 70b Instruct: 37.6 (#215), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
LMArena Longer Query1238—

Writing & Preference Not comparable

Llama 3.1 Nemotron 70b Instruct: 48.4 (#203), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 3.7 Flash
LMArena Text1283—
LMArena Creative Writing1269—
LMArena Multi-Turn1275—

Frequently asked questions

Is Llama 3.1 Nemotron 70b Instruct better than Step 3.7 Flash?

Llama 3.1 Nemotron 70b Instruct and Step 3.7 Flash score almost the same on the Noometry Index (37.6 vs 37.3), so choose on price, context window or the category you care about most.

Is Llama 3.1 Nemotron 70b Instruct or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 35.9 in the Noometry coding category.

How many benchmarks do Llama 3.1 Nemotron 70b Instruct and Step 3.7 Flash share?

0 benchmarks have published results for both models. Llama 3.1 Nemotron 70b Instruct has 14 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper