Model comparison

Grok 4.5 vs Step 3.5 Flash

Grok 4.5 is the stronger model overall, scoring 55.0 to 42.3 on the Noometry Index. Step 3.5 Flash costs 20× less per token, which makes it the better buy when Grok 4.5's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Grok 4.5 scores higher in 8 categories and Step 3.5 Flash in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.5 leads 56.1 to 22.2.
  • The biggest single-benchmark swing is NYT Connections (extended): 79.9% for Grok 4.5 and 28.4% for Step 3.5 Flash.
  • Step 3.5 Flash is cheaper at $0.10 / $0.30 per million input/output tokens, against $2 / $6 for Grok 4.5.
  • Grok 4.5 accepts more context: 500K tokens versus 256K.
  • Step 3.5 Flash has downloadable open weights; the other is API-only.

Side by side

Grok 4.5 and Step 3.5 Flash specifications
Grok 4.5Step 3.5 Flash
ProviderxAIStepFun
Noometry Index55.042.3
Released2026-07-082026-01-29
WeightsProprietaryOpen
Context window500K256K
Max output500K256K
Input $ / M tokens$2$0.10
Output $ / M tokens$6$0.30
Results tracked5219

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

Grok 4.5: 52.2 (#35), Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Coding14741436
DeepSWE53.8%—
FrontierCode42.4%—
LMArena WebDev1553—
SciCode54.1%—
WeirdML46.4%—
ALE-Bench1,309—

Agentic & Tool Use Not comparable

Grok 4.5: 44.4 (#17), Step 3.5 Flash: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
APEX-Agents56.2%—
τ²-bench Banking47.9%—
PostTrainBench23.4%—
GBAEval65.4%—
GDP.pdf14%—
LMArena Search1213—
Vending-Bench 23,887—

Reasoning Grok 4.5 leads

Grok 4.5: 56.1 (#25), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
NYT Connections (extended)79.9%28.4%
LMArena Hard Prompts14621411
ARC-AGI-252.6%—
SimpleBench70%—
Kagi LLM Benchmark83.5%—
ARC-AGI-187.2%—
CritPt15.4%—
Chess Puzzles36%—
DTBench96.5%—
LMCA45.2%—
Surface Evolver Bench74.4%—
Epoch Capabilities Index153.92—

Math Grok 4.5 leads

Grok 4.5: 60.9 (#35), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Math14591408
FrontierMath (Tiers 1-3)57.2%—
FrontierMath Tier 424.4%—
MathArena Final-Answer Competitions—66.8%
OTIS Mock AIME 2024-202597.8%—
ProofBench31%—

Knowledge Grok 4.5 leads

Grok 4.5: 62.3 (#24), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Expert14661421
GPQA Diamond93.4%—
SimpleQA Verified48.3%—

Multimodal Not comparable

Grok 4.5: 37.6 (#72), Step 3.5 Flash: —

Multimodal benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Vision1288—
Blueprint-Bench 227.3%—
Furniture Assembly22.5%—
LMArena Document1452—

Multilingual Grok 4.5 leads

Grok 4.5: 54.4 (#42), Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Non-English14401385
LMArena Chinese14961447
LMArena French14561421
LMArena German14461405
LMArena Japanese14281354
LMArena Korean14041352
LMArena Russian14481385
LMArena Spanish14501419

Instruction Following Grok 4.5 leads

Grok 4.5: 76.0 (#48), Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Instruction Following14461385

Long Context Grok 4.5 leads

Grok 4.5: 44.8 (#56), Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Longer Query14631402

Writing & Preference Grok 4.5 leads

Grok 4.5: 65.8 (#42), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkGrok 4.5Step 3.5 Flash
LMArena Text14481403
LMArena Creative Writing14421357
LMArena Multi-Turn14561405
EQ-Bench Creative Writing1579—

Frequently asked questions

Is Grok 4.5 better than Step 3.5 Flash?

Grok 4.5 is the stronger model overall, scoring 55.0 to 42.3 on the Noometry Index. Step 3.5 Flash costs 20× less per token, which makes it the better buy when Grok 4.5's lead doesn't matter for your workload.

Which is cheaper, Grok 4.5 or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Grok 4.5 lists at $2 and $6.

Is Grok 4.5 or Step 3.5 Flash better for coding?

Grok 4.5 scores higher on coding benchmarks: 52.2 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Grok 4.5 does, with 500K tokens against 256K.

How many benchmarks do Grok 4.5 and Step 3.5 Flash share?

18 benchmarks have published results for both models. Grok 4.5 has 52 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper