Model comparison

Grok 4.6 vs Step 5 Preview

Grok 4.6 is the stronger model overall, scoring 56.9 to 47.9 on the Noometry Index. Step 5 Preview costs 2.1× less per token, which makes it the better buy when Grok 4.6's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Grok 4.6 scores higher in 5 categories and Step 5 Preview in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok 4.6 leads 63.3 to 41.2.
  • The biggest single-benchmark swing is ProofBench: 51% for Grok 4.6 and 42% for Step 5 Preview.
  • Step 5 Preview is cheaper at $1 / $2.70 per million input/output tokens, against $2 / $6 for Grok 4.6.
  • Step 5 Preview accepts more context: 1.02M tokens versus 500K.

Side by side

Grok 4.6 and Step 5 Preview specifications
Grok 4.6Step 5 Preview
ProviderxAIStepFun
Noometry Index56.947.9
Released2026-08-122026-09-16
WeightsProprietaryProprietary
Context window500K1.02M
Max output500K66K
Input $ / M tokens$2$1
Output $ / M tokens$6$2.70
Results tracked4918

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.6 leads

Grok 4.6: 58.5 (#16), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkGrok 4.6Step 5 Preview
LMArena WebDev16171564
SciCode56.5%58.9%
LMArena Coding14651480
DeepSWE67.5%—
FrontierCode48%—
CursorBench41.4%—
FrontierSWE25.3%—
WeirdML67.3%—
ALE-Bench1,508—

Agentic & Tool Use Not comparable

Grok 4.6: 39.4 (#27), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.6Step 5 Preview
APEX-Agents65.3%—
GDP.pdf17.2%—
Vending-Bench 29,047—

Reasoning Grok 4.6 leads

Grok 4.6: 61.4 (#20), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkGrok 4.6Step 5 Preview
CritPt19.7%20.9%
LMArena Hard Prompts14471465
ARC-AGI-267.1%—
SimpleBench75.9%—
NYT Connections (extended)80%—
ARC-AGI-187.5%—
Chess Puzzles40%—
EBR-Bench30.5%—
Mystery Game Puzzles34%—
DTBench97.3%—
LMCA48.5%—
Epoch Capabilities Index156.44—

Math Grok 4.6 leads

Grok 4.6: 67.0 (#24), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkGrok 4.6Step 5 Preview
ProofBench51%42%
LMArena Math14231470
FrontierMath (Tiers 1-3)66%—
FrontierMath Tier 431.7%—
OTIS Mock AIME 2024-202599.2%—

Knowledge Grok 4.6 leads

Grok 4.6: 63.3 (#20), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkGrok 4.6Step 5 Preview
LMArena Expert14671470
GPQA Diamond94%—
SimpleQA Verified49.3%—

Multimodal Grok 4.6 leads

Grok 4.6: 43.6 (#23), Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkGrok 4.6Step 5 Preview
LMArena Vision12631267
Blueprint-Bench 233.2%—
Furniture Assembly40%—
LMArena Document1452—

Multilingual Too close to call

Grok 4.6: 53.0 (#74), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkGrok 4.6Step 5 Preview
LMArena Non-English14201432
LMArena Chinese14801519
LMArena Russian14221436
LMArena Spanish14041439
LMArena French1461—
LMArena German1431—
LMArena Japanese1376—
LMArena Korean1397—

Instruction Following Too close to call

Grok 4.6: 75.4 (#63), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkGrok 4.6Step 5 Preview
LMArena Instruction Following14311444

Long Context Too close to call

Grok 4.6: 44.5 (#66), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkGrok 4.6Step 5 Preview
LMArena Longer Query14541455

Writing & Preference Too close to call

Grok 4.6: 62.3 (#80), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkGrok 4.6Step 5 Preview
LMArena Text14281442
LMArena Creative Writing14281410
LMArena Multi-Turn14251447

Frequently asked questions

Is Grok 4.6 better than Step 5 Preview?

Grok 4.6 is the stronger model overall, scoring 56.9 to 47.9 on the Noometry Index. Step 5 Preview costs 2.1× less per token, which makes it the better buy when Grok 4.6's lead doesn't matter for your workload.

Which is cheaper, Grok 4.6 or Step 5 Preview?

Step 5 Preview is cheaper. It lists at $1 per million input tokens and $2.70 per million output tokens; Grok 4.6 lists at $2 and $6.

Is Grok 4.6 or Step 5 Preview better for coding?

Grok 4.6 scores higher on coding benchmarks: 58.5 versus 51.8 in the Noometry coding category.

Which has the bigger context window?

Step 5 Preview does, with 1.02M tokens against 500K.

How many benchmarks do Grok 4.6 and Step 5 Preview share?

18 benchmarks have published results for both models. Grok 4.6 has 49 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper