Model comparison

GPT-5 Pro vs Grok 4.6

Grok 4.6 is the stronger model overall, scoring 56.9 to 46.4 on the Noometry Index.

Last verified . 7 shared benchmarks.

GPT-5 Pro OpenAI

46.4

Rank #64 Confirmed

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Summary

  • They share 7 benchmarks with published results for both. GPT-5 Pro scores higher in 0 categories and Grok 4.6 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.6 leads 61.4 to 38.9.
  • The biggest single-benchmark swing is ARC-AGI-2: 18.3% for GPT-5 Pro and 67.1% for Grok 4.6.
  • Grok 4.6 is cheaper at $2 / $6 per million input/output tokens, against $15 / $120 for GPT-5 Pro.
  • Grok 4.6 accepts more context: 500K tokens versus 400K.

Side by side

GPT-5 Pro and Grok 4.6 specifications
GPT-5 ProGrok 4.6
ProviderOpenAIxAI
Noometry Index46.456.9
Released2025-10-062026-08-12
WeightsProprietaryProprietary
Context window400K500K
Max output272K500K
Input $ / M tokens$15$2
Output $ / M tokens$120$6
Results tracked1249

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.6 leads

GPT-5 Pro: 44.0 (#80), Grok 4.6: 58.5 (#16)

Coding benchmarks
BenchmarkGPT-5 ProGrok 4.6
WeirdML60.4%67.3%
DeepSWE—67.5%
FrontierCode—48%
CursorBench—41.4%
LMArena WebDev—1617
FrontierSWE—25.3%
SciCode—56.5%
LMArena Coding—1465
ALE-Bench—1,508
AlgoTune1.31—

Agentic & Tool Use Not comparable

GPT-5 Pro: —, Grok 4.6: 39.4 (#27)

Agentic & Tool Use benchmarks
BenchmarkGPT-5 ProGrok 4.6
APEX-Agents—65.3%
GDP.pdf—17.2%
Vending-Bench 2—9,047

Reasoning Grok 4.6 leads

GPT-5 Pro: 38.9 (#62), Grok 4.6: 61.4 (#20)

Reasoning benchmarks
BenchmarkGPT-5 ProGrok 4.6
ARC-AGI-218.3%67.1%
SimpleBench61.6%75.9%
ARC-AGI-170.2%87.5%
Epoch Capabilities Index150.28156.44
Kagi LLM Benchmark76.8%—
NYT Connections (extended)—80%
CritPt—19.7%
Chess Puzzles—40%
EnigmaEval18.8%—
EBR-Bench—30.5%
LMArena Hard Prompts—1447
Mystery Game Puzzles—34%
DTBench—97.3%
LMCA—48.5%

Math Grok 4.6 leads

GPT-5 Pro: 48.5 (#63), Grok 4.6: 67.0 (#24)

Math benchmarks
BenchmarkGPT-5 ProGrok 4.6
FrontierMath (Tiers 1-3)55.8%66%
FrontierMath Tier 419.5%31.7%
OTIS Mock AIME 2024-2025—99.2%
ProofBench—51%
LMArena Math—1423
FrontierMath Tier 4 (v1)14.6%—

Knowledge Grok 4.6 leads

GPT-5 Pro: 56.7 (#42), Grok 4.6: 63.3 (#20)

Knowledge benchmarks
BenchmarkGPT-5 ProGrok 4.6
GPQA Diamond—94%
Humanity's Last Exam31.6%—
SimpleQA Verified—49.3%
LMArena Expert—1467

Multimodal Not comparable

GPT-5 Pro: —, Grok 4.6: 43.6 (#23)

Multimodal benchmarks
BenchmarkGPT-5 ProGrok 4.6
LMArena Vision—1263
Blueprint-Bench 2—33.2%
Furniture Assembly—40%
LMArena Document—1452

Multilingual Not comparable

GPT-5 Pro: —, Grok 4.6: 53.0 (#74)

Multilingual benchmarks
BenchmarkGPT-5 ProGrok 4.6
LMArena Non-English—1420
LMArena Chinese—1480
LMArena French—1461
LMArena German—1431
LMArena Japanese—1376
LMArena Korean—1397
LMArena Russian—1422
LMArena Spanish—1404

Instruction Following Not comparable

GPT-5 Pro: —, Grok 4.6: 75.4 (#63)

Instruction Following benchmarks
BenchmarkGPT-5 ProGrok 4.6
LMArena Instruction Following—1431

Long Context Not comparable

GPT-5 Pro: —, Grok 4.6: 44.5 (#66)

Long Context benchmarks
BenchmarkGPT-5 ProGrok 4.6
LMArena Longer Query—1454

Writing & Preference Not comparable

GPT-5 Pro: —, Grok 4.6: 62.3 (#80)

Writing & Preference benchmarks
BenchmarkGPT-5 ProGrok 4.6
LMArena Text—1428
LMArena Creative Writing—1428
LMArena Multi-Turn—1425

Frequently asked questions

Is GPT-5 Pro better than Grok 4.6?

Grok 4.6 is the stronger model overall, scoring 56.9 to 46.4 on the Noometry Index.

Which is cheaper, GPT-5 Pro or Grok 4.6?

Grok 4.6 is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; GPT-5 Pro lists at $15 and $120.

Is GPT-5 Pro or Grok 4.6 better for coding?

Grok 4.6 scores higher on coding benchmarks: 58.5 versus 44.0 in the Noometry coding category.

Which has the bigger context window?

Grok 4.6 does, with 500K tokens against 400K.

How many benchmarks do GPT-5 Pro and Grok 4.6 share?

7 benchmarks have published results for both models. GPT-5 Pro has 12 scored results on Noometry and Grok 4.6 has 49.

Related comparisons

Go deeper