Noometry

Model comparison

GPT-5.1 vs Grok 4.7

GPT-5.1 is the stronger model overall, scoring 48.8 to 46.6 on the Noometry Index.

Last verified . 15 shared benchmarks.

GPT-5.1 OpenAI

48.8

Rank #47 Confirmed

Grok 4.7 xAI

46.6

Rank #56 Confirmed

Summary

  • They share 15 benchmarks with published results for both. GPT-5.1 scores higher in 6 categories and Grok 4.7 in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in multimodal, where GPT-5.1 leads 44.0 to 28.8.
  • The biggest single-benchmark swing is SciCode: 43.3% for GPT-5.1 and 57.4% for Grok 4.7.
  • Grok 4.7 is cheaper at $2 / $6 per million input/output tokens, against $1.25 / $10 for GPT-5.1.
  • Grok 4.7 accepts more context: 500K tokens versus 400K.

Side by side

GPT-5.1Grok 4.7
ProviderOpenAIxAI
Noometry Index48.846.6
Released2025-11-132026-09-21
WeightsProprietaryProprietary
Context window400K500K
Max output128K500K
Input $ / M tokens$1.25$2
Output $ / M tokens$10$6
Results tracked6321

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.7 leads

GPT-5.1: 46.9 (#59), Grok 4.7: 55.0 (#23)

BenchmarkGPT-5.1Grok 4.7
LMArena WebDev13951636
SciCode43.3%57.4%
LMArena Coding14541423
SWE-bench Verified68%—
SWE-bench Verified (bash only)66%—
CursorBench—46.3%
FrontierSWE—29.5%
GSO13.7%—
WeirdML60.8%—
LiveBench Coding72.5%—
ALE-Bench1,192—

Agentic & Tool Use Not comparable

GPT-5.1: 32.5 (#55), Grok 4.7: —

BenchmarkGPT-5.1Grok 4.7
Terminal-Bench47.6%—
DeepResearch Bench42.8%—
LMArena Search1199—
Vending-Bench 21,473—

Reasoning Too close to call

GPT-5.1: 39.9 (#50), Grok 4.7: 40.1 (#49)

BenchmarkGPT-5.1Grok 4.7
CritPt4.9%17.7%
LMArena Hard Prompts14571409
ARC-AGI-217.6%—
SimpleBench53.2%—
NYT Connections (extended)—76.8%
ARC-AGI-172.8%—
Chess Puzzles32%—
EnigmaEval11.2%—
LiveBench Reasoning95.8%—
Mystery Game Puzzles19%—
DTBench90.1%—
LiveBench Data Analysis72.1%—
LMCA43.9%—
Epoch Capabilities Index149.66—
ForecastBench58.1—
LiveBench78.8%—

Math GPT-5.1 leads

GPT-5.1: 50.3 (#45), Grok 4.7: 41.1 (#73)

BenchmarkGPT-5.1Grok 4.7
LMArena Math14461393
OTIS Mock AIME 2024-202588.6%—
ProofBench—34%
Omni-MATH46.4%—
LiveBench Math94.5%—
FrontierMath (Feb 2025 set)31%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge GPT-5.1 leads

GPT-5.1: 50.5 (#65), Grok 4.7: 38.7 (#130)

BenchmarkGPT-5.1Grok 4.7
LMArena Expert14701413
GPQA Diamond87.6%—
Humanity's Last Exam23.7%—
SimpleQA Verified48%—
MMLU-Pro57.9%—
Vectara Hallucination Rate10.9%—
GPQA (HELM)44.2%—

Multimodal GPT-5.1 leads

GPT-5.1: 44.0 (#17), Grok 4.7: 28.8 (#107)

BenchmarkGPT-5.1Grok 4.7
LMArena Vision1250—
VPCT58.7%—
Furniture Assembly—20.8%
LMArena Document1403—

Multilingual GPT-5.1 leads

GPT-5.1: 54.0 (#51), Grok 4.7: 51.2 (#108)

BenchmarkGPT-5.1Grok 4.7
LMArena Non-English14311392
LMArena Chinese14951476
LMArena Russian14351396
LMArena French1451—
LMArena German1439—
LMArena Japanese1453—
LMArena Korean1401—
LMArena Spanish1430—

Instruction Following GPT-5.1 leads

GPT-5.1: 84.0 (#1), Grok 4.7: 74.3 (#98)

BenchmarkGPT-5.1Grok 4.7
LMArena Instruction Following14421406
LiveBench Instruction Following93.3%—
IFEval93.5%—

Long Context GPT-5.1 leads

GPT-5.1: 47.6 (#14), Grok 4.7: 43.2 (#97)

BenchmarkGPT-5.1Grok 4.7
LMArena Longer Query14481416
CL-bench23.7%—
CL-bench Life17.3%—

Writing & Preference Grok 4.7 leads

GPT-5.1: 64.7 (#53), Grok 4.7: 70.1 (#23)

BenchmarkGPT-5.1Grok 4.7
LMArena Text14431397
LMArena Creative Writing14271391
LMArena Multi-Turn14491389
EQ-Bench Creative Writing—2007
WildBench86.3%—
LiveBench Language80.2%—

Frequently asked questions

Is GPT-5.1 better than Grok 4.7?

GPT-5.1 is the stronger model overall, scoring 48.8 to 46.6 on the Noometry Index.

Which is cheaper, GPT-5.1 or Grok 4.7?

Grok 4.7 is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; GPT-5.1 lists at $1.25 and $10.

Is GPT-5.1 or Grok 4.7 better for coding?

Grok 4.7 scores higher on coding benchmarks: 55.0 versus 46.9 in the Noometry coding category.

Which has the bigger context window?

Grok 4.7 does, with 500K tokens against 400K.

How many benchmarks do GPT-5.1 and Grok 4.7 share?

15 benchmarks have published results for both models. GPT-5.1 has 63 scored results on Noometry and Grok 4.7 has 21.

Related comparisons

Go deeper