Model comparison

GPT-5.2 vs Grok 4.20 (Non-Reasoning)

GPT-5.2 is the stronger model overall, scoring 54.1 to 48.6 on the Noometry Index. Grok 4.20 (Non-Reasoning) costs 3.1× less per token, which makes it the better buy when GPT-5.2's lead doesn't matter for your workload.

Last verified . 43 shared benchmarks.

GPT-5.2 OpenAI

54.1

Rank #34 Confirmed

Grok 4.20 (Non-Reasoning) xAI

48.6

Rank #54 Confirmed

Summary

  • They share 43 benchmarks with published results for both. GPT-5.2 scores higher in 6 categories and Grok 4.20 (Non-Reasoning) in 4 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in multimodal, where GPT-5.2 leads 51.3 to 33.3.
  • The biggest single-benchmark swing is Chess Puzzles: 49% for GPT-5.2 and 24% for Grok 4.20 (Non-Reasoning).
  • Grok 4.20 (Non-Reasoning) is cheaper at $1.25 / $2.50 per million input/output tokens, against $1.75 / $14 for GPT-5.2.
  • Grok 4.20 (Non-Reasoning) accepts more context: 1M tokens versus 400K.

Side by side

GPT-5.2 and Grok 4.20 (Non-Reasoning) specifications
GPT-5.2Grok 4.20 (Non-Reasoning)
ProviderOpenAIxAI
Noometry Index54.148.6
Released2025-12-112026-02-17
WeightsProprietaryProprietary
Context window400K1M
Max output128K30K
Input $ / M tokens$1.75$1.25
Output $ / M tokens$14$2.50
Results tracked6746

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 leads

GPT-5.2: 51.6 (#37), Grok 4.20 (Non-Reasoning): 42.1 (#112)

Coding benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
LMArena WebDev14161375
WeirdML72.2%52.3%
LMArena Coding14471459
ALE-Bench1,2941,150
SWE-bench Verified73.8%—
SWE-bench Verified (bash only)72.8%—
SWE-bench Multilingual66.7%—
GSO27.4%—
AlgoTune2.05—

Agentic & Tool Use GPT-5.2 leads

GPT-5.2: 40.2 (#24), Grok 4.20 (Non-Reasoning): 34.4 (#46)

Agentic & Tool Use benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
Terminal-Bench64.9%57.3%
τ²-bench Banking32.2%18%
LMArena Search12071189
Vending-Bench 23,5914,663
Berkeley Function Calling Leaderboard55.9%—
GDPval49.7%—
Remote Labor Index2.5%—
τ²-bench Airline83%—
τ²-bench Retail81.6%—
τ²-bench Telecom89.7%—
DeepResearch Bench41.1%—
METR Time Horizons75.3%—

Reasoning Grok 4.20 (Non-Reasoning) leads

GPT-5.2: 50.2 (#35), Grok 4.20 (Non-Reasoning): 52.3 (#32)

Reasoning benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
ARC-AGI-252.9%65.1%
Kagi LLM Benchmark73.3%75%
NYT Connections (extended)83.6%85.4%
ARC-AGI-186.2%89.5%
Chess Puzzles49%24%
LMArena Hard Prompts14451451
DTBench90.9%90.1%
LMCA43.9%38.7%
Epoch Capabilities Index153.45151.98
ForecastBench60.161.4
SimpleBench45.8%—
EnigmaEval10.4%—
Thematic Generalization—63.8%
EBR-Bench23%—
Mystery Game Puzzles23%—

Math GPT-5.2 leads

GPT-5.2: 60.0 (#38), Grok 4.20 (Non-Reasoning): 48.2 (#65)

Math benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
FrontierMath (Tiers 1-3)67.4%44.9%
FrontierMath Tier 431.7%17.1%
OTIS Mock AIME 2024-202596.1%92.2%
ProofBench15%14%
LMArena Math14401455
MathArena Final-Answer Competitions72%—
FrontierMath (Feb 2025 set)40.7%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge GPT-5.2 leads

GPT-5.2: 59.3 (#32), Grok 4.20 (Non-Reasoning): 52.8 (#60)

Knowledge benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
GPQA Diamond91.4%89.3%
SimpleQA Verified37.1%30.2%
LMArena Expert14451439
Humanity's Last Exam27.8%—
Vectara Hallucination Rate8.4%—

Multimodal GPT-5.2 leads

GPT-5.2: 51.3 (#7), Grok 4.20 (Non-Reasoning): 33.3 (#98)

Multimodal benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
LMArena Vision12681263
LMArena Document14051416
VPCT84%—
Blueprint-Bench 2—0%
Furniture Assembly38.3%—

Multilingual Grok 4.20 (Non-Reasoning) leads

GPT-5.2: 53.4 (#67), Grok 4.20 (Non-Reasoning): 54.5 (#40)

Multilingual benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
LMArena Non-English14251441
LMArena Chinese14601481
LMArena French14551476
LMArena German14481465
LMArena Japanese14201449
LMArena Korean13921417
LMArena Russian14401458
LMArena Spanish14331443

Instruction Following Too close to call

GPT-5.2: 74.7 (#89), Grok 4.20 (Non-Reasoning): 74.8 (#83)

Instruction Following benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
LMArena Instruction Following14171420

Long Context Grok 4.20 (Non-Reasoning) leads

GPT-5.2: 44.0 (#78), Grok 4.20 (Non-Reasoning): 45.5 (#34)

Long Context benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
CL-bench18.2%22.2%
LMArena Longer Query14281437
CL-bench Life—11.9%

Writing & Preference GPT-5.2 leads

GPT-5.2: 66.8 (#32), Grok 4.20 (Non-Reasoning): 65.7 (#44)

Writing & Preference benchmarks
BenchmarkGPT-5.2Grok 4.20 (Non-Reasoning)
LMArena Text14391451
LMArena Creative Writing14011438
EQ-Bench Creative Writing17031574
LMArena Multi-Turn14581456

Frequently asked questions

Is GPT-5.2 better than Grok 4.20 (Non-Reasoning)?

GPT-5.2 is the stronger model overall, scoring 54.1 to 48.6 on the Noometry Index. Grok 4.20 (Non-Reasoning) costs 3.1× less per token, which makes it the better buy when GPT-5.2's lead doesn't matter for your workload.

Which is cheaper, GPT-5.2 or Grok 4.20 (Non-Reasoning)?

Grok 4.20 (Non-Reasoning) is cheaper. It lists at $1.25 per million input tokens and $2.50 per million output tokens; GPT-5.2 lists at $1.75 and $14.

Is GPT-5.2 or Grok 4.20 (Non-Reasoning) better for coding?

GPT-5.2 scores higher on coding benchmarks: 51.6 versus 42.1 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 (Non-Reasoning) does, with 1M tokens against 400K.

How many benchmarks do GPT-5.2 and Grok 4.20 (Non-Reasoning) share?

43 benchmarks have published results for both models. GPT-5.2 has 67 scored results on Noometry and Grok 4.20 (Non-Reasoning) has 46.

Related comparisons

Go deeper