Model comparison

Claude Opus 4.5 vs Grok 4 Heavy

Claude Opus 4.5 has enough public results to be ranked (#47); Grok 4 Heavy does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Claude Opus 4.5 Anthropic

50.5

Rank #47 Confirmed

Grok 4 Heavy xAI

—

Unranked

Summary

  • They share 1 benchmark with published results for both.

Side by side

Claude Opus 4.5 and Grok 4 Heavy specifications
Claude Opus 4.5Grok 4 Heavy
ProviderAnthropicxAI
Noometry Index50.5—
Released2025-11-012025-07-10
WeightsProprietaryProprietary
Context window200K—
Max output64K—
Input $ / M tokens$5—
Output $ / M tokens$25—
Results tracked691

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Opus 4.5: 54.8 (#27), Grok 4 Heavy: —

Coding benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
SWE-bench Verified76.7%—
SWE-bench Verified (bash only)76.8%—
LMArena WebDev1494—
SWE-bench Multilingual70.7%—
GSO26.5%—
WeirdML63.7%—
LMArena Coding1504—
ALE-Bench1,025—
AlgoTune1.77—

Agentic & Tool Use Not comparable

Claude Opus 4.5: 47.3 (#12), Grok 4 Heavy: —

Agentic & Tool Use benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
Terminal-Bench63.1%—
Berkeley Function Calling Leaderboard77.5%—
GDPval45.5%—
Remote Labor Index3.8%—
τ²-bench Airline84%—
τ²-bench Banking24.7%—
τ²-bench Retail79.6%—
τ²-bench Telecom92.3%—
Cybench82%—
DeepResearch Bench54.8%—
OSWorld66.3%—
BALROG43.5%—
LMArena Search1180—
METR Time Horizons75%—
Vending-Bench 24,967—

Reasoning Not comparable

Claude Opus 4.5: 42.6 (#51), Grok 4 Heavy: —

Reasoning benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
ARC-AGI-237.6%—
SimpleBench62%—
Kagi LLM Benchmark80.2%—
NYT Connections (extended)52.5%—
ARC-AGI-180%—
Chess Puzzles12%—
EnigmaEval11.9%—
EBR-Bench14.3%—
LMArena Hard Prompts1476—
Mystery Game Puzzles22%—
DTBench89.9%—
LMCA44.5%—
Epoch Capabilities Index150.09—
ForecastBench60.7—

Math Not comparable

Claude Opus 4.5: 38.6 (#132), Grok 4 Heavy: —

Math benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
FrontierMath Tier 4 (v1)4.2%2.1%
FrontierMath (Tiers 1-3)34.4%—
FrontierMath Tier 44.9%—
OTIS Mock AIME 2024-202586.1%—
ProofBench36%—
LMArena Math1463—
FrontierMath (Feb 2025 set)20.7%—

Knowledge Not comparable

Claude Opus 4.5: 56.5 (#44), Grok 4 Heavy: —

Knowledge benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
GPQA Diamond86%—
Humanity's Last Exam25.2%—
SimpleQA Verified45.7%—
Vectara Hallucination Rate10.9%—
LMArena Expert1487—

Multimodal Not comparable

Claude Opus 4.5: 31.4 (#107), Grok 4 Heavy: —

Multimodal benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
GeoBench75%—
VPCT40%—
Furniture Assembly28.3%—
LMArena Document1462—

Multilingual Not comparable

Claude Opus 4.5: 54.3 (#47), Grok 4 Heavy: —

Multilingual benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
LMArena Non-English1438—
LMArena Chinese1470—
LMArena French1471—
LMArena German1449—
LMArena Japanese1416—
LMArena Korean1424—
LMArena Russian1447—
LMArena Spanish1458—

Instruction Following Not comparable

Claude Opus 4.5: 77.5 (#19), Grok 4 Heavy: —

Instruction Following benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
LMArena Instruction Following1478—

Long Context Not comparable

Claude Opus 4.5: 46.5 (#22), Grok 4 Heavy: —

Long Context benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
CL-bench21.1%—
LMArena Longer Query1480—

Writing & Preference Not comparable

Claude Opus 4.5: 68.1 (#28), Grok 4 Heavy: —

Writing & Preference benchmarks
BenchmarkClaude Opus 4.5Grok 4 Heavy
LMArena Text1451—
LMArena Creative Writing1445—
EQ-Bench Creative Writing1687—
LMArena Multi-Turn1466—

Frequently asked questions

Is Claude Opus 4.5 better than Grok 4 Heavy?

Claude Opus 4.5 has enough public results to be ranked (#47); Grok 4 Heavy does not yet, so treat this comparison as directional.

How many benchmarks do Claude Opus 4.5 and Grok 4 Heavy share?

1 benchmark has published results for both models. Claude Opus 4.5 has 69 scored results on Noometry and Grok 4 Heavy has 1.

Related comparisons

Go deeper