Noometry

Model comparison

Claude Opus 5 vs Grok 3

Claude Opus 5 is the stronger model overall, scoring 67.8 to 39.9 on the Noometry Index.

Last verified . 26 shared benchmarks.

Claude Opus 5 Anthropic

67.8

Rank #4 Confirmed

Grok 3 xAI

39.9

Rank #157 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Claude Opus 5 scores higher in 9 categories and Grok 3 in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Opus 5 leads 77.2 to 13.7.
  • The biggest single-benchmark swing is ARC-AGI-1: 97.5% for Claude Opus 5 and 5.5% for Grok 3.

Side by side

Claude Opus 5Grok 3
ProviderAnthropicxAI
Noometry Index67.839.9
Released2026-07-242025-04-09
WeightsProprietaryProprietary
Context window1M—
Max output128K—
Input $ / M tokens$5—
Output $ / M tokens$25—
Results tracked5740

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 5 leads

Claude Opus 5: 67.5 (#5), Grok 3: 41.9 (#115)

BenchmarkClaude Opus 5Grok 3
WeirdML91.8%37.2%
LMArena Coding15341432
DeepSWE73.6%—
FrontierCode53.4%—
Aider Polyglot—53.3%
CursorBench46.6%—
LMArena WebDev1691—
FrontierSWE52%—
SciCode56.4%—
ALE-Bench2,165—

Agentic & Tool Use Claude Opus 5 leads

Claude Opus 5: 55.6 (#1), Grok 3: 30.5 (#76)

BenchmarkClaude Opus 5Grok 3
BALROG63.4%29.5%
APEX-Agents65.8%—
OSWorld 2.031.4%—
τ²-bench Banking48.7%—
PostTrainBench35%—
GBAEval79.6%—
GDP.pdf24%—
Vending-Bench 211,182—

Reasoning Claude Opus 5 leads

Claude Opus 5: 77.2 (#4), Grok 3: 13.7 (#333)

BenchmarkClaude Opus 5Grok 3
ARC-AGI-290.4%0%
SimpleBench80.6%36.1%
ARC-AGI-197.5%5.5%
LMArena Hard Prompts15261434
Epoch Capabilities Index162.78138.33
Kagi LLM Benchmark—61.3%
NYT Connections (extended)94.3%—
CritPt29.1%—
Chess Puzzles42%—
EBR-Bench45.7%—
Mystery Game Puzzles59%—
DTBench97.9%—
LMCA64.5%—
Bench to the Future 30.12—

Math Claude Opus 5 leads

Claude Opus 5: 86.2 (#8), Grok 3: 38.0 (#145)

BenchmarkClaude Opus 5Grok 3
OTIS Mock AIME 2024-202598.9%55.6%
LMArena Math15311391
FrontierMath (Tiers 1-3)85.6%—
FrontierMath Tier 473.2%—
ProofBench99%—
Omni-MATH—46.4%
MATH Level 5—88.7%
FrontierMath (Feb 2025 set)—3.8%
FrontierMath Tier 4 (v1)—0%

Knowledge Claude Opus 5 leads

Claude Opus 5: 66.8 (#9), Grok 3: 46.2 (#82)

BenchmarkClaude Opus 5Grok 3
GPQA Diamond93.9%75.8%
LMArena Expert15571421
SimpleQA Verified59.9%—
MMLU-Pro—78.8%
Confabulations—14.2%
Vectara Hallucination Rate—5.8%
GPQA (HELM)—65%

Multimodal Not comparable

Claude Opus 5: 50.8 (#8), Grok 3: —

BenchmarkClaude Opus 5Grok 3
LMArena Vision1319—
Blueprint-Bench 230.4%—
Furniture Assembly60.8%—
LMArena Document1516—

Multilingual Claude Opus 5 leads

Claude Opus 5: 58.8 (#4), Grok 3: 52.3 (#87)

BenchmarkClaude Opus 5Grok 3
LMArena Non-English15011410
LMArena Chinese15741448
LMArena French15191460
LMArena German15241431
LMArena Japanese15161387
LMArena Korean15211373
LMArena Russian15071416
LMArena Spanish15191417

Instruction Following Claude Opus 5 leads

Claude Opus 5: 79.2 (#7), Grok 3: 75.0 (#73)

BenchmarkClaude Opus 5Grok 3
LMArena Instruction Following15171409
IFEval—88.4%

Long Context Claude Opus 5 leads

Claude Opus 5: 46.5 (#21), Grok 3: 38.7 (#192)

BenchmarkClaude Opus 5Grok 3
LMArena Longer Query15151439
Fiction.LiveBench—58.3%

Writing & Preference Claude Opus 5 leads

Claude Opus 5: 79.2 (#1), Grok 3: 55.8 (#141)

BenchmarkClaude Opus 5Grok 3
LMArena Text15071426
LMArena Creative Writing14911414
EQ-Bench Creative Writing21331186
LMArena Multi-Turn14991425
Short-Story Creative Writing—76.4%
WildBench—84.9%
EQ-Bench 41385—

Frequently asked questions

Is Claude Opus 5 better than Grok 3?

Claude Opus 5 is the stronger model overall, scoring 67.8 to 39.9 on the Noometry Index.

Is Claude Opus 5 or Grok 3 better for coding?

Claude Opus 5 scores higher on coding benchmarks: 67.5 versus 41.9 in the Noometry coding category.

How many benchmarks do Claude Opus 5 and Grok 3 share?

26 benchmarks have published results for both models. Claude Opus 5 has 57 scored results on Noometry and Grok 3 has 40.

Related comparisons

Go deeper