Model comparison

Claude 3 Opus vs Grok 4.6

Grok 4.6 is the stronger model overall, scoring 56.9 to 29.5 on the Noometry Index.

Last verified . 27 shared benchmarks.

Claude 3 Opus Anthropic

29.5

Rank #310 Confirmed

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Claude 3 Opus scores higher in 0 categories and Grok 4.6 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.6 leads 67.0 to 14.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.7% for Claude 3 Opus and 99.2% for Grok 4.6.

Side by side

Claude 3 Opus and Grok 4.6 specifications
Claude 3 OpusGrok 4.6
ProviderAnthropicxAI
Noometry Index29.556.9
Released2024-02-292026-08-12
WeightsProprietaryProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked4649

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.6 leads

Claude 3 Opus: 32.9 (#267), Grok 4.6: 58.5 (#16)

Coding benchmarks
BenchmarkClaude 3 OpusGrok 4.6
WeirdML19.2%67.3%
LMArena Coding12641465
DeepSWE—67.5%
FrontierCode—48%
CursorBench—41.4%
LMArena WebDev—1617
FrontierSWE—25.3%
SciCode—56.5%
BigCodeBench Instruct45.5%—
LiveBench Coding38.6%—
BigCodeBench Complete57.4%—
ALE-Bench—1,508
HumanEval+77.4%—
MBPP+73.3%—

Agentic & Tool Use Grok 4.6 leads

Claude 3 Opus: 24.6 (#116), Grok 4.6: 39.4 (#27)

Agentic & Tool Use benchmarks
BenchmarkClaude 3 OpusGrok 4.6
APEX-Agents—65.3%
Cybench10%—
GDP.pdf—17.2%
METR Time Horizons29.5%—
Vending-Bench 2—9,047

Reasoning Grok 4.6 leads

Claude 3 Opus: 14.6 (#324), Grok 4.6: 61.4 (#20)

Reasoning benchmarks
BenchmarkClaude 3 OpusGrok 4.6
SimpleBench23.5%75.9%
Chess Puzzles5%40%
LMArena Hard Prompts12451447
DTBench61.6%97.3%
LMCA17%48.5%
Epoch Capabilities Index126.91156.44
ARC-AGI-2—67.1%
NYT Connections (extended)—80%
ARC-AGI-1—87.5%
CritPt—19.7%
EnigmaEval0.8%—
EBR-Bench—30.5%
LiveBench Reasoning40.6%—
Mystery Game Puzzles—34%
LiveBench Data Analysis57.9%—
ForecastBench58.4—
LiveBench49.2%—
WinoGrande88.5%—

Math Grok 4.6 leads

Claude 3 Opus: 14.8 (#299), Grok 4.6: 67.0 (#24)

Math benchmarks
BenchmarkClaude 3 OpusGrok 4.6
OTIS Mock AIME 2024-20254.7%99.2%
LMArena Math12731423
FrontierMath (Tiers 1-3)—66%
FrontierMath Tier 4—31.7%
ProofBench—51%
LiveBench Math43.6%—
MATH Level 537.5%—

Knowledge Grok 4.6 leads

Claude 3 Opus: 24.5 (#267), Grok 4.6: 63.3 (#20)

Knowledge benchmarks
BenchmarkClaude 3 OpusGrok 4.6
GPQA Diamond47.2%94%
SimpleQA Verified12.6%49.3%
LMArena Expert12231467
Confabulations22.7%—
MMLU84.6%—

Multimodal Grok 4.6 leads

Claude 3 Opus: 27.1 (#116), Grok 4.6: 43.6 (#23)

Multimodal benchmarks
BenchmarkClaude 3 OpusGrok 4.6
LMArena Vision10231263
Blueprint-Bench 2—33.2%
Furniture Assembly—40%
LMArena Document—1452

Multilingual Grok 4.6 leads

Claude 3 Opus: 41.4 (#207), Grok 4.6: 53.0 (#74)

Multilingual benchmarks
BenchmarkClaude 3 OpusGrok 4.6
LMArena Non-English12581420
LMArena Chinese12481480
LMArena French12751461
LMArena German12581431
LMArena Japanese12041376
LMArena Korean11871397
LMArena Russian12801422
LMArena Spanish12461404

Instruction Following Grok 4.6 leads

Claude 3 Opus: 64.1 (#228), Grok 4.6: 75.4 (#63)

Instruction Following benchmarks
BenchmarkClaude 3 OpusGrok 4.6
LMArena Instruction Following12481431
LiveBench Instruction Following63.9%—

Long Context Grok 4.6 leads

Claude 3 Opus: 38.2 (#202), Grok 4.6: 44.5 (#66)

Long Context benchmarks
BenchmarkClaude 3 OpusGrok 4.6
LMArena Longer Query12591454

Writing & Preference Grok 4.6 leads

Claude 3 Opus: 47.2 (#213), Grok 4.6: 62.3 (#80)

Writing & Preference benchmarks
BenchmarkClaude 3 OpusGrok 4.6
LMArena Text12621428
LMArena Creative Writing12351428
LMArena Multi-Turn12751425
LiveBench Language50.4%—

Frequently asked questions

Is Claude 3 Opus better than Grok 4.6?

Grok 4.6 is the stronger model overall, scoring 56.9 to 29.5 on the Noometry Index.

Is Claude 3 Opus or Grok 4.6 better for coding?

Grok 4.6 scores higher on coding benchmarks: 58.5 versus 32.9 in the Noometry coding category.

How many benchmarks do Claude 3 Opus and Grok 4.6 share?

27 benchmarks have published results for both models. Claude 3 Opus has 46 scored results on Noometry and Grok 4.6 has 49.

Related comparisons

Go deeper