Noometry

Model comparison

Claude Opus 4 vs Grok-3 mini

Claude Opus 4 is the stronger model overall, scoring 43.1 to 41.2 on the Noometry Index.

Last verified . 35 shared benchmarks.

Claude Opus 4 Anthropic

43.1

Rank #100 Confirmed

Grok-3 mini xAI

41.2

Rank #141 Confirmed

Summary

  • They share 35 benchmarks with published results for both. Claude Opus 4 scores higher in 4 categories and Grok-3 mini in 4 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Opus 4 leads 27.3 to 13.6.
  • The biggest single-benchmark swing is Omni-MATH: 61.6% for Claude Opus 4 and 31.8% for Grok-3 mini.

Side by side

Claude Opus 4Grok-3 mini
ProviderAnthropicxAI
Noometry Index43.141.2
Released2025-05-222025-04-09
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked5635

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4 leads

Claude Opus 4: 47.2 (#62), Grok-3 mini: 40.8 (#131)

BenchmarkClaude Opus 4Grok-3 mini
Aider Polyglot72%49.3%
WeirdML43.7%42.6%
LMArena Coding14421379
SWE-bench Verified70.7%—
SWE-bench Verified (bash only)67.6%—
GSO6.9%—
AlgoTune1.33—

Agentic & Tool Use Not comparable

Claude Opus 4: 34.8 (#42), Grok-3 mini: —

BenchmarkClaude Opus 4Grok-3 mini
Cybench38%—
DeepResearch Bench46.8%—
LMArena Search1127—
METR Time Horizons63.9%—

Reasoning Claude Opus 4 leads

Claude Opus 4: 27.3 (#121), Grok-3 mini: 13.6 (#334)

BenchmarkClaude Opus 4Grok-3 mini
ARC-AGI-28.6%0.4%
Kagi LLM Benchmark74.3%61.3%
ARC-AGI-135.7%16.5%
LMArena Hard Prompts13991375
Epoch Capabilities Index142.67140.35
SimpleBench58.8%—
CritPt0.3%—
EnigmaEval5.6%—
DTBench81.6%—
LMCA37.4%—
ForecastBench61.1—

Math Too close to call

Claude Opus 4: 42.0 (#86), Grok-3 mini: 42.1 (#85)

BenchmarkClaude Opus 4Grok-3 mini
OTIS Mock AIME 2024-202564.4%77.8%
Omni-MATH61.6%31.8%
LMArena Math13901386
MATH Level 585%90.9%
FrontierMath (Feb 2025 set)4.5%5.9%
FrontierMath Tier 4 (v1)4.2%—

Knowledge Grok-3 mini leads

Claude Opus 4: 44.0 (#88), Grok-3 mini: 46.4 (#81)

BenchmarkClaude Opus 4Grok-3 mini
GPQA Diamond76.3%76.3%
MMLU-Pro87.5%79.9%
Confabulations15.9%10.8%
GPQA (HELM)70.8%67.5%
LMArena Expert13861395
Humanity's Last Exam10.7%—
Vectara Hallucination Rate12%—

Multimodal Not comparable

Claude Opus 4: 31.5 (#106), Grok-3 mini: —

BenchmarkClaude Opus 4Grok-3 mini
LMArena Vision1192—
GeoBench49%—
VPCT38%—

Multilingual Too close to call

Claude Opus 4: 48.8 (#138), Grok-3 mini: 48.1 (#145)

BenchmarkClaude Opus 4Grok-3 mini
LMArena Non-English13621352
LMArena Chinese13861387
LMArena French13721357
LMArena German13911349
LMArena Japanese13311342
LMArena Korean13211335
LMArena Russian13921353
LMArena Spanish13891381

Instruction Following Grok-3 mini leads

Claude Opus 4: 77.1 (#28), Grok-3 mini: 78.5 (#9)

BenchmarkClaude Opus 4Grok-3 mini
IFEval91.8%95.1%
LMArena Instruction Following14061357

Long Context Grok-3 mini leads

Claude Opus 4: 39.6 (#172), Grok-3 mini: 41.0 (#147)

BenchmarkClaude Opus 4Grok-3 mini
Fiction.LiveBench61.1%66.7%
LMArena Longer Query14221372

Writing & Preference Claude Opus 4 leads

Claude Opus 4: 61.2 (#89), Grok-3 mini: 52.5 (#169)

BenchmarkClaude Opus 4Grok-3 mini
LMArena Text13771370
LMArena Creative Writing13871342
Short-Story Creative Writing83.6%73.5%
WildBench85.2%65.1%
LMArena Multi-Turn13961355
EQ-Bench Creative Writing1580—

Frequently asked questions

Is Claude Opus 4 better than Grok-3 mini?

Claude Opus 4 is the stronger model overall, scoring 43.1 to 41.2 on the Noometry Index.

Is Claude Opus 4 or Grok-3 mini better for coding?

Claude Opus 4 scores higher on coding benchmarks: 47.2 versus 40.8 in the Noometry coding category.

How many benchmarks do Claude Opus 4 and Grok-3 mini share?

35 benchmarks have published results for both models. Claude Opus 4 has 56 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper