Model comparison

Claude 2.1 vs Grok 4.6

Grok 4.6 is the stronger model overall, scoring 56.9 to 25.2 on the Noometry Index.

Last verified . 5 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and Grok 4.6 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.6 leads 67.0 to 10.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.9% for Claude 2.1 and 99.2% for Grok 4.6.

Side by side

Claude 2.1 and Grok 4.6 specifications
Claude 2.1Grok 4.6
ProviderAnthropicxAI
Noometry Index25.256.9
Released2023-11-212026-08-12
WeightsProprietaryProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked749

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.6 leads

Claude 2.1: 26.2 (#327), Grok 4.6: 58.5 (#16)

Coding benchmarks
BenchmarkClaude 2.1Grok 4.6
WeirdML7.1%67.3%
DeepSWE—67.5%
FrontierCode—48%
CursorBench—41.4%
LMArena WebDev—1617
FrontierSWE—25.3%
SciCode—56.5%
LMArena Coding—1465
ALE-Bench—1,508

Agentic & Tool Use Not comparable

Claude 2.1: —, Grok 4.6: 39.4 (#27)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Grok 4.6
APEX-Agents—65.3%
GDP.pdf—17.2%
Vending-Bench 2—9,047

Reasoning Grok 4.6 leads

Claude 2.1: 21.4 (#221), Grok 4.6: 61.4 (#20)

Reasoning benchmarks
BenchmarkClaude 2.1Grok 4.6
DTBench51%97.3%
Epoch Capabilities Index119.27156.44
ARC-AGI-2—67.1%
SimpleBench—75.9%
NYT Connections (extended)—80%
ARC-AGI-1—87.5%
CritPt—19.7%
Chess Puzzles—40%
EBR-Bench—30.5%
LMArena Hard Prompts—1447
Mystery Game Puzzles—34%
LMCA—48.5%
ForecastBench54.2—

Math Grok 4.6 leads

Claude 2.1: 10.2 (#315), Grok 4.6: 67.0 (#24)

Math benchmarks
BenchmarkClaude 2.1Grok 4.6
OTIS Mock AIME 2024-20251.9%99.2%
FrontierMath (Tiers 1-3)—66%
FrontierMath Tier 4—31.7%
ProofBench—51%
LMArena Math—1423

Knowledge Grok 4.6 leads

Claude 2.1: 15.4 (#292), Grok 4.6: 63.3 (#20)

Knowledge benchmarks
BenchmarkClaude 2.1Grok 4.6
GPQA Diamond33%94%
SimpleQA Verified—49.3%
LMArena Expert—1467
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, Grok 4.6: 43.6 (#23)

Multimodal benchmarks
BenchmarkClaude 2.1Grok 4.6
LMArena Vision—1263
Blueprint-Bench 2—33.2%
Furniture Assembly—40%
LMArena Document—1452

Multilingual Not comparable

Claude 2.1: —, Grok 4.6: 53.0 (#74)

Multilingual benchmarks
BenchmarkClaude 2.1Grok 4.6
LMArena Non-English—1420
LMArena Chinese—1480
LMArena French—1461
LMArena German—1431
LMArena Japanese—1376
LMArena Korean—1397
LMArena Russian—1422
LMArena Spanish—1404

Instruction Following Not comparable

Claude 2.1: —, Grok 4.6: 75.4 (#63)

Instruction Following benchmarks
BenchmarkClaude 2.1Grok 4.6
LMArena Instruction Following—1431

Long Context Not comparable

Claude 2.1: —, Grok 4.6: 44.5 (#66)

Long Context benchmarks
BenchmarkClaude 2.1Grok 4.6
LMArena Longer Query—1454

Writing & Preference Not comparable

Claude 2.1: —, Grok 4.6: 62.3 (#80)

Writing & Preference benchmarks
BenchmarkClaude 2.1Grok 4.6
LMArena Text—1428
LMArena Creative Writing—1428
LMArena Multi-Turn—1425

Frequently asked questions

Is Claude 2.1 better than Grok 4.6?

Grok 4.6 is the stronger model overall, scoring 56.9 to 25.2 on the Noometry Index.

Is Claude 2.1 or Grok 4.6 better for coding?

Grok 4.6 scores higher on coding benchmarks: 58.5 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Grok 4.6 share?

5 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Grok 4.6 has 49.

Related comparisons

Go deeper