Noometry

Model comparison

Claude Opus 4.1 vs Mercury

Claude Opus 4.1 is the stronger model overall, scoring 40.8 to 37.3 on the Noometry Index.

Last verified . 8 shared benchmarks.

Claude Opus 4.1 Anthropic

40.8

Rank #136 Confirmed

Mercury Inception

37.3

Rank #192 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Claude Opus 4.1 scores higher in 6 categories and Mercury in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Claude Opus 4.1 leads 62.6 to 46.2.

Side by side

Claude Opus 4.1Mercury
ProviderAnthropicInception
Noometry Index40.837.3
Released2025-08-05—
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked489

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Claude Opus 4.1: 44.3 (#69), Mercury: 38.1 (#164)

BenchmarkClaude Opus 4.1Mercury
LMArena Coding14791323
SWE-bench Verified73.3%—
LMArena WebDev1390—
WeirdML45.9%—
ALE-Bench674.77—
AlgoTune1.34—

Agentic & Tool Use Not comparable

Claude Opus 4.1: 34.8 (#38), Mercury: —

BenchmarkClaude Opus 4.1Mercury
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
LMArena Search1148—
METR Time Horizons66.8%—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 31.6 (#70), Mercury: 16.8 (#288)

BenchmarkClaude Opus 4.1Mercury
LMArena Hard Prompts14431284
SimpleBench60%—
Kagi LLM Benchmark—21.6%
Chess Puzzles7%—
EnigmaEval7.2%—
EBR-Bench7.9%—
Mystery Game Puzzles21%—
DTBench80%—
LMCA37.1%—
Epoch Capabilities Index144.11—
ForecastBench62—

Math Not comparable

Claude Opus 4.1: 22.0 (#267), Mercury: —

BenchmarkClaude Opus 4.1Mercury
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
OTIS Mock AIME 2024-202568.9%—
LMArena Math1430—
FrontierMath (Feb 2025 set)7.2%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Not comparable

Claude Opus 4.1: 41.9 (#93), Mercury: —

BenchmarkClaude Opus 4.1Mercury
GPQA Diamond77.3%—
Humanity's Last Exam11.5%—
Confabulations17.1%—
Vectara Hallucination Rate11.8%—
LMArena Expert1439—

Multimodal Not comparable

Claude Opus 4.1: 26.2 (#114), Mercury: —

BenchmarkClaude Opus 4.1Mercury
VPCT35%—

Multilingual Claude Opus 4.1 leads

Claude Opus 4.1: 52.1 (#90), Mercury: 41.7 (#201)

BenchmarkClaude Opus 4.1Mercury
LMArena Non-English14051259
LMArena Chinese1427—
LMArena French1432—
LMArena German1412—
LMArena Japanese1378—
LMArena Korean1381—
LMArena Russian1421—
LMArena Spanish1448—

Instruction Following Claude Opus 4.1 leads

Claude Opus 4.1: 75.8 (#53), Mercury: 65.3 (#220)

BenchmarkClaude Opus 4.1Mercury
LMArena Instruction Following14361238

Long Context Claude Opus 4.1 leads

Claude Opus 4.1: 44.5 (#60), Mercury: 38.3 (#193)

BenchmarkClaude Opus 4.1Mercury
LMArena Longer Query14551264

Writing & Preference Claude Opus 4.1 leads

Claude Opus 4.1: 62.6 (#70), Mercury: 46.2 (#216)

BenchmarkClaude Opus 4.1Mercury
LMArena Text14191282
LMArena Creative Writing14121186
LMArena Multi-Turn14441283
Short-Story Creative Writing84.7%—

Frequently asked questions

Is Claude Opus 4.1 better than Mercury?

Claude Opus 4.1 is the stronger model overall, scoring 40.8 to 37.3 on the Noometry Index.

Is Claude Opus 4.1 or Mercury better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.3 versus 38.1 in the Noometry coding category.

How many benchmarks do Claude Opus 4.1 and Mercury share?

8 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and Mercury has 9.

Related comparisons

Go deeper