Noometry

Model comparison

Claude Opus 4.1 vs Qwen2.5-Max

Claude Opus 4.1 and Qwen2.5-Max score almost the same on the Noometry Index (41.0 vs 40.7), so choose on price, context window or the category you care about most.

Last verified . 20 shared benchmarks.

Claude Opus 4.1 Anthropic

41.0

Rank #142 Confirmed

Qwen2.5-Max Alibaba (Qwen)

40.7

Rank #146 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Claude Opus 4.1 scores higher in 7 categories and Qwen2.5-Max in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen2.5-Max leads 36.9 to 22.3.
  • The biggest single-benchmark swing is Short-Story Creative Writing: 84.7% for Claude Opus 4.1 and 72.9% for Qwen2.5-Max.

Side by side

Claude Opus 4.1Qwen2.5-Max
ProviderAnthropicAlibaba (Qwen)
Noometry Index41.040.7
Released2025-08-052025-01-25
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked4827

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Claude Opus 4.1: 44.4 (#73), Qwen2.5-Max: 41.8 (#117)

BenchmarkClaude Opus 4.1Qwen2.5-Max
LMArena Coding14791359
SWE-bench Verified73.3%—
LMArena WebDev1390—
WeirdML45.9%—
LiveBench Coding—64.4%
ALE-Bench674.77—
AlgoTune1.34—

Agentic & Tool Use Not comparable

Claude Opus 4.1: 35.0 (#41), Qwen2.5-Max: —

BenchmarkClaude Opus 4.1Qwen2.5-Max
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
LMArena Search1148—
METR Time Horizons66.8%—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 32.2 (#76), Qwen2.5-Max: 25.6 (#147)

BenchmarkClaude Opus 4.1Qwen2.5-Max
LMArena Hard Prompts14431360
Epoch Capabilities Index144.12132.53
SimpleBench60%—
Chess Puzzles7%—
EnigmaEval7.2%—
EBR-Bench7.9%—
LiveBench Reasoning—51.4%
Mystery Game Puzzles21%—
DTBench80%—
LiveBench Data Analysis—67.9%
LMCA37.1%—
ForecastBench62—
LiveBench—62.3%

Math Qwen2.5-Max leads

Claude Opus 4.1: 22.3 (#277), Qwen2.5-Max: 36.9 (#162)

BenchmarkClaude Opus 4.1Qwen2.5-Max
LMArena Math14311369
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
OTIS Mock AIME 2024-202568.9%—
LiveBench Math—58.4%
FrontierMath (Feb 2025 set)7.2%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Claude Opus 4.1 leads

Claude Opus 4.1: 42.0 (#101), Qwen2.5-Max: 35.3 (#186)

BenchmarkClaude Opus 4.1Qwen2.5-Max
Confabulations17.1%21.8%
LMArena Expert14391337
GPQA Diamond77.3%—
Humanity's Last Exam11.5%—
Vectara Hallucination Rate11.8%—

Multimodal Not comparable

Claude Opus 4.1: 26.8 (#119), Qwen2.5-Max: —

BenchmarkClaude Opus 4.1Qwen2.5-Max
VPCT35%—

Multilingual Claude Opus 4.1 leads

Claude Opus 4.1: 52.0 (#95), Qwen2.5-Max: 48.1 (#146)

BenchmarkClaude Opus 4.1Qwen2.5-Max
LMArena Non-English14051352
LMArena Chinese14271382
LMArena French14311396
LMArena German14131350
LMArena Japanese13781300
LMArena Korean13801304
LMArena Russian14221353
LMArena Spanish14481377

Instruction Following Claude Opus 4.1 leads

Claude Opus 4.1: 75.6 (#58), Qwen2.5-Max: 71.3 (#152)

BenchmarkClaude Opus 4.1Qwen2.5-Max
LMArena Instruction Following14351335
LiveBench Instruction Following—75.3%

Long Context Claude Opus 4.1 leads

Claude Opus 4.1: 44.5 (#63), Qwen2.5-Max: 41.4 (#142)

BenchmarkClaude Opus 4.1Qwen2.5-Max
LMArena Longer Query14551358

Writing & Preference Claude Opus 4.1 leads

Claude Opus 4.1: 62.4 (#74), Qwen2.5-Max: 55.4 (#146)

BenchmarkClaude Opus 4.1Qwen2.5-Max
LMArena Text14191367
LMArena Creative Writing14121339
Short-Story Creative Writing84.7%72.9%
LMArena Multi-Turn14441364
LiveBench Language—56.3%

Frequently asked questions

Is Claude Opus 4.1 better than Qwen2.5-Max?

Claude Opus 4.1 and Qwen2.5-Max score almost the same on the Noometry Index (41.0 vs 40.7), so choose on price, context window or the category you care about most.

Is Claude Opus 4.1 or Qwen2.5-Max better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.4 versus 41.8 in the Noometry coding category.

How many benchmarks do Claude Opus 4.1 and Qwen2.5-Max share?

20 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and Qwen2.5-Max has 27.

Related comparisons

Go deeper