Noometry

Model comparison

Claude Sonnet 4 vs Qwen3.8 Max

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 40.8 on the Noometry Index.

Last verified . 25 shared benchmarks.

Claude Sonnet 4 Anthropic

40.8

Rank #145 Confirmed

Qwen3.8 Max Alibaba (Qwen)

56.8

Rank #22 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Claude Sonnet 4 scores higher in 0 categories and Qwen3.8 Max in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.8 Max leads 54.4 to 22.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 71.1% for Claude Sonnet 4 and 100% for Qwen3.8 Max.
  • Qwen3.8 Max is cheaper at $2 / $6 per million input/output tokens, against $3 / $15 for Claude Sonnet 4.
  • Qwen3.8 Max accepts more context: 1M tokens versus 200K.

Side by side

Claude Sonnet 4Qwen3.8 Max
ProviderAnthropicAlibaba (Qwen)
Noometry Index40.856.8
Released2025-05-222026-08-02
WeightsProprietaryProprietary
Context window200K1M
Max output64K131K
Input $ / M tokens$3$2
Output $ / M tokens$15$6
Results tracked5839

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 Max leads

Claude Sonnet 4: 43.5 (#88), Qwen3.8 Max: 53.5 (#29)

BenchmarkClaude Sonnet 4Qwen3.8 Max
SciCode40%53.2%
LMArena Coding14141502
DeepSWE—57.5%
SWE-bench Verified (bash only)64.9%—
Aider Polyglot61.3%—
LMArena WebDev—1674
FrontierSWE—17.8%
GSO4.9%—
WeirdML46.1%—
ALE-Bench655.35—

Agentic & Tool Use Qwen3.8 Max leads

Claude Sonnet 4: 38.5 (#31), Qwen3.8 Max: 45.4 (#14)

BenchmarkClaude Sonnet 4Qwen3.8 Max
APEX-Agents—63.3%
TheAgentCompany33.1%—
τ²-bench Banking—55.1%
Cybench35%—
DeepResearch Bench46.6%—
OSWorld43.9%—
GDP.pdf—23.2%
METR Time Horizons62%—

Reasoning Qwen3.8 Max leads

Claude Sonnet 4: 22.9 (#187), Qwen3.8 Max: 54.4 (#26)

BenchmarkClaude Sonnet 4Qwen3.8 Max
CritPt0.3%20%
LMArena Hard Prompts13721496
DTBench77.1%92%
LMCA29%46.2%
Epoch Capabilities Index141.69156.41
ARC-AGI-25.9%—
SimpleBench45.5%—
Kagi LLM Benchmark73%—
NYT Connections (extended)—88.3%
ARC-AGI-140%—
Chess Puzzles—40%
EnigmaEval3.1%—
Mystery Game Puzzles—38%
ForecastBench60.2—

Math Qwen3.8 Max leads

Claude Sonnet 4: 43.3 (#80), Qwen3.8 Max: 73.2 (#20)

BenchmarkClaude Sonnet 4Qwen3.8 Max
OTIS Mock AIME 2024-202571.1%100%
LMArena Math13751499
FrontierMath (Tiers 1-3)—74.7%
FrontierMath Tier 4—46.3%
ProofBench—58%
Omni-MATH60.2%—
MATH Level 584.4%—
FrontierMath (Feb 2025 set)4.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Qwen3.8 Max leads

Claude Sonnet 4: 41.8 (#108), Qwen3.8 Max: 61.7 (#27)

BenchmarkClaude Sonnet 4Qwen3.8 Max
GPQA Diamond79.2%92.7%
LMArena Expert13721507
Humanity's Last Exam7.8%—
SimpleQA Verified—47.3%
MMLU-Pro84.3%—
Confabulations13.2%—
Vectara Hallucination Rate10.3%—
GPQA (HELM)70.6%—

Multimodal Qwen3.8 Max leads

Claude Sonnet 4: 26.2 (#121), Qwen3.8 Max: 37.2 (#75)

BenchmarkClaude Sonnet 4Qwen3.8 Max
LMArena Vision11911314
GeoBench37%—
VPCT34%—
Furniture Assembly—20%
MindCube44.8%—

Multilingual Qwen3.8 Max leads

Claude Sonnet 4: 46.7 (#156), Qwen3.8 Max: 56.7 (#18)

BenchmarkClaude Sonnet 4Qwen3.8 Max
LMArena Non-English13331472
LMArena Chinese13501538
LMArena French13631503
LMArena German13311483
LMArena Japanese13021467
LMArena Korean12911461
LMArena Russian13551481
LMArena Spanish13571492

Instruction Following Qwen3.8 Max leads

Claude Sonnet 4: 71.7 (#145), Qwen3.8 Max: 77.6 (#17)

BenchmarkClaude Sonnet 4Qwen3.8 Max
LMArena Instruction Following13761479
IFEval84%—

Long Context Qwen3.8 Max leads

Claude Sonnet 4: 33.7 (#259), Qwen3.8 Max: 45.6 (#31)

BenchmarkClaude Sonnet 4Qwen3.8 Max
LMArena Longer Query13981489
Fiction.LiveBench46.9%—

Writing & Preference Qwen3.8 Max leads

Claude Sonnet 4: 57.1 (#132), Qwen3.8 Max: 67.1 (#30)

BenchmarkClaude Sonnet 4Qwen3.8 Max
LMArena Text13511483
LMArena Creative Writing13451479
LMArena Multi-Turn13761489
Short-Story Creative Writing81.4%—
EQ-Bench Creative Writing1483—
WildBench83.8%—

Frequently asked questions

Is Claude Sonnet 4 better than Qwen3.8 Max?

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 40.8 on the Noometry Index.

Which is cheaper, Claude Sonnet 4 or Qwen3.8 Max?

Qwen3.8 Max is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; Claude Sonnet 4 lists at $3 and $15.

Is Claude Sonnet 4 or Qwen3.8 Max better for coding?

Qwen3.8 Max scores higher on coding benchmarks: 53.5 versus 43.5 in the Noometry coding category.

Which has the bigger context window?

Qwen3.8 Max does, with 1M tokens against 200K.

How many benchmarks do Claude Sonnet 4 and Qwen3.8 Max share?

25 benchmarks have published results for both models. Claude Sonnet 4 has 58 scored results on Noometry and Qwen3.8 Max has 39.

Related comparisons

Go deeper