Noometry

Model comparison

GPT-5.1 vs Qwen3 Max

GPT-5.1 is the stronger model overall, scoring 48.8 to 43.5 on the Noometry Index.

Last verified . 28 shared benchmarks.

GPT-5.1 OpenAI

48.8

Rank #47 Confirmed

Qwen3 Max Alibaba (Qwen)

43.5

Rank #82 Confirmed

Summary

  • They share 28 benchmarks with published results for both. GPT-5.1 scores higher in 8 categories and Qwen3 Max in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.1 leads 39.9 to 22.0.
  • The biggest single-benchmark swing is Chess Puzzles: 32% for GPT-5.1 and 4% for Qwen3 Max.
  • Qwen3 Max is cheaper at $1.20 / $6 per million input/output tokens, against $1.25 / $10 for GPT-5.1.
  • GPT-5.1 accepts more context: 400K tokens versus 262K.

Side by side

GPT-5.1Qwen3 Max
ProviderOpenAIAlibaba (Qwen)
Noometry Index48.843.5
Released2025-11-132025-09-23
WeightsProprietaryProprietary
Context window400K262K
Max output128K66K
Input $ / M tokens$1.25$1.20
Output $ / M tokens$10$6
Results tracked6333

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1 leads

GPT-5.1: 46.9 (#59), Qwen3 Max: 42.4 (#93)

BenchmarkGPT-5.1Qwen3 Max
LMArena Coding14541456
ALE-Bench1,192370.45
SWE-bench Verified68%—
SWE-bench Verified (bash only)66%—
LMArena WebDev1395—
SciCode43.3%—
GSO13.7%—
WeirdML60.8%—
LiveBench Coding72.5%—

Agentic & Tool Use Not comparable

GPT-5.1: 32.5 (#55), Qwen3 Max: —

BenchmarkGPT-5.1Qwen3 Max
Vending-Bench 21,47371.56
Terminal-Bench47.6%—
DeepResearch Bench42.8%—
LMArena Search1199—

Reasoning GPT-5.1 leads

GPT-5.1: 39.9 (#50), Qwen3 Max: 22.0 (#186)

BenchmarkGPT-5.1Qwen3 Max
Chess Puzzles32%4%
LMArena Hard Prompts14571448
Mystery Game Puzzles19%5%
DTBench90.1%82.1%
LMCA43.9%28.3%
Epoch Capabilities Index149.66142.41
ARC-AGI-217.6%—
SimpleBench53.2%—
Kagi LLM Benchmark—72.5%
NYT Connections (extended)—30.1%
ARC-AGI-172.8%—
CritPt4.9%—
EnigmaEval11.2%—
LiveBench Reasoning95.8%—
LiveBench Data Analysis72.1%—
ForecastBench58.1—
LiveBench78.8%—

Math GPT-5.1 leads

GPT-5.1: 50.3 (#45), Qwen3 Max: 37.6 (#94)

BenchmarkGPT-5.1Qwen3 Max
OTIS Mock AIME 2024-202588.6%73.3%
LMArena Math14461447
FrontierMath (Tiers 1-3)—18.9%
Omni-MATH46.4%—
LiveBench Math94.5%—
MATH Level 5—97.1%
FrontierMath (Feb 2025 set)31%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge GPT-5.1 leads

GPT-5.1: 50.5 (#65), Qwen3 Max: 48.1 (#72)

BenchmarkGPT-5.1Qwen3 Max
GPQA Diamond87.6%72.6%
SimpleQA Verified48%48.7%
LMArena Expert14701457
Humanity's Last Exam23.7%—
MMLU-Pro57.9%—
Vectara Hallucination Rate10.9%—
GPQA (HELM)44.2%—

Multimodal Not comparable

GPT-5.1: 44.0 (#17), Qwen3 Max: —

BenchmarkGPT-5.1Qwen3 Max
LMArena Vision1250—
VPCT58.7%—
LMArena Document1403—

Multilingual Too close to call

GPT-5.1: 54.0 (#51), Qwen3 Max: 53.9 (#58)

BenchmarkGPT-5.1Qwen3 Max
LMArena Non-English14311429
LMArena Chinese14951479
LMArena French14511450
LMArena German14391463
LMArena Japanese14531399
LMArena Korean14011397
LMArena Russian14351428
LMArena Spanish14301463

Instruction Following GPT-5.1 leads

GPT-5.1: 84.0 (#1), Qwen3 Max: 75.0 (#81)

BenchmarkGPT-5.1Qwen3 Max
LMArena Instruction Following14421420
LiveBench Instruction Following93.3%—
IFEval93.5%—

Long Context GPT-5.1 leads

GPT-5.1: 47.6 (#14), Qwen3 Max: 41.6 (#129)

BenchmarkGPT-5.1Qwen3 Max
CL-bench23.7%14.5%
LMArena Longer Query14481439
Fiction.LiveBench—66.7%
CL-bench Life17.3%—

Writing & Preference GPT-5.1 leads

GPT-5.1: 64.7 (#53), Qwen3 Max: 62.6 (#72)

BenchmarkGPT-5.1Qwen3 Max
LMArena Text14431439
LMArena Creative Writing14271401
LMArena Multi-Turn14491446
WildBench86.3%—
LiveBench Language80.2%—

Frequently asked questions

Is GPT-5.1 better than Qwen3 Max?

GPT-5.1 is the stronger model overall, scoring 48.8 to 43.5 on the Noometry Index.

Which is cheaper, GPT-5.1 or Qwen3 Max?

Qwen3 Max is cheaper. It lists at $1.20 per million input tokens and $6 per million output tokens; GPT-5.1 lists at $1.25 and $10.

Is GPT-5.1 or Qwen3 Max better for coding?

GPT-5.1 scores higher on coding benchmarks: 46.9 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

GPT-5.1 does, with 400K tokens against 262K.

How many benchmarks do GPT-5.1 and Qwen3 Max share?

28 benchmarks have published results for both models. GPT-5.1 has 63 scored results on Noometry and Qwen3 Max has 33.

Related comparisons

Go deeper