Noometry

Model comparison

GPT-4.1 mini vs Qwen Max

GPT-4.1 mini and Qwen Max score almost the same on the Noometry Index (33.5 vs 34.4), so choose on price, context window or the category you care about most.

Last verified . 23 shared benchmarks.

GPT-4.1 mini OpenAI

33.5

Rank #232 Confirmed

Qwen Max Alibaba (Qwen)

34.4

Rank #226 Confirmed

Summary

  • They share 23 benchmarks with published results for both. GPT-4.1 mini scores higher in 6 categories and Qwen Max in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen Max leads 24.1 to 10.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 44.7% for GPT-4.1 mini and 16.1% for Qwen Max.
  • GPT-4.1 mini is cheaper at $0.40 / $1.60 per million input/output tokens, against $1.60 / $6.40 for Qwen Max.
  • GPT-4.1 mini accepts more context: 1.05M tokens versus 33K.

Side by side

GPT-4.1 miniQwen Max
ProviderOpenAIAlibaba (Qwen)
Noometry Index33.534.4
Released2025-04-142024-04-03
WeightsProprietaryProprietary
Context window1.05M33K
Max output33K8K
Input $ / M tokens$0.40$1.60
Output $ / M tokens$1.60$6.40
Results tracked4723

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

GPT-4.1 mini: 30.4 (#286), Qwen Max: 30.3 (#288)

BenchmarkGPT-4.1 miniQwen Max
Aider Polyglot32.4%21.8%
LMArena Coding13671288
SWE-bench Verified (bash only)23.9%—
SciCode40.4%—
WeirdML37.6%—
BigCodeBench Instruct48.9%—
CadEval16%—

Agentic & Tool Use Not comparable

GPT-4.1 mini: 33.0 (#52), Qwen Max: —

BenchmarkGPT-4.1 miniQwen Max
Berkeley Function Calling Leaderboard50.5%—

Reasoning Qwen Max leads

GPT-4.1 mini: 10.9 (#335), Qwen Max: 24.1 (#154)

BenchmarkGPT-4.1 miniQwen Max
LMArena Hard Prompts13491270
ARC-AGI-20%—
Kagi LLM Benchmark48.6%—
ARC-AGI-13.5%—
CritPt0%—
Chess Puzzles7%—
Mystery Game Puzzles7%—
DTBench68.8%—
LMCA21.1%—
Epoch Capabilities Index135.01—

Math GPT-4.1 mini leads

GPT-4.1 mini: 23.1 (#264), Qwen Max: 21.0 (#272)

BenchmarkGPT-4.1 miniQwen Max
OTIS Mock AIME 2024-202544.7%16.1%
LMArena Math13431275
MATH Level 587.3%67.2%
FrontierMath (Feb 2025 set)4.5%1%
FrontierMath (Tiers 1-3)6.7%—
Omni-MATH49.1%—

Knowledge GPT-4.1 mini leads

GPT-4.1 mini: 34.7 (#183), Qwen Max: 30.3 (#222)

BenchmarkGPT-4.1 miniQwen Max
GPQA Diamond65.8%56.1%
LMArena Expert13381248
SimpleQA Verified12.7%—
MMLU-Pro78.3%—
GPQA (HELM)61.4%—

Multimodal Not comparable

GPT-4.1 mini: 35.2 (#77), Qwen Max: —

BenchmarkGPT-4.1 miniQwen Max
LMArena Vision1181—

Multilingual GPT-4.1 mini leads

GPT-4.1 mini: 45.9 (#161), Qwen Max: 42.0 (#197)

BenchmarkGPT-4.1 miniQwen Max
LMArena Non-English13181263
LMArena Chinese13291254
LMArena French13571329
LMArena German13491254
LMArena Japanese12911205
LMArena Korean12981141
LMArena Russian13241274
LMArena Spanish13191290

Instruction Following GPT-4.1 mini leads

GPT-4.1 mini: 73.9 (#113), Qwen Max: 66.7 (#203)

BenchmarkGPT-4.1 miniQwen Max
LMArena Instruction Following13321262
IFEval90.4%—

Long Context Qwen Max leads

GPT-4.1 mini: 31.8 (#270), Qwen Max: 39.4 (#175)

BenchmarkGPT-4.1 miniQwen Max
Fiction.LiveBench44.4%66.7%
LMArena Longer Query13441289

Writing & Preference Too close to call

GPT-4.1 mini: 48.8 (#193), Qwen Max: 48.0 (#200)

BenchmarkGPT-4.1 miniQwen Max
LMArena Text13411282
LMArena Creative Writing13001248
LMArena Multi-Turn13541277
EQ-Bench Creative Writing1147—
WildBench83.8%—

Frequently asked questions

Is GPT-4.1 mini better than Qwen Max?

GPT-4.1 mini and Qwen Max score almost the same on the Noometry Index (33.5 vs 34.4), so choose on price, context window or the category you care about most.

Which is cheaper, GPT-4.1 mini or Qwen Max?

GPT-4.1 mini is cheaper. It lists at $0.40 per million input tokens and $1.60 per million output tokens; Qwen Max lists at $1.60 and $6.40.

Is GPT-4.1 mini or Qwen Max better for coding?

They score almost the same on coding (30.4 vs 30.3); test both on your own repository before choosing.

Which has the bigger context window?

GPT-4.1 mini does, with 1.05M tokens against 33K.

How many benchmarks do GPT-4.1 mini and Qwen Max share?

23 benchmarks have published results for both models. GPT-4.1 mini has 47 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper