Noometry

Model comparison

GPT-5.4 mini vs Qwen3.7 Plus

GPT-5.4 mini and Qwen3.7 Plus score almost the same on the Noometry Index (45.0 vs 45.3), so choose on price, context window or the category you care about most.

Last verified . 30 shared benchmarks.

GPT-5.4 mini OpenAI

45.0

Rank #76 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 30 benchmarks with published results for both. GPT-5.4 mini scores higher in 2 categories and Qwen3.7 Plus in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.7 Plus leads 39.3 to 30.4.
  • The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 51.2% for GPT-5.4 mini and 34.4% for Qwen3.7 Plus.
  • Qwen3.7 Plus is cheaper at $0.40 / $1.60 per million input/output tokens, against $0.75 / $4.50 for GPT-5.4 mini.
  • Qwen3.7 Plus accepts more context: 1M tokens versus 400K.

Side by side

GPT-5.4 miniQwen3.7 Plus
ProviderOpenAIAlibaba (Qwen)
Noometry Index45.045.3
Released2026-03-172026-06-02
WeightsProprietaryProprietary
Context window400K1M
Max output128K131K
Input $ / M tokens$0.75$0.40
Output $ / M tokens$4.50$1.60
Results tracked4632

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 mini leads

GPT-5.4 mini: 45.2 (#72), Qwen3.7 Plus: 36.6 (#206)

BenchmarkGPT-5.4 miniQwen3.7 Plus
FrontierCode27%10.2%
SciCode49.9%45.5%
LMArena Coding14381473
LMArena WebDev1397—
WeirdML60.3%—
ALE-Bench1,189—

Agentic & Tool Use GPT-5.4 mini leads

GPT-5.4 mini: 29.9 (#81), Qwen3.7 Plus: 21.4 (#138)

BenchmarkGPT-5.4 miniQwen3.7 Plus
OSWorld 2.0—2.8%
DeepResearch Bench36.3%—

Reasoning Qwen3.7 Plus leads

GPT-5.4 mini: 30.4 (#85), Qwen3.7 Plus: 39.3 (#59)

BenchmarkGPT-5.4 miniQwen3.7 Plus
NYT Connections (extended)61.8%74.8%
CritPt10%9.1%
Chess Puzzles24%24%
LMArena Hard Prompts14241460
Mystery Game Puzzles11%17%
DTBench80%84%
LMCA40.8%37.6%
Epoch Capabilities Index148.84147.37
ARC-AGI-218.9%—
Kagi LLM Benchmark37.9%—
ARC-AGI-163.7%—
Thematic Generalization61.7%—
ForecastBench57—

Math Qwen3.7 Plus leads

GPT-5.4 mini: 45.5 (#75), Qwen3.7 Plus: 50.5 (#56)

BenchmarkGPT-5.4 miniQwen3.7 Plus
FrontierMath (Tiers 1-3)51.2%34.4%
OTIS Mock AIME 2024-202588.9%93.3%
LMArena Math14191466
FrontierMath Tier 49.8%—
ProofBench21%—
FrontierMath (Feb 2025 set)28.3%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge Qwen3.7 Plus leads

GPT-5.4 mini: 51.5 (#67), Qwen3.7 Plus: 54.9 (#51)

BenchmarkGPT-5.4 miniQwen3.7 Plus
GPQA Diamond86.9%87.9%
LMArena Expert14351467
SimpleQA Verified29.4%—
Vectara Hallucination Rate5.5%—

Multimodal Qwen3.7 Plus leads

GPT-5.4 mini: 39.7 (#56), Qwen3.7 Plus: 41.8 (#33)

BenchmarkGPT-5.4 miniQwen3.7 Plus
LMArena Vision12451279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

GPT-5.4 mini: 51.9 (#96), Qwen3.7 Plus: 54.8 (#38)

BenchmarkGPT-5.4 miniQwen3.7 Plus
LMArena Non-English14051445
LMArena Chinese14461510
LMArena French14401473
LMArena German14091471
LMArena Japanese13741413
LMArena Korean13681415
LMArena Russian14171457
LMArena Spanish14051457

Instruction Following Qwen3.7 Plus leads

GPT-5.4 mini: 74.1 (#102), Qwen3.7 Plus: 75.8 (#52)

BenchmarkGPT-5.4 miniQwen3.7 Plus
LMArena Instruction Following14051440

Long Context Qwen3.7 Plus leads

GPT-5.4 mini: 43.0 (#112), Qwen3.7 Plus: 44.5 (#65)

BenchmarkGPT-5.4 miniQwen3.7 Plus
LMArena Longer Query14071455

Writing & Preference Too close to call

GPT-5.4 mini: 64.0 (#58), Qwen3.7 Plus: 64.3 (#56)

BenchmarkGPT-5.4 miniQwen3.7 Plus
LMArena Text14121455
LMArena Creative Writing13701439
LMArena Multi-Turn14291460
EQ-Bench Creative Writing1665—

Frequently asked questions

Is GPT-5.4 mini better than Qwen3.7 Plus?

GPT-5.4 mini and Qwen3.7 Plus score almost the same on the Noometry Index (45.0 vs 45.3), so choose on price, context window or the category you care about most.

Which is cheaper, GPT-5.4 mini or Qwen3.7 Plus?

Qwen3.7 Plus is cheaper. It lists at $0.40 per million input tokens and $1.60 per million output tokens; GPT-5.4 mini lists at $0.75 and $4.50.

Is GPT-5.4 mini or Qwen3.7 Plus better for coding?

GPT-5.4 mini scores higher on coding benchmarks: 45.2 versus 36.6 in the Noometry coding category.

Which has the bigger context window?

Qwen3.7 Plus does, with 1M tokens against 400K.

How many benchmarks do GPT-5.4 mini and Qwen3.7 Plus share?

30 benchmarks have published results for both models. GPT-5.4 mini has 46 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper