Noometry

Model comparison

o1 vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 40.6 on the Noometry Index.

Last verified . 17 shared benchmarks.

o1 OpenAI

40.6

Rank #140 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

44.7

Rank #72 Confirmed

Summary

  • They share 17 benchmarks with published results for both. o1 scores higher in 3 categories and Qwen3.5 Max Preview in 5 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.1 to 55.8.

Side by side

o1Qwen3.5 Max Preview
ProviderOpenAIAlibaba (Qwen)
Noometry Index40.644.7
Released2024-09-12—
WeightsProprietaryProprietary
Context window200K—
Max output100K—
Input $ / M tokens$15—
Output $ / M tokens$60—
Results tracked5217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o1 leads

o1: 45.7 (#64), Qwen3.5 Max Preview: 43.4 (#79)

Benchmarko1Qwen3.5 Max Preview
LMArena Coding13671488
Aider Polyglot61.7%—
WeirdML47.6%—
LiveBench Coding69.7%—
CadEval56%—
HumanEval+89%—
MBPP+80.2%—

Agentic & Tool Use Not comparable

o1: 24.3 (#111), Qwen3.5 Max Preview: —

Benchmarko1Qwen3.5 Max Preview
Cybench10%—
METR Time Horizons51.1%—

Reasoning Qwen3.5 Max Preview leads

o1: 27.5 (#103), Qwen3.5 Max Preview: 29.6 (#81)

Benchmarko1Qwen3.5 Max Preview
LMArena Hard Prompts13721483
SimpleBench41.7%—
ARC-AGI-130.7%—
Chess Puzzles15%—
EnigmaEval5.7%—
LiveBench Reasoning91.6%—
DTBench74.7%—
LiveBench Data Analysis65.5%—
LMCA22.3%—
Epoch Capabilities Index141.92—
LiveBench75.7%—

Math Qwen3.5 Max Preview leads

o1: 34.9 (#150), Qwen3.5 Max Preview: 37.3 (#99)

Benchmarko1Qwen3.5 Max Preview
LMArena Math13881473
FrontierMath (Tiers 1-3)14.7%—
OTIS Mock AIME 2024-202573.3%—
LiveBench Math80.3%—
MATH Level 594.7%—
FrontierMath (Feb 2025 set)9.3%—

Knowledge Too close to call

o1: 41.5 (#101), Qwen3.5 Max Preview: 41.1 (#104)

Benchmarko1Qwen3.5 Max Preview
LMArena Expert13621489
GPQA Diamond76.8%—
Humanity's Last Exam8%—
SimpleQA Verified41.1%—
Confabulations11.7%—

Multimodal Not comparable

o1: 33.6 (#87), Qwen3.5 Max Preview: —

Benchmarko1Qwen3.5 Max Preview
LMArena Vision1168—
GeoBench80%—
VPCT37%—
SpatialViz-Bench41.4%—

Multilingual Qwen3.5 Max Preview leads

o1: 48.8 (#137), Qwen3.5 Max Preview: 56.4 (#21)

Benchmarko1Qwen3.5 Max Preview
LMArena Non-English13591465
LMArena Chinese13941534
LMArena French13431483
LMArena German13371487
LMArena Japanese13461497
LMArena Korean13961438
LMArena Russian13561472
LMArena Spanish13451470

Instruction Following Qwen3.5 Max Preview leads

o1: 75.0 (#82), Qwen3.5 Max Preview: 77.2 (#28)

Benchmarko1Qwen3.5 Max Preview
LMArena Instruction Following13681467
LiveBench Instruction Following81.5%—

Long Context o1 leads

o1: 50.3 (#9), Qwen3.5 Max Preview: 45.2 (#44)

Benchmarko1Qwen3.5 Max Preview
LMArena Longer Query13781477
Fiction.LiveBench83.3%—

Writing & Preference Qwen3.5 Max Preview leads

o1: 55.8 (#139), Qwen3.5 Max Preview: 66.1 (#39)

Benchmarko1Qwen3.5 Max Preview
LMArena Text13661471
LMArena Creative Writing13471464
LMArena Multi-Turn13681478
Short-Story Creative Writing70.2%—
LiveBench Language65.4%—

Frequently asked questions

Is o1 better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 40.6 on the Noometry Index.

Is o1 or Qwen3.5 Max Preview better for coding?

o1 scores higher on coding benchmarks: 45.7 versus 43.4 in the Noometry coding category.

How many benchmarks do o1 and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. o1 has 52 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper