Model comparison
o3-pro vs Qwen3.5 Plus
o3-pro and Qwen3.5 Plus score almost the same on the Noometry Index (42.9 vs 42.9), so choose on price, context window or the category you care about most.
Last verified . 4 shared benchmarks.
Alibaba (Qwen)Summary
- They share 4 benchmarks with published results for both. o3-pro scores higher in 1 category and Qwen3.5 Plus in 2 categories; 3 gaps are clear of the uncertainty.
- The widest gap is in long context, where o3-pro leads 72.2 to 43.0.
- The biggest single-benchmark swing is Vectara Hallucination Rate: 23.3% for o3-pro and 10.7% for Qwen3.5 Plus.
- Qwen3.5 Plus is cheaper at $0.40 / $2.40 per million input/output tokens, against $20 / $80 for o3-pro.
- Qwen3.5 Plus accepts more context: 1M tokens versus 200K.
Side by side
| o3-pro | Qwen3.5 Plus | |
|---|---|---|
| Provider | OpenAI | Alibaba (Qwen) |
| Noometry Index | 42.9 | 42.9 |
| Released | 2025-06-10 | 2026-02-16 |
| Weights | Proprietary | Proprietary |
| Context window | 200K | 1M |
| Max output | 100K | 66K |
| Input $ / M tokens | $20 | $0.40 |
| Output $ / M tokens | $80 | $2.40 |
| Results tracked | 12 | 15 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
o3-pro: 55.5 (#24), Qwen3.5 Plus: —
| Benchmark | o3-pro | Qwen3.5 Plus |
|---|---|---|
| Aider Polyglot | 84.9% | — |
| WeirdML | 58.2% | — |
| ALE-Bench | — | 621.92 |
Agentic & Tool Use Not comparable
o3-pro: —, Qwen3.5 Plus: —
| Benchmark | o3-pro | Qwen3.5 Plus |
|---|---|---|
| Vending-Bench 2 | — | 0.54 |
Reasoning Qwen3.5 Plus leads
o3-pro: 23.8 (#171), Qwen3.5 Plus: 32.8 (#74)
| Benchmark | o3-pro | Qwen3.5 Plus |
|---|---|---|
| DTBench | 86.9% | 80.5% |
| LMCA | 38.5% | 36.4% |
| Epoch Capabilities Index | 147.42 | 146.78 |
| ARC-AGI-2 | 4.9% | — |
| Kagi LLM Benchmark | 72.1% | — |
| ARC-AGI-1 | 59.3% | — |
| Chess Puzzles | — | 22% |
| Mystery Game Puzzles | — | 17% |
Math Not comparable
o3-pro: —, Qwen3.5 Plus: 49.6 (#61)
| Benchmark | o3-pro | Qwen3.5 Plus |
|---|---|---|
| OTIS Mock AIME 2024-2025 | — | 86.7% |
| FrontierMath (Feb 2025 set) | — | 21% |
| FrontierMath Tier 4 (v1) | — | 2.1% |
Knowledge Qwen3.5 Plus leads
o3-pro: 29.5 (#238), Qwen3.5 Plus: 46.0 (#83)
| Benchmark | o3-pro | Qwen3.5 Plus |
|---|---|---|
| Vectara Hallucination Rate | 23.3% | 10.7% |
| GPQA Diamond | — | 84.8% |
| SimpleQA Verified | — | 25.4% |
| Confabulations | 14.2% | — |
Long Context o3-pro leads
o3-pro: 72.2 (#1), Qwen3.5 Plus: 43.0 (#113)
| Benchmark | o3-pro | Qwen3.5 Plus |
|---|---|---|
| Fiction.LiveBench | 97.2% | — |
| CL-bench | — | 19.8% |
| CL-bench Life | — | 12.4% |
Writing & Preference Not comparable
o3-pro: 57.1 (#133), Qwen3.5 Plus: —
| Benchmark | o3-pro | Qwen3.5 Plus |
|---|---|---|
| Short-Story Creative Writing | 84.4% | — |
Frequently asked questions
Is o3-pro better than Qwen3.5 Plus?
o3-pro and Qwen3.5 Plus score almost the same on the Noometry Index (42.9 vs 42.9), so choose on price, context window or the category you care about most.
Which is cheaper, o3-pro or Qwen3.5 Plus?
Qwen3.5 Plus is cheaper. It lists at $0.40 per million input tokens and $2.40 per million output tokens; o3-pro lists at $20 and $80.
Which has the bigger context window?
Qwen3.5 Plus does, with 1M tokens against 200K.
How many benchmarks do o3-pro and Qwen3.5 Plus share?
4 benchmarks have published results for both models. o3-pro has 12 scored results on Noometry and Qwen3.5 Plus has 15.