Model comparison

GPT-5.1-Codex vs Qwen Plus

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 37.1 on the Noometry Index. Qwen Plus costs 5.7× less per token, which makes it the better buy when GPT-5.1-Codex's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.6

Rank #186 Reported

Qwen Plus Alibaba (Qwen)

37.1

Rank #210 Confirmed

Summary

  • The widest gap is in math, where GPT-5.1-Codex leads 30.3 to 23.3.
  • Qwen Plus is cheaper at $0.40 / $1.20 per million input/output tokens, against $1.25 / $10 for GPT-5.1-Codex.
  • Qwen Plus accepts more context: 1M tokens versus 400K.

Side by side

GPT-5.1-Codex and Qwen Plus specifications
GPT-5.1-CodexQwen Plus
ProviderOpenAIAlibaba (Qwen)
Noometry Index38.637.1
Released2025-11-122024-01-25
WeightsProprietaryProprietary
Context window400K1M
Max output128K33K
Input $ / M tokens$1.25$0.40
Output $ / M tokens$10$1.20
Results tracked620

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1-Codex leads

GPT-5.1-Codex: 41.9 (#116), Qwen Plus: 38.9 (#167)

Coding benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
SWE-bench Verified (bash only)66%—
LMArena WebDev1337—
LMArena Coding—1328
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 38.0 (#33), Qwen Plus: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Qwen Plus: 28.4 (#107)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
Kagi LLM Benchmark—63.3%
LMArena Hard Prompts—1317
DTBench—81.1%
LMCA—24%

Math GPT-5.1-Codex leads

GPT-5.1-Codex: 30.3 (#235), Qwen Plus: 23.3 (#271)

Math benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
OTIS Mock AIME 2024-2025—17.8%
ProofBench9%—
LMArena Math—1326
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Not comparable

GPT-5.1-Codex: —, Qwen Plus: 27.4 (#251)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
GPQA Diamond—48.1%
LMArena Expert—1328

Multilingual Not comparable

GPT-5.1-Codex: —, Qwen Plus: 45.1 (#175)

Multilingual benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
LMArena Non-English—1310
LMArena Chinese—1347
LMArena Japanese—1251
LMArena Russian—1323

Instruction Following Not comparable

GPT-5.1-Codex: —, Qwen Plus: 68.8 (#181)

Instruction Following benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
LMArena Instruction Following—1303

Long Context Not comparable

GPT-5.1-Codex: —, Qwen Plus: 40.3 (#158)

Long Context benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
LMArena Longer Query—1324

Writing & Preference Not comparable

GPT-5.1-Codex: —, Qwen Plus: 52.2 (#176)

Writing & Preference benchmarks
BenchmarkGPT-5.1-CodexQwen Plus
LMArena Text—1326
LMArena Creative Writing—1293
LMArena Multi-Turn—1336

Frequently asked questions

Is GPT-5.1-Codex better than Qwen Plus?

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 37.1 on the Noometry Index. Qwen Plus costs 5.7× less per token, which makes it the better buy when GPT-5.1-Codex's lead doesn't matter for your workload.

Which is cheaper, GPT-5.1-Codex or Qwen Plus?

Qwen Plus is cheaper. It lists at $0.40 per million input tokens and $1.20 per million output tokens; GPT-5.1-Codex lists at $1.25 and $10.

Is GPT-5.1-Codex or Qwen Plus better for coding?

GPT-5.1-Codex scores higher on coding benchmarks: 41.9 versus 38.9 in the Noometry coding category.

Which has the bigger context window?

Qwen Plus does, with 1M tokens against 400K.

How many benchmarks do GPT-5.1-Codex and Qwen Plus share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper