Model comparison

GPT-5.1-Codex vs Qwen3-1.7B

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 26.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.6

Rank #186 Reported

Qwen3-1.7B Alibaba (Qwen)

26.6

Rank #336 Reported

Summary

  • The widest gap is in math, where GPT-5.1-Codex leads 30.3 to 16.3.
  • Qwen3-1.7B has downloadable open weights; the other is API-only.

Side by side

GPT-5.1-Codex and Qwen3-1.7B specifications
GPT-5.1-CodexQwen3-1.7B
ProviderOpenAIAlibaba (Qwen)
Noometry Index38.626.6
Released2025-11-122025-04-29
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.25—
Output $ / M tokens$10—
Results tracked64

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.1-Codex: 41.9 (#116), Qwen3-1.7B: —

Coding benchmarks
BenchmarkGPT-5.1-CodexQwen3-1.7B
SWE-bench Verified (bash only)66%—
LMArena WebDev1337—
ALE-Bench1,245—

Agentic & Tool Use GPT-5.1-Codex leads

GPT-5.1-Codex: 38.0 (#33), Qwen3-1.7B: 24.7 (#115)

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexQwen3-1.7B
Terminal-Bench60.4%—
Berkeley Function Calling Leaderboard—28.4%
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Qwen3-1.7B: 19.2 (#267)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexQwen3-1.7B
Chess Puzzles—0%

Math GPT-5.1-Codex leads

GPT-5.1-Codex: 30.3 (#235), Qwen3-1.7B: 16.3 (#294)

Math benchmarks
BenchmarkGPT-5.1-CodexQwen3-1.7B
OTIS Mock AIME 2024-2025—8.1%
ProofBench9%—

Knowledge Not comparable

GPT-5.1-Codex: —, Qwen3-1.7B: 19.6 (#278)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexQwen3-1.7B
GPQA Diamond—38%

Frequently asked questions

Is GPT-5.1-Codex better than Qwen3-1.7B?

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 26.6 on the Noometry Index.

How many benchmarks do GPT-5.1-Codex and Qwen3-1.7B share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper