Model comparison

GPT-5.1 vs GPT-5.3 Codex

GPT-5.1 is the stronger model overall, scoring 48.8 to 45.5 on the Noometry Index.

Last verified . 7 shared benchmarks.

GPT-5.1 OpenAI

48.8

Rank #47 Confirmed

GPT-5.3 Codex OpenAI

45.5

Rank #61 Reported

Summary

  • They share 7 benchmarks with published results for both. GPT-5.1 scores higher in 0 categories and GPT-5.3 Codex in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where GPT-5.3 Codex leads 47.8 to 32.5.
  • The biggest single-benchmark swing is Terminal-Bench: 47.6% for GPT-5.1 and 78.4% for GPT-5.3 Codex.
  • GPT-5.1 is cheaper at $1.25 / $10 per million input/output tokens, against $1.75 / $14 for GPT-5.3 Codex.

Side by side

GPT-5.1 and GPT-5.3 Codex specifications
GPT-5.1GPT-5.3 Codex
ProviderOpenAIOpenAI
Noometry Index48.845.5
Released2025-11-132026-02-05
WeightsProprietaryProprietary
Context window400K400K
Max output128K128K
Input $ / M tokens$1.25$1.75
Output $ / M tokens$10$14
Results tracked638

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.3 Codex leads

GPT-5.1: 46.9 (#59), GPT-5.3 Codex: 48.5 (#51)

Coding benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
SWE-bench Verified68%74.8%
LMArena WebDev13951408
WeirdML60.8%79.3%
ALE-Bench1,1921,655
SWE-bench Verified (bash only)66%—
SciCode43.3%—
GSO13.7%—
LiveBench Coding72.5%—
LMArena Coding1454—

Agentic & Tool Use GPT-5.3 Codex leads

GPT-5.1: 32.5 (#55), GPT-5.3 Codex: 47.8 (#9)

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
Terminal-Bench47.6%78.4%
Vending-Bench 21,4735,940
DeepResearch Bench42.8%—
LMArena Search1199—
METR Time Horizons—74.5%

Reasoning Not comparable

GPT-5.1: 39.9 (#50), GPT-5.3 Codex: —

Reasoning benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
Epoch Capabilities Index149.66156.84
ARC-AGI-217.6%—
SimpleBench53.2%—
ARC-AGI-172.8%—
CritPt4.9%—
Chess Puzzles32%—
EnigmaEval11.2%—
LiveBench Reasoning95.8%—
LMArena Hard Prompts1457—
Mystery Game Puzzles19%—
DTBench90.1%—
LiveBench Data Analysis72.1%—
LMCA43.9%—
ForecastBench58.1—
LiveBench78.8%—

Math Not comparable

GPT-5.1: 50.3 (#45), GPT-5.3 Codex: —

Math benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
OTIS Mock AIME 2024-202588.6%—
Omni-MATH46.4%—
LiveBench Math94.5%—
LMArena Math1446—
FrontierMath (Feb 2025 set)31%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge Not comparable

GPT-5.1: 50.5 (#65), GPT-5.3 Codex: —

Knowledge benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
GPQA Diamond87.6%—
Humanity's Last Exam23.7%—
SimpleQA Verified48%—
MMLU-Pro57.9%—
Vectara Hallucination Rate10.9%—
GPQA (HELM)44.2%—
LMArena Expert1470—

Multimodal Not comparable

GPT-5.1: 44.0 (#17), GPT-5.3 Codex: —

Multimodal benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
LMArena Vision1250—
VPCT58.7%—
LMArena Document1403—

Multilingual Not comparable

GPT-5.1: 54.0 (#51), GPT-5.3 Codex: —

Multilingual benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
LMArena Non-English1431—
LMArena Chinese1495—
LMArena French1451—
LMArena German1439—
LMArena Japanese1453—
LMArena Korean1401—
LMArena Russian1435—
LMArena Spanish1430—

Instruction Following Not comparable

GPT-5.1: 84.0 (#1), GPT-5.3 Codex: —

Instruction Following benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
LiveBench Instruction Following93.3%—
IFEval93.5%—
LMArena Instruction Following1442—

Long Context Not comparable

GPT-5.1: 47.6 (#14), GPT-5.3 Codex: —

Long Context benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
CL-bench23.7%—
CL-bench Life17.3%—
LMArena Longer Query1448—

Writing & Preference Not comparable

GPT-5.1: 64.7 (#53), GPT-5.3 Codex: —

Writing & Preference benchmarks
BenchmarkGPT-5.1GPT-5.3 Codex
LMArena Text1443—
LMArena Creative Writing1427—
WildBench86.3%—
LMArena Multi-Turn1449—
LiveBench Language80.2%—

Frequently asked questions

Is GPT-5.1 better than GPT-5.3 Codex?

GPT-5.1 is the stronger model overall, scoring 48.8 to 45.5 on the Noometry Index.

Which is cheaper, GPT-5.1 or GPT-5.3 Codex?

GPT-5.1 is cheaper. It lists at $1.25 per million input tokens and $10 per million output tokens; GPT-5.3 Codex lists at $1.75 and $14.

Is GPT-5.1 or GPT-5.3 Codex better for coding?

GPT-5.3 Codex scores higher on coding benchmarks: 48.5 versus 46.9 in the Noometry coding category.

Which has the bigger context window?

Both accept 400K tokens.

How many benchmarks do GPT-5.1 and GPT-5.3 Codex share?

7 benchmarks have published results for both models. GPT-5.1 has 63 scored results on Noometry and GPT-5.3 Codex has 8.

Related comparisons

Go deeper