Noometry

Model comparison

GPT-4.1 nano vs GPT-5 Nano

GPT-5 Nano is the stronger model overall, scoring 33.5 to 27.9 on the Noometry Index.

Last verified . 35 shared benchmarks.

GPT-4.1 nano OpenAI

27.9

Rank #327 Confirmed

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Summary

  • They share 35 benchmarks with published results for both. GPT-4.1 nano scores higher in 2 categories and GPT-5 Nano in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5 Nano leads 35.9 to 21.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 28.9% for GPT-4.1 nano and 81.1% for GPT-5 Nano.
  • GPT-5 Nano is cheaper at $0.05 / $0.40 per million input/output tokens, against $0.10 / $0.40 for GPT-4.1 nano.
  • GPT-4.1 nano accepts more context: 1.05M tokens versus 400K.

Side by side

GPT-4.1 nanoGPT-5 Nano
ProviderOpenAIOpenAI
Noometry Index27.933.5
Released2025-04-142025-08-07
WeightsProprietaryProprietary
Context window1.05M400K
Max output33K128K
Input $ / M tokens$0.10$0.05
Output $ / M tokens$0.40$0.40
Results tracked3849

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 Nano leads

GPT-4.1 nano: 24.1 (#330), GPT-5 Nano: 33.6 (#254)

BenchmarkGPT-4.1 nanoGPT-5 Nano
WeirdML19%38.1%
LMArena Coding13061351
SWE-bench Verified (bash only)—34.8%
Aider Polyglot8.9%—
SciCode25.9%—
ALE-Bench—718.67

Agentic & Tool Use Too close to call

GPT-4.1 nano: 26.5 (#104), GPT-5 Nano: 25.8 (#106)

BenchmarkGPT-4.1 nanoGPT-5 Nano
Berkeley Function Calling Leaderboard33%51.5%
Terminal-Bench—21.8%

Reasoning GPT-5 Nano leads

GPT-4.1 nano: 8.5 (#349), GPT-5 Nano: 16.3 (#306)

BenchmarkGPT-4.1 nanoGPT-5 Nano
ARC-AGI-20%2.6%
Kagi LLM Benchmark33.3%62.2%
ARC-AGI-10%20.7%
LMArena Hard Prompts12861328
DTBench52.5%62.7%
LMCA5.5%7.9%
Epoch Capabilities Index129.62139.38
CritPt0%—
Chess Puzzles—27%
Mystery Game Puzzles—9%
ForecastBench—59.1

Math GPT-5 Nano leads

GPT-4.1 nano: 26.9 (#252), GPT-5 Nano: 29.4 (#241)

BenchmarkGPT-4.1 nanoGPT-5 Nano
OTIS Mock AIME 2024-202528.9%81.1%
Omni-MATH36.7%54.6%
LMArena Math12741317
MATH Level 570%95.2%
FrontierMath (Feb 2025 set)1%8.3%
FrontierMath (Tiers 1-3)—20%
FrontierMath Tier 4—2.4%
ProofBench—12%
FrontierMath Tier 4 (v1)—2.1%

Knowledge GPT-5 Nano leads

GPT-4.1 nano: 21.8 (#273), GPT-5 Nano: 35.9 (#178)

BenchmarkGPT-4.1 nanoGPT-5 Nano
GPQA Diamond48.9%69.4%
SimpleQA Verified6%11.7%
MMLU-Pro55%77.8%
GPQA (HELM)50.7%67.9%
LMArena Expert12721321
Vectara Hallucination Rate—10.5%

Multimodal GPT-5 Nano leads

GPT-4.1 nano: 29.2 (#113), GPT-5 Nano: 31.3 (#108)

BenchmarkGPT-4.1 nanoGPT-5 Nano
LMArena Vision10631159
VPCT—37.2%

Multilingual GPT-5 Nano leads

GPT-4.1 nano: 41.6 (#205), GPT-5 Nano: 45.3 (#172)

BenchmarkGPT-4.1 nanoGPT-5 Nano
LMArena Non-English12601313
LMArena Chinese12701356
LMArena German12881327
LMArena Japanese11981226
LMArena Russian12611296
LMArena Korean—1269
LMArena Spanish—1360

Instruction Following GPT-5 Nano leads

GPT-4.1 nano: 67.8 (#193), GPT-5 Nano: 75.0 (#79)

BenchmarkGPT-4.1 nanoGPT-5 Nano
IFEval84.3%93.2%
LMArena Instruction Following12671306

Long Context GPT-5 Nano leads

GPT-4.1 nano: 23.7 (#296), GPT-5 Nano: 31.3 (#281)

BenchmarkGPT-4.1 nanoGPT-5 Nano
Fiction.LiveBench25%44.4%
LMArena Longer Query12831312

Writing & Preference GPT-4.1 nano leads

GPT-4.1 nano: 40.5 (#243), GPT-5 Nano: 39.1 (#249)

BenchmarkGPT-4.1 nanoGPT-5 Nano
LMArena Text12851320
LMArena Creative Writing12601249
EQ-Bench Creative Writing946705
WildBench81.2%80.6%
LMArena Multi-Turn12771311

Frequently asked questions

Is GPT-4.1 nano better than GPT-5 Nano?

GPT-5 Nano is the stronger model overall, scoring 33.5 to 27.9 on the Noometry Index.

Which is cheaper, GPT-4.1 nano or GPT-5 Nano?

GPT-5 Nano is cheaper. It lists at $0.05 per million input tokens and $0.40 per million output tokens; GPT-4.1 nano lists at $0.10 and $0.40.

Is GPT-4.1 nano or GPT-5 Nano better for coding?

GPT-5 Nano scores higher on coding benchmarks: 33.6 versus 24.1 in the Noometry coding category.

Which has the bigger context window?

GPT-4.1 nano does, with 1.05M tokens against 400K.

How many benchmarks do GPT-4.1 nano and GPT-5 Nano share?

35 benchmarks have published results for both models. GPT-4.1 nano has 38 scored results on Noometry and GPT-5 Nano has 49.

Related comparisons

Go deeper