Model comparison

Amazon Nova Pro vs GPT-5.4 Pro

GPT-5.4 Pro is the stronger model overall, scoring 58.9 to 31.0 on the Noometry Index. Amazon Nova Pro costs 48× less per token, which makes it the better buy when GPT-5.4 Pro's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

GPT-5.4 Pro OpenAI

58.9

Rank #18 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Amazon Nova Pro scores higher in 0 categories and GPT-5.4 Pro in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.4 Pro leads 70.7 to 20.0.
  • The biggest single-benchmark swing is Humanity's Last Exam: 4.4% for Amazon Nova Pro and 44.3% for GPT-5.4 Pro.
  • Amazon Nova Pro is cheaper at $0.80 / $3.20 per million input/output tokens, against $30 / $180 for GPT-5.4 Pro.
  • GPT-5.4 Pro accepts more context: 1.05M tokens versus 300K.

Side by side

Amazon Nova Pro and GPT-5.4 Pro specifications
Amazon Nova ProGPT-5.4 Pro
ProviderAmazonOpenAI
Noometry Index31.058.9
Released2024-12-032026-03-05
WeightsProprietaryProprietary
Context window300K1.05M
Max output10K128K
Input $ / M tokens$0.80$30
Output $ / M tokens$3.20$180
Results tracked3816

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 Pro leads

Amazon Nova Pro: 35.1 (#229), GPT-5.4 Pro: 43.2 (#90)

Coding benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
WeirdML—57.4%
LiveBench Coding38.1%—
LMArena Coding1270—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), GPT-5.4 Pro: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning GPT-5.4 Pro leads

Amazon Nova Pro: 20.0 (#243), GPT-5.4 Pro: 70.7 (#13)

Reasoning benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
Epoch Capabilities Index123.8158.93
ARC-AGI-2—83.3%
SimpleBench—74.1%
ARC-AGI-1—94.5%
CritPt—30%
Chess Puzzles—58.6%
EnigmaEval—23.8%
LiveBench Reasoning32.6%—
LMArena Hard Prompts1246—
LiveBench Data Analysis48.3%—
LiveBench43.5%—

Math GPT-5.4 Pro leads

Amazon Nova Pro: 28.5 (#243), GPT-5.4 Pro: 72.4 (#22)

Math benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
FrontierMath (Tiers 1-3)—82.5%
FrontierMath Tier 4—58.5%
Omni-MATH24.2%—
LiveBench Math38%—
LMArena Math1252—
FrontierMath (Feb 2025 set)—50%
FrontierMath Tier 4 (v1)—37.5%

Knowledge GPT-5.4 Pro leads

Amazon Nova Pro: 27.4 (#250), GPT-5.4 Pro: 68.3 (#7)

Knowledge benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
Humanity's Last Exam4.4%44.3%
Vectara Hallucination Rate5.1%8.3%
GPQA Diamond—94.6%
SimpleQA Verified—46.3%
MMLU-Pro67.3%—
Confabulations30.1%—
GPQA (HELM)44.6%—
LMArena Expert1211—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), GPT-5.4 Pro: —

Multimodal benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
LMArena Vision980—

Multilingual Not comparable

Amazon Nova Pro: 39.7 (#223), GPT-5.4 Pro: —

Multilingual benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
LMArena Non-English1234—
LMArena Chinese1244—
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Russian1240—
LMArena Spanish1182—

Instruction Following Not comparable

Amazon Nova Pro: 64.9 (#226), GPT-5.4 Pro: —

Instruction Following benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
LiveBench Instruction Following67.1%—
IFEval81.5%—
LMArena Instruction Following1235—

Long Context Not comparable

Amazon Nova Pro: 38.1 (#205), GPT-5.4 Pro: —

Long Context benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
LMArena Longer Query1255—

Writing & Preference Not comparable

Amazon Nova Pro: 43.9 (#226), GPT-5.4 Pro: —

Writing & Preference benchmarks
BenchmarkAmazon Nova ProGPT-5.4 Pro
LMArena Text1259—
LMArena Creative Writing1212—
Short-Story Creative Writing60.5%—
WildBench77.7%—
LMArena Multi-Turn1246—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than GPT-5.4 Pro?

GPT-5.4 Pro is the stronger model overall, scoring 58.9 to 31.0 on the Noometry Index. Amazon Nova Pro costs 48× less per token, which makes it the better buy when GPT-5.4 Pro's lead doesn't matter for your workload.

Which is cheaper, Amazon Nova Pro or GPT-5.4 Pro?

Amazon Nova Pro is cheaper. It lists at $0.80 per million input tokens and $3.20 per million output tokens; GPT-5.4 Pro lists at $30 and $180.

Is Amazon Nova Pro or GPT-5.4 Pro better for coding?

GPT-5.4 Pro scores higher on coding benchmarks: 43.2 versus 35.1 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 Pro does, with 1.05M tokens against 300K.

How many benchmarks do Amazon Nova Pro and GPT-5.4 Pro share?

3 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and GPT-5.4 Pro has 16.

Related comparisons

Go deeper