Model comparison

Amazon Nova Experimental Chat 10 09 vs GPT-5 Mini

Amazon Nova Experimental Chat 10 09 and GPT-5 Mini score almost the same on the Noometry Index (41.9 vs 41.8), so choose on price, context window or the category you care about most.

Last verified . 9 shared benchmarks.

GPT-5 Mini OpenAI

41.8

Rank #128 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 2 categories and GPT-5 Mini in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where GPT-5 Mini leads 76.2 to 69.4.

Side by side

Amazon Nova Experimental Chat 10 09 and GPT-5 Mini specifications
Amazon Nova Experimental Chat 10 09GPT-5 Mini
ProviderAmazonOpenAI
Noometry Index41.941.8
Released—2025-08-07
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$0.25
Output $ / M tokens—$2
Results tracked960

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Experimental Chat 10 09: 40.2 (#145), GPT-5 Mini: 40.1 (#146)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
LMArena Coding13701406
SWE-bench Verified—64.7%
SWE-bench Verified (bash only)—59.8%
SWE-bench Multilingual—39.7%
SciCode—39.2%
WeirdML—52.7%
ALE-Bench—799.77
AlgoTune—1.38

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Mini: 31.1 (#70)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
Terminal-Bench—34.8%
Berkeley Function Calling Leaderboard—55.5%
Vending-Bench 2—-31.18

Reasoning Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 27.3 (#120), GPT-5 Mini: 23.9 (#168)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
LMArena Hard Prompts13561380
ARC-AGI-2—4.4%
Kagi LLM Benchmark—70.3%
ARC-AGI-1—54.3%
CritPt—0%
Chess Puzzles—30%
EnigmaEval—8.2%
Mystery Game Puzzles—10%
DTBench—80.5%
LMCA—34.2%
Epoch Capabilities Index—145.52
ForecastBench—61

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Mini: 46.7 (#69)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
FrontierMath (Tiers 1-3)—46.7%
FrontierMath Tier 4—12.2%
OTIS Mock AIME 2024-2025—86.7%
ProofBench—9%
Omni-MATH—72.2%
LMArena Math—1378
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—27.2%
FrontierMath Tier 4 (v1)—6.3%

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Mini: 45.6 (#86)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
GPQA Diamond—75%
Humanity's Last Exam—19.4%
SimpleQA Verified—21.6%
MMLU-Pro—83.5%
Confabulations—13.3%
Vectara Hallucination Rate—12.9%
GPQA (HELM)—75.6%
LMArena Expert—1379

Multimodal Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Mini: 35.6 (#85)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
LMArena Vision—1202
VPCT—40.2%

Multilingual GPT-5 Mini leads

Amazon Nova Experimental Chat 10 09: 47.3 (#150), GPT-5 Mini: 48.9 (#137)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
LMArena Non-English13401363
LMArena Chinese13411385
LMArena French—1386
LMArena German—1366
LMArena Japanese—1341
LMArena Korean—1308
LMArena Russian—1362
LMArena Spanish—1355

Instruction Following GPT-5 Mini leads

Amazon Nova Experimental Chat 10 09: 69.4 (#172), GPT-5 Mini: 76.2 (#46)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
LMArena Instruction Following13151357
IFEval—92.7%

Long Context GPT-5 Mini leads

Amazon Nova Experimental Chat 10 09: 40.5 (#152), GPT-5 Mini: 41.9 (#132)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
LMArena Longer Query13331355
Fiction.LiveBench—69.4%

Writing & Preference Too close to call

Amazon Nova Experimental Chat 10 09: 54.7 (#149), GPT-5 Mini: 55.2 (#148)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Mini
LMArena Text13641373
LMArena Creative Writing13071325
LMArena Multi-Turn13551363
Short-Story Creative Writing—83.1%
EQ-Bench Creative Writing—1313
WildBench—85.5%

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than GPT-5 Mini?

Amazon Nova Experimental Chat 10 09 and GPT-5 Mini score almost the same on the Noometry Index (41.9 vs 41.8), so choose on price, context window or the category you care about most.

Is Amazon Nova Experimental Chat 10 09 or GPT-5 Mini better for coding?

They score almost the same on coding (40.2 vs 40.1); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and GPT-5 Mini share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and GPT-5 Mini has 60.

Related comparisons

Go deeper