Model comparison

GPT-5 vs GPT-5 Mini

GPT-5 is the stronger model overall, scoring 50.9 to 41.8 on the Noometry Index. GPT-5 Mini costs 5.0× less per token, which makes it the better buy when GPT-5's lead doesn't matter for your workload.

Last verified . 57 shared benchmarks.

GPT-5 OpenAI

50.9

Rank #45 Confirmed

GPT-5 Mini OpenAI

41.8

Rank #128 Confirmed

Summary

  • They share 57 benchmarks with published results for both. GPT-5 scores higher in 9 categories and GPT-5 Mini in 1 category; 10 gaps are clear of the uncertainty.
  • The widest gap is in long context, where GPT-5 leads 69.5 to 41.9.
  • The biggest single-benchmark swing is SimpleQA Verified: 50.1% for GPT-5 and 21.6% for GPT-5 Mini.
  • GPT-5 Mini is cheaper at $0.25 / $2 per million input/output tokens, against $1.25 / $10 for GPT-5.

Side by side

GPT-5 and GPT-5 Mini specifications
GPT-5GPT-5 Mini
ProviderOpenAIOpenAI
Noometry Index50.941.8
Released2025-08-072025-08-07
WeightsProprietaryProprietary
Context window400K400K
Max output128K128K
Input $ / M tokens$1.25$0.25
Output $ / M tokens$10$2
Results tracked6960

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 leads

GPT-5: 50.3 (#47), GPT-5 Mini: 40.1 (#146)

Coding benchmarks
BenchmarkGPT-5GPT-5 Mini
SWE-bench Verified73.6%64.7%
SWE-bench Verified (bash only)65%59.8%
SciCode42.9%39.2%
WeirdML60.7%52.7%
LMArena Coding14361406
ALE-Bench1,162799.77
AlgoTune1.671.38
Aider Polyglot88%—
LMArena WebDev1418—
SWE-bench Multilingual—39.7%
GSO6.9%—

Agentic & Tool Use GPT-5 leads

GPT-5: 33.1 (#56), GPT-5 Mini: 31.1 (#70)

Agentic & Tool Use benchmarks
BenchmarkGPT-5GPT-5 Mini
Terminal-Bench49.6%34.8%
Berkeley Function Calling Leaderboard—55.5%
GDPval34.8%—
Remote Labor Index1.7%—
DeepResearch Bench49.6%—
BALROG32.8%—
LMArena Search1133—
METR Time Horizons69.6%—
Vending-Bench 2—-31.18

Reasoning GPT-5 leads

GPT-5: 38.3 (#64), GPT-5 Mini: 23.9 (#168)

Reasoning benchmarks
BenchmarkGPT-5GPT-5 Mini
ARC-AGI-29.9%4.4%
Kagi LLM Benchmark72.7%70.3%
ARC-AGI-165.7%54.3%
CritPt12.6%0%
Chess Puzzles37%30%
EnigmaEval10.5%8.2%
LMArena Hard Prompts14161380
Mystery Game Puzzles23%10%
DTBench90.7%80.5%
LMCA40%34.2%
Epoch Capabilities Index150145.52
ForecastBench61.461
SimpleBench56.7%—
EBR-Bench12.7%—

Math GPT-5 leads

GPT-5: 55.0 (#44), GPT-5 Mini: 46.7 (#69)

Math benchmarks
BenchmarkGPT-5GPT-5 Mini
FrontierMath (Tiers 1-3)55.4%46.7%
FrontierMath Tier 422%12.2%
OTIS Mock AIME 2024-202591.4%86.7%
ProofBench18%9%
Omni-MATH64.7%72.2%
LMArena Math14071378
MATH Level 598.1%97.8%
FrontierMath (Feb 2025 set)32.4%27.2%
FrontierMath Tier 4 (v1)12.5%6.3%

Knowledge GPT-5 leads

GPT-5: 56.6 (#43), GPT-5 Mini: 45.6 (#86)

Knowledge benchmarks
BenchmarkGPT-5GPT-5 Mini
GPQA Diamond86.2%75%
Humanity's Last Exam25.3%19.4%
SimpleQA Verified50.1%21.6%
MMLU-Pro86.3%83.5%
Confabulations10.3%13.3%
Vectara Hallucination Rate14.7%12.9%
GPQA (HELM)79.2%75.6%
LMArena Expert14191379

Multimodal GPT-5 leads

GPT-5: 46.8 (#13), GPT-5 Mini: 35.6 (#85)

Multimodal benchmarks
BenchmarkGPT-5GPT-5 Mini
LMArena Vision12321202
VPCT66%40.2%
GeoBench81%—

Multilingual GPT-5 leads

GPT-5: 51.4 (#110), GPT-5 Mini: 48.9 (#137)

Multilingual benchmarks
BenchmarkGPT-5GPT-5 Mini
LMArena Non-English13971363
LMArena Chinese14221385
LMArena French14101386
LMArena German14161366
LMArena Japanese14091341
LMArena Korean13601308
LMArena Russian14061362
LMArena Spanish13991355

Instruction Following GPT-5 Mini leads

GPT-5: 73.8 (#113), GPT-5 Mini: 76.2 (#46)

Instruction Following benchmarks
BenchmarkGPT-5GPT-5 Mini
IFEval87.5%92.7%
LMArena Instruction Following13881357

Long Context GPT-5 leads

GPT-5: 69.5 (#2), GPT-5 Mini: 41.9 (#132)

Long Context benchmarks
BenchmarkGPT-5GPT-5 Mini
Fiction.LiveBench97.2%69.4%
LMArena Longer Query13991355

Writing & Preference GPT-5 leads

GPT-5: 63.4 (#65), GPT-5 Mini: 55.2 (#148)

Writing & Preference benchmarks
BenchmarkGPT-5GPT-5 Mini
LMArena Text14061373
LMArena Creative Writing13651325
Short-Story Creative Writing86%83.1%
EQ-Bench Creative Writing16271313
WildBench85.7%85.5%
LMArena Multi-Turn14261363

Frequently asked questions

Is GPT-5 better than GPT-5 Mini?

GPT-5 is the stronger model overall, scoring 50.9 to 41.8 on the Noometry Index. GPT-5 Mini costs 5.0× less per token, which makes it the better buy when GPT-5's lead doesn't matter for your workload.

Which is cheaper, GPT-5 or GPT-5 Mini?

GPT-5 Mini is cheaper. It lists at $0.25 per million input tokens and $2 per million output tokens; GPT-5 lists at $1.25 and $10.

Is GPT-5 or GPT-5 Mini better for coding?

GPT-5 scores higher on coding benchmarks: 50.3 versus 40.1 in the Noometry coding category.

Which has the bigger context window?

Both accept 400K tokens.

How many benchmarks do GPT-5 and GPT-5 Mini share?

57 benchmarks have published results for both models. GPT-5 has 69 scored results on Noometry and GPT-5 Mini has 60.

Related comparisons

Go deeper