Noometry

Model comparison

Claude Sonnet 5 vs GPT-4o mini

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 25.5 on the Noometry Index. GPT-4o mini costs 15× less per token, which makes it the better buy when Claude Sonnet 5's lead doesn't matter for your workload.

Last verified . 30 shared benchmarks.

Claude Sonnet 5 Anthropic

54.6

Rank #29 Confirmed

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

Summary

  • They share 30 benchmarks with published results for both. Claude Sonnet 5 scores higher in 10 categories and GPT-4o mini in 0 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.2 to 10.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 94.7% for Claude Sonnet 5 and 6.9% for GPT-4o mini.
  • GPT-4o mini is cheaper at $0.15 / $0.60 per million input/output tokens, against $2 / $10 for Claude Sonnet 5.
  • Claude Sonnet 5 accepts more context: 1M tokens versus 128K.

Side by side

Claude Sonnet 5GPT-4o mini
ProviderAnthropicOpenAI
Noometry Index54.625.5
Released2026-06-292024-07-18
WeightsProprietaryProprietary
Context window1M128K
Max output128K16K
Input $ / M tokens$2$0.15
Output $ / M tokens$10$0.60
Results tracked5160

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude Sonnet 5: 55.5 (#26), GPT-4o mini: 22.0 (#335)

BenchmarkClaude Sonnet 5GPT-4o mini
WeirdML68.8%11.8%
LMArena Coding14831290
DeepSWE53.8%—
FrontierCode42.7%—
Aider Polyglot—3.6%
CursorBench34.1%—
LMArena WebDev1541—
SciCode54.3%—
GSO37.3%—
BigCodeBench Instruct—46.1%
LiveBench Coding—43.1%
BigCodeBench Complete—57.4%
ALE-Bench1,463—
HumanEval+—83.5%
MBPP+—72.2%

Agentic & Tool Use Claude Sonnet 5 leads

Claude Sonnet 5: 42.8 (#18), GPT-4o mini: 27.5 (#101)

BenchmarkClaude Sonnet 5GPT-4o mini
APEX-Agents54.5%—
BALROG—17.4%
GBAEval65.3%—
LMArena Search1194—
Vending-Bench 26,378—

Reasoning Claude Sonnet 5 leads

Claude Sonnet 5: 49.1 (#39), GPT-4o mini: 8.7 (#347)

BenchmarkClaude Sonnet 5GPT-4o mini
SimpleBench60.6%10.7%
Chess Puzzles35%0%
LMArena Hard Prompts14611267
Mystery Game Puzzles35%12%
DTBench92.5%54.4%
LMCA50%10.4%
Epoch Capabilities Index156.21126.56
ARC-AGI-2—0%
Kagi LLM Benchmark—28.8%
NYT Connections (extended)75.1%—
CritPt16.9%—
LiveBench Reasoning—32.8%
LiveBench Data Analysis—50%
Surface Evolver Bench60%—
Bench to the Future 30.14—
ForecastBench61.1—
LiveBench—41.3%
PIQA—88.7%

Math Claude Sonnet 5 leads

Claude Sonnet 5: 66.2 (#27), GPT-4o mini: 10.4 (#314)

BenchmarkClaude Sonnet 5GPT-4o mini
FrontierMath (Tiers 1-3)65.6%0.7%
OTIS Mock AIME 2024-202594.7%6.9%
LMArena Math14671267
FrontierMath Tier 429.3%—
ProofBench77%—
Omni-MATH—28%
LiveBench Math—36.3%
MATH Level 5—52.6%
GSM8K—91.3%

Knowledge Claude Sonnet 5 leads

Claude Sonnet 5: 55.6 (#47), GPT-4o mini: 17.7 (#284)

BenchmarkClaude Sonnet 5GPT-4o mini
GPQA Diamond90.5%37.7%
SimpleQA Verified33.7%8.3%
LMArena Expert14901235
MMLU-Pro—60.3%
Confabulations—37.2%
GPQA (HELM)—36.8%
BoolQ—88.7%
MMLU—81.8%

Multimodal Claude Sonnet 5 leads

Claude Sonnet 5: 42.4 (#31), GPT-4o mini: 25.9 (#122)

BenchmarkClaude Sonnet 5GPT-4o mini
LMArena Vision12741066
Video-MME—64.8%
GeoBench—64%
VPCT—34%
Blueprint-Bench 224.9%—
LMArena Document1466—

Multilingual Claude Sonnet 5 leads

Claude Sonnet 5: 53.8 (#55), GPT-4o mini: 42.0 (#199)

BenchmarkClaude Sonnet 5GPT-4o mini
LMArena Non-English14311266
LMArena Chinese14771265
LMArena French14601297
LMArena German14401272
LMArena Japanese14221216
LMArena Korean14111195
LMArena Russian14511275
LMArena Spanish14371276

Instruction Following Claude Sonnet 5 leads

Claude Sonnet 5: 76.3 (#41), GPT-4o mini: 61.9 (#239)

BenchmarkClaude Sonnet 5GPT-4o mini
LMArena Instruction Following14521258
LiveBench Instruction Following—56.8%
IFEval—78.2%

Long Context Claude Sonnet 5 leads

Claude Sonnet 5: 44.8 (#55), GPT-4o mini: 39.1 (#186)

BenchmarkClaude Sonnet 5GPT-4o mini
LMArena Longer Query14631289

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.2 (#25), GPT-4o mini: 39.5 (#248)

BenchmarkClaude Sonnet 5GPT-4o mini
LMArena Text14421286
LMArena Creative Writing14161268
EQ-Bench Creative Writing1794873
LMArena Multi-Turn14541285
Short-Story Creative Writing—67.2%
WildBench—79.1%
EQ-Bench 41236—
LiveBench Language—28.6%

Frequently asked questions

Is Claude Sonnet 5 better than GPT-4o mini?

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 25.5 on the Noometry Index. GPT-4o mini costs 15× less per token, which makes it the better buy when Claude Sonnet 5's lead doesn't matter for your workload.

Which is cheaper, Claude Sonnet 5 or GPT-4o mini?

GPT-4o mini is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Claude Sonnet 5 lists at $2 and $10.

Is Claude Sonnet 5 or GPT-4o mini better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

Claude Sonnet 5 does, with 1M tokens against 128K.

How many benchmarks do Claude Sonnet 5 and GPT-4o mini share?

30 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and GPT-4o mini has 60.

Related comparisons

Go deeper