Noometry

Model comparison

DeepSeek V4 Pro vs GPT-4o mini

DeepSeek V4 Pro is the stronger model overall, scoring 54.3 to 25.5 on the Noometry Index. GPT-4o mini costs 3.8× less per token, which makes it the better buy when DeepSeek V4 Pro's lead doesn't matter for your workload.

Last verified . 30 shared benchmarks.

DeepSeek V4 Pro DeepSeek

54.3

Rank #31 Confirmed

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

Summary

  • They share 30 benchmarks with published results for both. DeepSeek V4 Pro scores higher in 9 categories and GPT-4o mini in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek V4 Pro leads 64.8 to 10.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 98.6% for DeepSeek V4 Pro and 6.9% for GPT-4o mini.
  • GPT-4o mini is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.66 / $1.98 for DeepSeek V4 Pro.
  • DeepSeek V4 Pro accepts more context: 1M tokens versus 128K.
  • DeepSeek V4 Pro has downloadable open weights; the other is API-only.

Side by side

DeepSeek V4 ProGPT-4o mini
ProviderDeepSeekOpenAI
Noometry Index54.325.5
Released2026-04-242024-07-18
WeightsOpenProprietary
Context window1M128K
Max output393K16K
Input $ / M tokens$0.66$0.15
Output $ / M tokens$1.98$0.60
Results tracked4860

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4 Pro leads

DeepSeek V4 Pro: 52.4 (#34), GPT-4o mini: 22.0 (#335)

BenchmarkDeepSeek V4 ProGPT-4o mini
WeirdML66.2%11.8%
LMArena Coding14701290
SWE-bench Verified77.6%—
FrontierCode28.6%—
Aider Polyglot—3.6%
LMArena WebDev1582—
SciCode51%—
BigCodeBench Instruct—46.1%
LiveBench Coding—43.1%
BigCodeBench Complete—57.4%
ALE-Bench1,403—
HumanEval+—83.5%
MBPP+—72.2%

Agentic & Tool Use DeepSeek V4 Pro leads

DeepSeek V4 Pro: 32.8 (#58), GPT-4o mini: 27.5 (#101)

BenchmarkDeepSeek V4 ProGPT-4o mini
APEX-Agents47.3%—
BALROG—17.4%
Vending-Bench 23,285—

Reasoning DeepSeek V4 Pro leads

DeepSeek V4 Pro: 56.5 (#24), GPT-4o mini: 8.7 (#347)

BenchmarkDeepSeek V4 ProGPT-4o mini
ARC-AGI-261.3%0%
Kagi LLM Benchmark53.5%28.8%
Chess Puzzles47%0%
LMArena Hard Prompts14611267
Mystery Game Puzzles43%12%
DTBench93.9%54.4%
LMCA45.5%10.4%
Epoch Capabilities Index155.31126.56
SimpleBench—10.7%
NYT Connections (extended)91.3%—
ARC-AGI-190.5%—
CritPt18%—
LiveBench Reasoning—32.8%
LiveBench Data Analysis—50%
Surface Evolver Bench40%—
ForecastBench56.1—
LiveBench—41.3%
PIQA—88.7%

Math DeepSeek V4 Pro leads

DeepSeek V4 Pro: 64.8 (#30), GPT-4o mini: 10.4 (#314)

BenchmarkDeepSeek V4 ProGPT-4o mini
FrontierMath (Tiers 1-3)64.6%0.7%
OTIS Mock AIME 2024-202598.6%6.9%
LMArena Math14551267
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions76.6%—
ProofBench50%—
Omni-MATH—28%
LiveBench Math—36.3%
MATH Level 5—52.6%
GSM8K—91.3%

Knowledge DeepSeek V4 Pro leads

DeepSeek V4 Pro: 59.5 (#31), GPT-4o mini: 17.7 (#284)

BenchmarkDeepSeek V4 ProGPT-4o mini
GPQA Diamond91.7%37.7%
SimpleQA Verified52.9%8.3%
LMArena Expert14641235
MMLU-Pro—60.3%
Confabulations—37.2%
Vectara Hallucination Rate8.6%—
GPQA (HELM)—36.8%
BoolQ—88.7%
MMLU—81.8%

Multimodal Not comparable

DeepSeek V4 Pro: —, GPT-4o mini: 25.9 (#122)

BenchmarkDeepSeek V4 ProGPT-4o mini
LMArena Vision—1066
Video-MME—64.8%
GeoBench—64%
VPCT—34%

Multilingual DeepSeek V4 Pro leads

DeepSeek V4 Pro: 54.4 (#45), GPT-4o mini: 42.0 (#199)

BenchmarkDeepSeek V4 ProGPT-4o mini
LMArena Non-English14391266
LMArena Chinese14861265
LMArena French14721297
LMArena German14581272
LMArena Japanese14451216
LMArena Korean14471195
LMArena Russian14531275
LMArena Spanish14581276

Instruction Following DeepSeek V4 Pro leads

DeepSeek V4 Pro: 76.1 (#47), GPT-4o mini: 61.9 (#239)

BenchmarkDeepSeek V4 ProGPT-4o mini
LMArena Instruction Following14481258
LiveBench Instruction Following—56.8%
IFEval—78.2%

Long Context DeepSeek V4 Pro leads

DeepSeek V4 Pro: 45.0 (#51), GPT-4o mini: 39.1 (#186)

BenchmarkDeepSeek V4 ProGPT-4o mini
LMArena Longer Query14581289
CL-bench Life13.5%—

Writing & Preference DeepSeek V4 Pro leads

DeepSeek V4 Pro: 65.5 (#46), GPT-4o mini: 39.5 (#248)

BenchmarkDeepSeek V4 ProGPT-4o mini
LMArena Text14511286
LMArena Creative Writing14461268
EQ-Bench Creative Writing1553873
LMArena Multi-Turn14671285
Short-Story Creative Writing—67.2%
WildBench—79.1%
EQ-Bench 41166—
LiveBench Language—28.6%

Frequently asked questions

Is DeepSeek V4 Pro better than GPT-4o mini?

DeepSeek V4 Pro is the stronger model overall, scoring 54.3 to 25.5 on the Noometry Index. GPT-4o mini costs 3.8× less per token, which makes it the better buy when DeepSeek V4 Pro's lead doesn't matter for your workload.

Which is cheaper, DeepSeek V4 Pro or GPT-4o mini?

GPT-4o mini is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; DeepSeek V4 Pro lists at $0.66 and $1.98.

Is DeepSeek V4 Pro or GPT-4o mini better for coding?

DeepSeek V4 Pro scores higher on coding benchmarks: 52.4 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

DeepSeek V4 Pro does, with 1M tokens against 128K.

How many benchmarks do DeepSeek V4 Pro and GPT-4o mini share?

30 benchmarks have published results for both models. DeepSeek V4 Pro has 48 scored results on Noometry and GPT-4o mini has 60.

Related comparisons

Go deeper