Noometry

Model comparison

DeepSeek V4.1 Flash vs GPT-5.4 mini

DeepSeek V4.1 Flash is the stronger model overall, scoring 50.3 to 44.8 on the Noometry Index.

Last verified . 24 shared benchmarks.

DeepSeek V4.1 Flash DeepSeek

50.3

Rank #40 Confirmed

GPT-5.4 mini OpenAI

44.8

Rank #69 Confirmed

Summary

  • They share 24 benchmarks with published results for both. DeepSeek V4.1 Flash scores higher in 7 categories and GPT-5.4 mini in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where DeepSeek V4.1 Flash leads 46.2 to 30.3.
  • The biggest single-benchmark swing is ProofBench: 54% for DeepSeek V4.1 Flash and 21% for GPT-5.4 mini.
  • DeepSeek V4.1 Flash is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.75 / $4.50 for GPT-5.4 mini.
  • DeepSeek V4.1 Flash accepts more context: 1M tokens versus 400K.
  • DeepSeek V4.1 Flash has downloadable open weights; the other is API-only.

Side by side

DeepSeek V4.1 FlashGPT-5.4 mini
ProviderDeepSeekOpenAI
Noometry Index50.344.8
Released2026-09-092026-03-17
WeightsOpenProprietary
Context window1M400K
Max output393K128K
Input $ / M tokens$0.15$0.75
Output $ / M tokens$0.60$4.50
Results tracked2546

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 52.8 (#29), GPT-5.4 mini: 45.0 (#67)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena WebDev16201397
SciCode51.9%49.9%
LMArena Coding15111438
ALE-Bench1,0921,189
FrontierCode—27%
WeirdML—60.3%

Agentic & Tool Use Not comparable

DeepSeek V4.1 Flash: —, GPT-5.4 mini: 29.6 (#74)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
DeepResearch Bench—36.3%

Reasoning DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 46.2 (#39), GPT-5.4 mini: 30.3 (#77)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
NYT Connections (extended)89.6%61.8%
CritPt14.3%10%
LMArena Hard Prompts14851424
DTBench89.9%80%
LMCA47%40.8%
Epoch Capabilities Index155.01148.83
ARC-AGI-2—18.9%
Kagi LLM Benchmark—37.9%
ARC-AGI-1—63.7%
Chess Puzzles—24%
Thematic Generalization—61.7%
Mystery Game Puzzles—11%
Surface Evolver Bench46.3%—
ForecastBench—57

Math DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 48.4 (#52), GPT-5.4 mini: 45.4 (#63)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
ProofBench54%21%
LMArena Math14931418
FrontierMath (Tiers 1-3)—51.2%
FrontierMath Tier 4—9.8%
OTIS Mock AIME 2024-2025—88.9%
FrontierMath (Feb 2025 set)—28.3%
FrontierMath Tier 4 (v1)—2.1%

Knowledge GPT-5.4 mini leads

DeepSeek V4.1 Flash: 41.6 (#97), GPT-5.4 mini: 51.4 (#62)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Expert15051434
GPQA Diamond—86.9%
SimpleQA Verified—29.4%
Vectara Hallucination Rate—5.5%

Multimodal Not comparable

DeepSeek V4.1 Flash: —, GPT-5.4 mini: 39.0 (#51)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Vision—1245

Multilingual DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 55.5 (#29), GPT-5.4 mini: 52.1 (#94)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Non-English14521405
LMArena Chinese15061446
LMArena French14481440
LMArena Russian14731417
LMArena Spanish14991403
LMArena German—1407
LMArena Japanese—1375
LMArena Korean—1369

Instruction Following DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 77.6 (#24), GPT-5.4 mini: 74.3 (#99)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Instruction Following14751405

Long Context DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 45.2 (#46), GPT-5.4 mini: 42.9 (#107)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Longer Query14761407

Writing & Preference DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 65.8 (#43), GPT-5.4 mini: 64.2 (#56)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Text14651411
LMArena Creative Writing14361370
EQ-Bench Creative Writing15401665
LMArena Multi-Turn14601429

Frequently asked questions

Is DeepSeek V4.1 Flash better than GPT-5.4 mini?

DeepSeek V4.1 Flash is the stronger model overall, scoring 50.3 to 44.8 on the Noometry Index.

Which is cheaper, DeepSeek V4.1 Flash or GPT-5.4 mini?

DeepSeek V4.1 Flash is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GPT-5.4 mini lists at $0.75 and $4.50.

Is DeepSeek V4.1 Flash or GPT-5.4 mini better for coding?

DeepSeek V4.1 Flash scores higher on coding benchmarks: 52.8 versus 45.0 in the Noometry coding category.

Which has the bigger context window?

DeepSeek V4.1 Flash does, with 1M tokens against 400K.

How many benchmarks do DeepSeek V4.1 Flash and GPT-5.4 mini share?

24 benchmarks have published results for both models. DeepSeek V4.1 Flash has 25 scored results on Noometry and GPT-5.4 mini has 46.

Related comparisons

Go deeper