Model comparison

Claude Haiku 4.5 vs DeepSeek-V3

Claude Haiku 4.5 and DeepSeek-V3 score almost the same on the Noometry Index (39.5 vs 39.5), so choose on price, context window or the category you care about most.

Last verified . 34 shared benchmarks.

Claude Haiku 4.5 Anthropic

39.5

Rank #165 Confirmed

DeepSeek-V3 DeepSeek

39.5

Rank #166 Confirmed

Summary

  • They share 34 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 6 categories and DeepSeek-V3 in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Haiku 4.5 leads 44.9 to 32.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 66.7% for Claude Haiku 4.5 and 37.8% for DeepSeek-V3.
  • DeepSeek-V3 is cheaper at $0.24 / $0.90 per million input/output tokens, against $1 / $5 for Claude Haiku 4.5.
  • Claude Haiku 4.5 accepts more context: 200K tokens versus 164K.
  • DeepSeek-V3 has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 4.5 and DeepSeek-V3 specifications
Claude Haiku 4.5DeepSeek-V3
ProviderAnthropicDeepSeek
Noometry Index39.539.5
Released2025-10-152024-12-26
WeightsProprietaryOpen
Context window200K164K
Max output64K164K
Input $ / M tokens$1$0.24
Output $ / M tokens$5$0.90
Results tracked5360

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.0 (#78), DeepSeek-V3: 42.3 (#106)

Coding benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
SciCode43.3%35.8%
WeirdML45.4%36.1%
LMArena Coding14531368
SWE-bench Verified (bash only)66.6%—
Aider Polyglot—55.1%
LMArena WebDev1330—
SWE-bench Multilingual64.7%—
BigCodeBench Instruct—50%
LiveBench Coding—70.9%
BigCodeBench Complete—62.2%
ALE-Bench653.48—
HumanEval+—86.6%
MBPP+—73%

Agentic & Tool Use Not comparable

Claude Haiku 4.5: 33.6 (#52), DeepSeek-V3: —

Agentic & Tool Use benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
Terminal-Bench35.5%—
Berkeley Function Calling Leaderboard68.7%—
DeepResearch Bench45.5%—
BALROG31.2%—
ExploitBench13.7%—
METR Time Horizons—49.6%
Vending-Bench 2458.89—

Reasoning DeepSeek-V3 leads

Claude Haiku 4.5: 15.1 (#320), DeepSeek-V3: 20.5 (#236)

Reasoning benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
CritPt0%0%
LMArena Hard Prompts14201365
DTBench73.6%64.8%
LMCA30.9%15.5%
Epoch Capabilities Index142.41135.94
ForecastBench61.459.1
ARC-AGI-24%—
SimpleBench—27.2%
Kagi LLM Benchmark—52.3%
NYT Connections (extended)14.3%—
ARC-AGI-147.7%—
Chess Puzzles8%—
LiveBench Reasoning—65.8%
LiveBench Data Analysis—60.9%
BIG-Bench Hard—87.5%
HellaSwag—88.9%
LiveBench—66.9%
PIQA—84.7%
WinoGrande—85.2%

Math Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.9 (#78), DeepSeek-V3: 32.1 (#219)

Math benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
OTIS Mock AIME 2024-202566.7%37.8%
Omni-MATH56.1%40.3%
LMArena Math13961373
MATH Level 596.4%75.5%
FrontierMath (Feb 2025 set)5.9%1.7%
LiveBench Math—73.5%
FrontierMath Tier 4 (v1)2.1%—

Knowledge Too close to call

Claude Haiku 4.5: 37.7 (#153), DeepSeek-V3: 37.5 (#155)

Knowledge benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
GPQA Diamond71.2%67.6%
MMLU-Pro77.7%72.3%
Vectara Hallucination Rate9.8%6.1%
GPQA (HELM)60.5%53.8%
LMArena Expert14421351
SimpleQA Verified13.2%—
Confabulations—26.1%
ARC (AI2) Challenge—95.3%
MMLU—87.2%
TriviaQA—82.9%

Multimodal Not comparable

Claude Haiku 4.5: 26.8 (#118), DeepSeek-V3: —

Multimodal benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
Blueprint-Bench 20%—
LMArena Document1420—

Multilingual Claude Haiku 4.5 leads

Claude Haiku 4.5: 49.9 (#129), DeepSeek-V3: 48.5 (#143)

Multilingual benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
LMArena Non-English13771358
LMArena Chinese14171391
LMArena French14081385
LMArena German13751374
LMArena Japanese13391333
LMArena Korean13471319
LMArena Russian13811373
LMArena Spanish14201358

Instruction Following DeepSeek-V3 leads

Claude Haiku 4.5: 71.4 (#149), DeepSeek-V3: 72.8 (#130)

Instruction Following benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
IFEval80.1%83.2%
LMArena Instruction Following14141345
LiveBench Instruction Following—81.5%

Long Context Claude Haiku 4.5 leads

Claude Haiku 4.5: 43.6 (#92), DeepSeek-V3: 34.0 (#253)

Long Context benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
LMArena Longer Query14271352
Fiction.LiveBench—50%

Writing & Preference Too close to call

Claude Haiku 4.5: 57.9 (#123), DeepSeek-V3: 57.4 (#130)

Writing & Preference benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
LMArena Text13961375
LMArena Creative Writing13721364
WildBench83.9%83%
LMArena Multi-Turn14091389
Short-Story Creative Writing—77%
EQ-Bench Creative Writing—1472
EQ-Bench 41064—
LiveBench Language—49.1%

Frequently asked questions

Is Claude Haiku 4.5 better than DeepSeek-V3?

Claude Haiku 4.5 and DeepSeek-V3 score almost the same on the Noometry Index (39.5 vs 39.5), so choose on price, context window or the category you care about most.

Which is cheaper, Claude Haiku 4.5 or DeepSeek-V3?

DeepSeek-V3 is cheaper. It lists at $0.24 per million input tokens and $0.90 per million output tokens; Claude Haiku 4.5 lists at $1 and $5.

Is Claude Haiku 4.5 or DeepSeek-V3 better for coding?

Claude Haiku 4.5 scores higher on coding benchmarks: 44.0 versus 42.3 in the Noometry coding category.

Which has the bigger context window?

Claude Haiku 4.5 does, with 200K tokens against 164K.

How many benchmarks do Claude Haiku 4.5 and DeepSeek-V3 share?

34 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and DeepSeek-V3 has 60.

Related comparisons

Go deeper