Model comparison

DeepSeek-V3 vs Ministral 8B

DeepSeek-V3 is the stronger model overall, scoring 39.2 to 27.8 on the Noometry Index. Ministral 8B costs 4.0× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

DeepSeek-V3 DeepSeek

39.2

Rank #157 Confirmed

Ministral 8B Mistral AI

27.8

Rank #321 Confirmed

Summary

  • They share 16 benchmarks with published results for both. DeepSeek-V3 scores higher in 7 categories and Ministral 8B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where DeepSeek-V3 leads 37.5 to 12.5.
  • The biggest single-benchmark swing is MATH Level 5: 75.5% for DeepSeek-V3 and 14.9% for Ministral 8B.
  • Ministral 8B is cheaper at $0.10 / $0.10 per million input/output tokens, against $0.24 / $0.90 for DeepSeek-V3.
  • DeepSeek-V3 accepts more context: 164K tokens versus 128K.

Side by side

DeepSeek-V3 and Ministral 8B specifications
DeepSeek-V3Ministral 8B
ProviderDeepSeekMistral AI
Noometry Index39.227.8
Released2024-12-262024-10-01
WeightsOpenOpen
Context window164K128K
Max output164K128K
Input $ / M tokens$0.24$0.10
Output $ / M tokens$0.90$0.10
Results tracked6017

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V3 leads

DeepSeek-V3: 41.9 (#99), Ministral 8B: 34.4 (#226)

Coding benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Coding13681202
Aider Polyglot55.1%—
SciCode35.8%—
WeirdML36.1%—
BigCodeBench Instruct50%—
LiveBench Coding70.9%—
BigCodeBench Complete62.2%—
HumanEval+86.6%—
MBPP+73%—

Agentic & Tool Use Not comparable

DeepSeek-V3: —, Ministral 8B: 16.2 (#140)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3Ministral 8B
Berkeley Function Calling Leaderboard—11.1%
METR Time Horizons49.6%—

Reasoning DeepSeek-V3 leads

DeepSeek-V3: 20.0 (#226), Ministral 8B: 17.7 (#279)

Reasoning benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Hard Prompts13651191
DTBench64.8%45.7%
SimpleBench27.2%—
Kagi LLM Benchmark52.3%—
CritPt0%—
LiveBench Reasoning65.8%—
LiveBench Data Analysis60.9%—
LMCA15.5%—
BIG-Bench Hard87.5%—
Epoch Capabilities Index135.95—
ForecastBench59.1—
HellaSwag88.9%—
LiveBench66.9%—
PIQA84.7%—
WinoGrande85.2%—

Math DeepSeek-V3 leads

DeepSeek-V3: 30.4 (#208), Ministral 8B: 23.7 (#262)

Math benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Math13731188
MATH Level 575.5%14.9%
OTIS Mock AIME 2024-202537.8%—
Omni-MATH40.3%—
LiveBench Math73.5%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge DeepSeek-V3 leads

DeepSeek-V3: 37.5 (#147), Ministral 8B: 12.5 (#292)

Knowledge benchmarks
BenchmarkDeepSeek-V3Ministral 8B
GPQA Diamond67.6%27.1%
Vectara Hallucination Rate6.1%7.4%
LMArena Expert13521170
MMLU-Pro72.3%—
Confabulations26.1%—
GPQA (HELM)53.8%—
ARC (AI2) Challenge95.3%—
MMLU87.2%—
TriviaQA82.9%—

Multilingual DeepSeek-V3 leads

DeepSeek-V3: 48.8 (#138), Ministral 8B: 35.3 (#242)

Multilingual benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Non-English13581165
LMArena Chinese13901193
LMArena Russian13721195
LMArena French1386—
LMArena German1374—
LMArena Japanese1333—
LMArena Korean1321—
LMArena Spanish1358—

Instruction Following DeepSeek-V3 leads

DeepSeek-V3: 73.0 (#125), Ministral 8B: 60.7 (#245)

Instruction Following benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Instruction Following13451161
LiveBench Instruction Following81.5%—
IFEval83.2%—

Long Context Ministral 8B leads

DeepSeek-V3: 34.0 (#248), Ministral 8B: 36.7 (#222)

Long Context benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Longer Query13531212
Fiction.LiveBench50%—

Writing & Preference DeepSeek-V3 leads

DeepSeek-V3: 57.6 (#124), Ministral 8B: 39.8 (#241)

Writing & Preference benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Text13751191
LMArena Creative Writing13641175
LMArena Multi-Turn13891166
Short-Story Creative Writing77%—
EQ-Bench Creative Writing1472—
WildBench83%—
LiveBench Language49.1%—

Frequently asked questions

Is DeepSeek-V3 better than Ministral 8B?

DeepSeek-V3 is the stronger model overall, scoring 39.2 to 27.8 on the Noometry Index. Ministral 8B costs 4.0× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-V3 or Ministral 8B?

Ministral 8B is cheaper. It lists at $0.10 per million input tokens and $0.10 per million output tokens; DeepSeek-V3 lists at $0.24 and $0.90.

Is DeepSeek-V3 or Ministral 8B better for coding?

DeepSeek-V3 scores higher on coding benchmarks: 41.9 versus 34.4 in the Noometry coding category.

Which has the bigger context window?

DeepSeek-V3 does, with 164K tokens against 128K.

How many benchmarks do DeepSeek-V3 and Ministral 8B share?

16 benchmarks have published results for both models. DeepSeek-V3 has 60 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper