Model comparison

DeepSeek-V2.5 (Sep 2024) vs MiMo-V2-Flash

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 37.6 on the Noometry Index.

Last verified . 17 shared benchmarks.

DeepSeek-V2.5 (Sep 2024) DeepSeek

37.6

Rank #200 Confirmed

MiMo-V2-Flash Xiaomi

41.3

Rank #138 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DeepSeek-V2.5 (Sep 2024) scores higher in 1 category and MiMo-V2-Flash in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2-Flash leads 59.7 to 49.8.

Side by side

DeepSeek-V2.5 (Sep 2024) and MiMo-V2-Flash specifications
DeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
ProviderDeepSeekXiaomi
Noometry Index37.641.3
Released2024-09-062025-12-16
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked2221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2-Flash leads

DeepSeek-V2.5 (Sep 2024): 31.7 (#281), MiMo-V2-Flash: 36.1 (#211)

Coding benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Coding13091443
Aider Polyglot17.8%—
LMArena WebDev—1330
SciCode—25.9%
BigCodeBench Instruct48.6%—
BigCodeBench Complete53.2%—
ALE-Bench—737.95
HumanEval+83.5%—
MBPP+74.1%—

Reasoning Too close to call

DeepSeek-V2.5 (Sep 2024): 25.6 (#145), MiMo-V2-Flash: 24.9 (#157)

Reasoning benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Hard Prompts12891420
CritPt—0%

Math MiMo-V2-Flash leads

DeepSeek-V2.5 (Sep 2024): 35.9 (#177), MiMo-V2-Flash: 38.3 (#139)

Math benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Math12881396

Knowledge MiMo-V2-Flash leads

DeepSeek-V2.5 (Sep 2024): 34.8 (#193), MiMo-V2-Flash: 39.7 (#131)

Knowledge benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Expert12661425

Multilingual MiMo-V2-Flash leads

DeepSeek-V2.5 (Sep 2024): 42.5 (#193), MiMo-V2-Flash: 51.0 (#113)

Multilingual benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Non-English12731392
LMArena Chinese13181462
LMArena French12891429
LMArena German12581395
LMArena Japanese12281325
LMArena Korean12091358
LMArena Russian12891387
LMArena Spanish12481420

Instruction Following MiMo-V2-Flash leads

DeepSeek-V2.5 (Sep 2024): 67.5 (#194), MiMo-V2-Flash: 73.5 (#120)

Instruction Following benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Instruction Following12801392

Long Context MiMo-V2-Flash leads

DeepSeek-V2.5 (Sep 2024): 39.5 (#174), MiMo-V2-Flash: 43.0 (#110)

Long Context benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Longer Query13011409

Writing & Preference MiMo-V2-Flash leads

DeepSeek-V2.5 (Sep 2024): 49.8 (#187), MiMo-V2-Flash: 59.7 (#106)

Writing & Preference benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiMo-V2-Flash
LMArena Text12941411
LMArena Creative Writing12851375
LMArena Multi-Turn12971404

Frequently asked questions

Is DeepSeek-V2.5 (Sep 2024) better than MiMo-V2-Flash?

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 37.6 on the Noometry Index.

Is DeepSeek-V2.5 (Sep 2024) or MiMo-V2-Flash better for coding?

MiMo-V2-Flash scores higher on coding benchmarks: 36.1 versus 31.7 in the Noometry coding category.

How many benchmarks do DeepSeek-V2.5 (Sep 2024) and MiMo-V2-Flash share?

17 benchmarks have published results for both models. DeepSeek-V2.5 (Sep 2024) has 22 scored results on Noometry and MiMo-V2-Flash has 21.

Related comparisons

Go deeper