Model comparison

DeepSeek-V2.5 (Sep 2024) vs MiniMax-M2.7

DeepSeek-V2.5 (Sep 2024) and MiniMax-M2.7 score almost the same on the Noometry Index (37.6 vs 37.7), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

DeepSeek-V2.5 (Sep 2024) DeepSeek

37.6

Rank #200 Confirmed

MiniMax-M2.7 MiniMax

37.7

Rank #196 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DeepSeek-V2.5 (Sep 2024) scores higher in 2 categories and MiniMax-M2.7 in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where MiniMax-M2.7 leads 41.8 to 31.7.

Side by side

DeepSeek-V2.5 (Sep 2024) and MiniMax-M2.7 specifications
DeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
ProviderDeepSeekMiniMax
Noometry Index37.637.7
Released2024-09-062026-03-18
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked2230

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.7 leads

DeepSeek-V2.5 (Sep 2024): 31.7 (#281), MiniMax-M2.7: 41.8 (#120)

Coding benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Coding13091454
Aider Polyglot17.8%—
LMArena WebDev—1398
SciCode—47%
WeirdML—37%
BigCodeBench Instruct48.6%—
BigCodeBench Complete53.2%—
ALE-Bench—599.25
HumanEval+83.5%—
MBPP+74.1%—

Agentic & Tool Use Not comparable

DeepSeek-V2.5 (Sep 2024): —, MiniMax-M2.7: 25.1 (#111)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
Terminal-Bench—45.1%
ExploitBench—13.3%
GBAEval—0%

Reasoning DeepSeek-V2.5 (Sep 2024) leads

DeepSeek-V2.5 (Sep 2024): 25.6 (#145), MiniMax-M2.7: 19.7 (#253)

Reasoning benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Hard Prompts12891422
NYT Connections (extended)—24.7%
CritPt—0.6%
Thematic Generalization—39.3%
Epoch Capabilities Index—145.85

Math DeepSeek-V2.5 (Sep 2024) leads

DeepSeek-V2.5 (Sep 2024): 35.9 (#177), MiniMax-M2.7: 25.9 (#263)

Math benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Math12881420
ProofBench—3%

Knowledge MiniMax-M2.7 leads

DeepSeek-V2.5 (Sep 2024): 34.8 (#193), MiniMax-M2.7: 37.7 (#152)

Knowledge benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Expert12661444
Vectara Hallucination Rate—12.9%

Multilingual MiniMax-M2.7 leads

DeepSeek-V2.5 (Sep 2024): 42.5 (#193), MiniMax-M2.7: 50.3 (#123)

Multilingual benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Non-English12731382
LMArena Chinese13181441
LMArena French12891421
LMArena German12581398
LMArena Japanese12281262
LMArena Korean12091313
LMArena Russian12891383
LMArena Spanish12481403

Instruction Following MiniMax-M2.7 leads

DeepSeek-V2.5 (Sep 2024): 67.5 (#194), MiniMax-M2.7: 74.1 (#103)

Instruction Following benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Instruction Following12801405

Long Context MiniMax-M2.7 leads

DeepSeek-V2.5 (Sep 2024): 39.5 (#174), MiniMax-M2.7: 43.3 (#99)

Long Context benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Longer Query13011419

Writing & Preference MiniMax-M2.7 leads

DeepSeek-V2.5 (Sep 2024): 49.8 (#187), MiniMax-M2.7: 58.9 (#112)

Writing & Preference benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)MiniMax-M2.7
LMArena Text12941405
LMArena Creative Writing12851354
LMArena Multi-Turn12971412

Frequently asked questions

Is DeepSeek-V2.5 (Sep 2024) better than MiniMax-M2.7?

DeepSeek-V2.5 (Sep 2024) and MiniMax-M2.7 score almost the same on the Noometry Index (37.6 vs 37.7), so choose on price, context window or the category you care about most.

Is DeepSeek-V2.5 (Sep 2024) or MiniMax-M2.7 better for coding?

MiniMax-M2.7 scores higher on coding benchmarks: 41.8 versus 31.7 in the Noometry coding category.

How many benchmarks do DeepSeek-V2.5 (Sep 2024) and MiniMax-M2.7 share?

17 benchmarks have published results for both models. DeepSeek-V2.5 (Sep 2024) has 22 scored results on Noometry and MiniMax-M2.7 has 30.

Related comparisons

Go deeper