DeepSeek, open weights
DeepSeek-V2.5 (Sep 2024)
DeepSeek-V2.5 (Sep 2024) by DeepSeek ranks 200th of 354 ranked models on the Noometry Index as of October 2026, with a score of 37.6. Its strongest category is reasoning, where it ranks 145th.
Last verified
Specifications
- Noometry rank
- #200 of 354
- Index score
- 37.6
- Evidence
- Confirmed 22 results
- Provider
DeepSeek
- Released
- September 6, 2024
- Weights
- Open weights
- Reasoning
- Unknown
- Context window
- —
- Max output
- —
- Input price
- Not listed
- Output price
- Not listed
- Blended price
- Not listed
- Output speed
- Not measured
- Value
- Not ranked
- Knowledge cutoff
- Unknown
Category scores
Each category score combines every public result we have in that category.
- Coding 31.7
- Reasoning 25.6
- Math 35.9
- Knowledge 34.8
- Multilingual 42.5
- Instruction Following 67.5
- Long Context 39.5
- Writing & Preference 49.8
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 31.7 | #281 | 4 |
| Reasoning | 25.6 | #145 | 1 |
| Math | 35.9 | #177 | 1 |
| Knowledge | 34.8 | #193 | 1 |
| Multilingual | 42.5 | #193 | 1 |
| Instruction Following | 67.5 | #194 | 1 |
| Long Context | 39.5 | #174 | 1 |
| Writing & Preference | 49.8 | #187 | 3 |
Strengths and weaknesses
Categories where DeepSeek-V2.5 (Sep 2024) places highest and lowest among the models ranked in each, with its score against that category's median.
Strongest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Reasoning | 25.6 | +2.0 | #145 of 350, top 42% |
| Math | 35.9 | −0.6 | #177 of 327, top 55% |
| Long Context | 39.5 | −1.4 | #174 of 296, top 59% |
Weakest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Coding | 31.7 | −7.0 | #281 of 340, top 83% |
| Multilingual | 42.5 | −4.9 | #193 of 297, top 65% |
| Instruction Following | 67.5 | −3.8 | #194 of 305, top 64% |
Closest competitors
The models ranked just above and below DeepSeek-V2.5 (Sep 2024). When scores are this close, price and speed are often the better way to choose.
| Model | Rank | Score | Blended $/M | Speed | |
|---|---|---|---|---|---|
| MiniMax-M2.7 | #196 | 37.7 | $0.52 | — | Compare |
| Gemini Advanced 0514 | #197 | 37.7 | — | — | Compare |
| Grok 2 Mini 2024 08 13 | #198 | 37.7 | — | — | Compare |
| Mercury | #199 | 37.6 | — | 35 | Compare |
| Qwen3.6 35B-A3B | #201 | 37.6 | $0.56 | — | Compare |
| Hunyuan Large Vision | #202 | 37.6 | — | — | Compare |
| Llama 3.1 Nemotron 70b Instruct | #203 | 37.6 | — | — | Compare |
| MiniMax-M2 | #204 | 37.4 | $0.52 | 17 | Compare |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| Aider Polyglot | 17.8% | #36 of 44, top 82% | Epoch AI | ||
| BigCodeBench Instruct | 48.6% | #7 of 64, top 11% | BigCodeBench | 2024-12-10 | |
| LMArena Coding | 1301 | LMArena | 2026-10-08 | ||
| LMArena Coding | 1309 | #192 of 294, top 66% | LMArena | 2026-10-08 | |
| BigCodeBench Complete | 53.2% | #25 of 66, top 38% | BigCodeBench | 2024-12-10 | |
| HumanEval+ | 83.5% | #7 of 45, top 16% | nov 2024 | EvalPlus | |
| MBPP+ | 74.1% | #7 of 38, top 19% | nov 2024 | EvalPlus |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Hard Prompts | 1289 | #193 of 297, top 65% | LMArena | 2026-10-08 | |
| LMArena Hard Prompts | 1270 | LMArena | 2026-10-08 |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Math | 1271 | LMArena | 2026-10-08 | ||
| LMArena Math | 1288 | #187 of 285, top 66% | LMArena | 2026-10-08 |
Knowledge
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Expert | 1266 | #188 of 273, top 69% | LMArena | 2026-10-08 | |
| LMArena Expert | 1240 | LMArena | 2026-10-08 |
Multilingual
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Non-English | 1273 | #193 of 297, top 65% | LMArena | 2026-10-08 | |
| LMArena Non-English | 1253 | LMArena | 2026-10-08 | ||
| LMArena Chinese | 1281 | LMArena | 2026-10-08 | ||
| LMArena Chinese | 1318 | #182 of 285, top 64% | LMArena | 2026-10-08 | |
| LMArena French | 1289 | #166 of 223, top 75% | LMArena | 2026-10-08 | |
| LMArena German | 1258 | #172 of 231, top 75% | LMArena | 2026-10-08 | |
| LMArena German | 1226 | LMArena | 2026-10-08 | ||
| LMArena Japanese | 1228 | #147 of 211, top 70% | LMArena | 2026-10-08 | |
| LMArena Japanese | 1190 | LMArena | 2026-10-08 | ||
| LMArena Korean | 1209 | #155 of 213, top 73% | LMArena | 2026-10-08 | |
| LMArena Russian | 1253 | LMArena | 2026-10-08 | ||
| LMArena Russian | 1289 | #181 of 283, top 64% | LMArena | 2026-10-08 | |
| LMArena Spanish | 1248 | #183 of 226, top 81% | LMArena | 2026-10-08 |
Instruction Following
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Instruction Following | 1280 | #187 of 298, top 63% | LMArena | 2026-10-08 | |
| LMArena Instruction Following | 1249 | LMArena | 2026-10-08 |
Long Context
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Longer Query | 1273 | LMArena | 2026-10-08 | ||
| LMArena Longer Query | 1301 | #187 of 291, top 65% | LMArena | 2026-10-08 |
Writing & Preference
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Text | 1294 | #194 of 297, top 66% | LMArena | 2026-10-08 | |
| LMArena Text | 1271 | LMArena | 2026-10-08 | ||
| LMArena Creative Writing | 1237 | LMArena | 2026-10-08 | ||
| LMArena Creative Writing | 1285 | #183 of 295, top 63% | LMArena | 2026-10-08 | |
| LMArena Multi-Turn | 1261 | LMArena | 2026-10-08 | ||
| LMArena Multi-Turn | 1297 | #190 of 295, top 65% | LMArena | 2026-10-08 |
Compare DeepSeek-V2.5 (Sep 2024)
- DeepSeek-V2.5 (Sep 2024) vs Mercury
- DeepSeek-V2.5 (Sep 2024) vs Qwen3.6 35B-A3B
- DeepSeek-V2.5 (Sep 2024) vs Grok 2 Mini 2024 08 13
- DeepSeek-V2.5 (Sep 2024) vs Hunyuan Large Vision
- DeepSeek-V2.5 (Sep 2024) vs Gemini Advanced 0514
- DeepSeek-V2.5 (Sep 2024) vs Llama 3.1 Nemotron 70b Instruct
- DeepSeek-V2.5 (Sep 2024) vs GPT-6 Astra
- DeepSeek-V2.5 (Sep 2024) vs Claude Fable 5.1
- DeepSeek-V2.5 (Sep 2024) vs Gemini 3.8 Flash
- DeepSeek-V2.5 (Sep 2024) vs Kimi K3
- DeepSeek-V2.5 (Sep 2024) vs Grok 4.6
- DeepSeek-V2.5 (Sep 2024) vs Qwen3.8 Max
- DeepSeek-V2.5 (Sep 2024) vs GLM-5.3
- DeepSeek-V2.5 (Sep 2024) vs Muse Spark 1.3
Other DeepSeek models
Frequently asked questions
How good is DeepSeek-V2.5 (Sep 2024)?
DeepSeek-V2.5 (Sep 2024) by DeepSeek ranks 200th of 354 ranked models on the Noometry Index as of October 2026, with a score of 37.6. Its strongest category is reasoning, where it ranks 145th.
Is DeepSeek-V2.5 (Sep 2024) open source?
Yes. DeepSeek-V2.5 (Sep 2024)'s weights are downloadable; check the license for commercial terms.
What are DeepSeek-V2.5 (Sep 2024)'s strengths and weaknesses?
Relative to other ranked models, DeepSeek-V2.5 (Sep 2024) places best in reasoning, math, long context and lowest in coding, multilingual, instruction following.
What is DeepSeek-V2.5 (Sep 2024) best at?
Its best category is reasoning, where it ranks 145th on Noometry.