Noometry

DeepSeek, open weights

DeepSeek-V2 (MoE-236B, May 2024)

DeepSeek-V2 (MoE-236B, May 2024) by DeepSeek has 10 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Noometry rank
Unranked
Index score
Not ranked
Evidence
Sparse 10 results
Provider
DeepSeek
Released
May 7, 2024
Weights
Open weights
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Category scores

Each category score combines every public result we have in that category.

  1. Coding 40.4
CategoryScoreRankResults
Coding40.4#1392

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Coding

BenchmarkScorePositionSettingSourceDate
BigCodeBench Instruct48.9%#5 of 64, top 8%2024-06-28BigCodeBench2024-06-28
BigCodeBench Complete59.4%#6 of 66, top 10%2024-06-28BigCodeBench2024-06-28

Reasoning

BenchmarkScorePositionSettingSourceDate
BIG-Bench Hard78.8%#7 of 27, top 26%Epoch AI
Epoch Capabilities Index124.77#158 of 213, top 75%Epoch AI2024-05-07
HellaSwag87.1%#6 of 29, top 21%Epoch AI
PIQA83.9%#7 of 27, top 26%Epoch AI
WinoGrande86.3%#6 of 43, top 14%Epoch AI

Knowledge

BenchmarkScorePositionSettingSourceDate
ARC (AI2) Challenge92.2%#4 of 39, top 11%Epoch AI
MMLU78.4%#24 of 81, top 30%Epoch AI
TriviaQA80%#10 of 25, top 40%Epoch AI

Compare DeepSeek-V2 (MoE-236B, May 2024)

Other DeepSeek models

Frequently asked questions

How good is DeepSeek-V2 (MoE-236B, May 2024)?

DeepSeek-V2 (MoE-236B, May 2024) by DeepSeek has 10 published benchmark results on Noometry, not yet enough to be ranked.

Is DeepSeek-V2 (MoE-236B, May 2024) open source?

Yes. DeepSeek-V2 (MoE-236B, May 2024)'s weights are downloadable; check the license for commercial terms.