DeepSeek, open weights

DeepSeek Coder 1.3B

DeepSeek Coder 1.3B by DeepSeek has 9 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Specifications

Noometry rank
Unranked
Index score
Not ranked
Evidence
Sparse 9 results
Provider
DeepSeek
Released
November 2, 2023
Weights
Open weights
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Category scores

Each category score combines every public result we have in that category.

DeepSeek Coder 1.3B category scores
  1. Coding 31.2
DeepSeek Coder 1.3B category ranks
CategoryScoreRankResults
Coding31.2#2872

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Coding

DeepSeek Coder 1.3B Coding benchmark results
BenchmarkScorePositionSettingSourceDate
BigCodeBench Instruct22.8%#60 of 64, top 94%BigCodeBench2023-10-28
BigCodeBench Complete29.6%#60 of 66, top 91%BigCodeBench2023-10-28
BigCodeBench Complete22.2%BigCodeBench2023-10-28
HumanEval+60.4%#28 of 45, top 63%EvalPlus
HumanEval+25.6%EvalPlus
MBPP+47.9%EvalPlus
MBPP+54.8%#29 of 38, top 77%EvalPlus

Reasoning

DeepSeek Coder 1.3B Reasoning benchmark results
BenchmarkScorePositionSettingSourceDate
Epoch Capabilities Index63.6#213 of 213, top 100%Epoch AI2023-11-02
WinoGrande53.3%#43 of 43, top 100%Epoch AI

Math

DeepSeek Coder 1.3B Math benchmark results
BenchmarkScorePositionSettingSourceDate
GSM8K4.4%#38 of 38, top 100%Epoch AI

Knowledge

DeepSeek Coder 1.3B Knowledge benchmark results
BenchmarkScorePositionSettingSourceDate
ARC (AI2) Challenge25.4%#39 of 39, top 100%Epoch AI
MMLU25.8%#81 of 81, top 100%Epoch AI

Compare DeepSeek Coder 1.3B

Other DeepSeek models

Frequently asked questions

How good is DeepSeek Coder 1.3B?

DeepSeek Coder 1.3B by DeepSeek has 9 published benchmark results on Noometry, not yet enough to be ranked.

Is DeepSeek Coder 1.3B open source?

Yes. DeepSeek Coder 1.3B's weights are downloadable; check the license for commercial terms.