NVIDIA, open weights
StarCoder 2 3B
StarCoder 2 3B by NVIDIA has 7 published benchmark results on Noometry, not yet enough to be ranked.
Last verified
Specifications
- Noometry rank
- Unranked
- Index score
- Not ranked
- Evidence
- Sparse 7 results
- Provider
NVIDIA- Released
- February 22, 2024
- Weights
- Open weights
- Reasoning
- Unknown
- Context window
- —
- Max output
- —
- Input price
- Not listed
- Output price
- Not listed
- Blended price
- Not listed
- Output speed
- Not measured
- Value
- Not ranked
- Knowledge cutoff
- Unknown
Category scores
Each category score combines every public result we have in that category.
- Coding 33.5
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 33.5 | — | 1 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| BigCodeBench Complete | 21.4% | #64 of 66, top 97% | BigCodeBench | 2024-02-29 | |
| HumanEval+ | 27.4% | #43 of 45, top 96% | EvalPlus |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| Epoch Capabilities Index | 88.76 | #212 of 213, top 100% | Epoch AI | 2024-02-22 | |
| WinoGrande | 57.1% | #40 of 43, top 94% | Epoch AI |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| GSM8K | 21.6% | #32 of 38, top 85% | Epoch AI |
Knowledge
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| ARC (AI2) Challenge | 34.2% | #38 of 39, top 98% | Epoch AI | ||
| MMLU | 36.6% | #77 of 81, top 96% | Epoch AI |
Compare StarCoder 2 3B
- StarCoder 2 3B vs GPT-6 Astra
- StarCoder 2 3B vs Claude Fable 5.1
- StarCoder 2 3B vs Claude Opus 5.5
- StarCoder 2 3B vs Claude Opus 5
- StarCoder 2 3B vs Claude Fable 5
- StarCoder 2 3B vs GPT-6.1 Sol
- StarCoder 2 3B vs Gemini 3.8 Flash
- StarCoder 2 3B vs Kimi K3
- StarCoder 2 3B vs Grok 4.6
- StarCoder 2 3B vs Qwen3.8 Max
- StarCoder 2 3B vs GLM-5.3
- StarCoder 2 3B vs Muse Spark 1.3
- StarCoder 2 3B vs DeepSeek V4 Pro
- StarCoder 2 3B vs MiMo-V2.6-Pro
Frequently asked questions
How good is StarCoder 2 3B?
StarCoder 2 3B by NVIDIA has 7 published benchmark results on Noometry, not yet enough to be ranked.
Is StarCoder 2 3B open source?
Yes. StarCoder 2 3B's weights are downloadable; check the license for commercial terms.