NVIDIA, open weights
StarCoder 2 7B
StarCoder 2 7B by NVIDIA has 7 published benchmark results on Noometry, not yet enough to be ranked.
Last verified
Specifications
- Noometry rank
- Unranked
- Index score
- Not ranked
- Evidence
- Sparse 7 results
- Provider
NVIDIA- Released
- February 20, 2024
- Weights
- Open weights
- Reasoning
- Unknown
- Context window
- —
- Max output
- —
- Input price
- Not listed
- Output price
- Not listed
- Blended price
- Not listed
- Output speed
- Not measured
- Value
- Not ranked
- Knowledge cutoff
- Unknown
Category scores
Each category score combines every public result we have in that category.
- Coding 34.8
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 34.8 | — | 1 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| BigCodeBench Complete | 27.7% | #62 of 66, top 94% | BigCodeBench | 2024-02-29 | |
| HumanEval+ | 29.9% | #41 of 45, top 92% | EvalPlus |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| Epoch Capabilities Index | 93.56 | #208 of 213, top 98% | Epoch AI | 2024-02-20 | |
| WinoGrande | 57.1% | #41 of 43, top 96% | Epoch AI |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| GSM8K | 32.7% | #31 of 38, top 82% | Epoch AI |
Knowledge
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| ARC (AI2) Challenge | 38.7% | #36 of 39, top 93% | Epoch AI | ||
| MMLU | 38.8% | #75 of 81, top 93% | Epoch AI |
Compare StarCoder 2 7B
- StarCoder 2 7B vs GPT-6 Astra
- StarCoder 2 7B vs Claude Fable 5.1
- StarCoder 2 7B vs Claude Opus 5.5
- StarCoder 2 7B vs Claude Opus 5
- StarCoder 2 7B vs Claude Fable 5
- StarCoder 2 7B vs GPT-6.1 Sol
- StarCoder 2 7B vs Gemini 3.8 Flash
- StarCoder 2 7B vs Kimi K3
- StarCoder 2 7B vs Grok 4.6
- StarCoder 2 7B vs Qwen3.8 Max
- StarCoder 2 7B vs GLM-5.3
- StarCoder 2 7B vs Muse Spark 1.3
- StarCoder 2 7B vs DeepSeek V4 Pro
- StarCoder 2 7B vs MiMo-V2.6-Pro
Frequently asked questions
How good is StarCoder 2 7B?
StarCoder 2 7B by NVIDIA has 7 published benchmark results on Noometry, not yet enough to be ranked.
Is StarCoder 2 7B open source?
Yes. StarCoder 2 7B's weights are downloadable; check the license for commercial terms.