Model comparison

GPT-5.2 Pro vs StarCoder 2 15B

GPT-5.2 Pro has enough public results to be ranked (#39); StarCoder 2 15B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

GPT-5.2 Pro OpenAI

52.3

Rank #39 Reported

StarCoder 2 15B NVIDIA

38.1

Unranked Sparse

Summary

  • They share 1 benchmark with published results for both.
  • StarCoder 2 15B has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 Pro and StarCoder 2 15B specifications
GPT-5.2 ProStarCoder 2 15B
ProviderOpenAINVIDIA
Noometry Index52.338.1
Released2025-12-112024-02-20
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$21—
Output $ / M tokens$168—
Results tracked87

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.2 Pro: —, StarCoder 2 15B: 36.6

Coding benchmarks
BenchmarkGPT-5.2 ProStarCoder 2 15B
BigCodeBench Complete—38.4%
HumanEval+—37.8%

Reasoning Not comparable

GPT-5.2 Pro: 51.5 (#33), StarCoder 2 15B: —

Reasoning benchmarks
BenchmarkGPT-5.2 ProStarCoder 2 15B
Epoch Capabilities Index155.4105
ARC-AGI-254.2%—
SimpleBench57.4%—
NYT Connections (extended)79.3%—
ARC-AGI-190.5%—
WinoGrande—64.3%

Math Not comparable

GPT-5.2 Pro: 65.3 (#29), StarCoder 2 15B: —

Math benchmarks
BenchmarkGPT-5.2 ProStarCoder 2 15B
FrontierMath (Tiers 1-3)74%—
FrontierMath Tier 446%—
FrontierMath Tier 4 (v1)31.3%—
GSM8K—57.7%

Knowledge Not comparable

GPT-5.2 Pro: —, StarCoder 2 15B: —

Knowledge benchmarks
BenchmarkGPT-5.2 ProStarCoder 2 15B
ARC (AI2) Challenge—47.2%
MMLU—64.1%

Frequently asked questions

Is GPT-5.2 Pro better than StarCoder 2 15B?

GPT-5.2 Pro has enough public results to be ranked (#39); StarCoder 2 15B does not yet, so treat this comparison as directional.

How many benchmarks do GPT-5.2 Pro and StarCoder 2 15B share?

1 benchmark has published results for both models. GPT-5.2 Pro has 8 scored results on Noometry and StarCoder 2 15B has 7.

Related comparisons

Go deeper