Model comparison

GPT-5.5 Pro vs StarCoder 2 15B

GPT-5.5 Pro has enough public results to be ranked (#8); StarCoder 2 15B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

GPT-5.5 Pro OpenAI

64.3

Rank #8 Confirmed

StarCoder 2 15B NVIDIA

38.1

Unranked Sparse

Summary

  • They share 1 benchmark with published results for both.
  • StarCoder 2 15B has downloadable open weights; the other is API-only.

Side by side

GPT-5.5 Pro and StarCoder 2 15B specifications
GPT-5.5 ProStarCoder 2 15B
ProviderOpenAINVIDIA
Noometry Index64.338.1
Released2026-04-232024-02-20
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$30—
Output $ / M tokens$180—
Results tracked147

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.5 Pro: —, StarCoder 2 15B: 36.6

Coding benchmarks
BenchmarkGPT-5.5 ProStarCoder 2 15B
BigCodeBench Complete—38.4%
HumanEval+—37.8%

Reasoning Not comparable

GPT-5.5 Pro: 73.3 (#10), StarCoder 2 15B: —

Reasoning benchmarks
BenchmarkGPT-5.5 ProStarCoder 2 15B
Epoch Capabilities Index162.07105
ARC-AGI-284.6%—
SimpleBench76.9%—
ARC-AGI-196.5%—
CritPt30.6%—
Chess Puzzles64%—
DTBench96%—
LMCA53.9%—
WinoGrande—64.3%

Math Not comparable

GPT-5.5 Pro: 84.0 (#10), StarCoder 2 15B: —

Math benchmarks
BenchmarkGPT-5.5 ProStarCoder 2 15B
FrontierMath (Tiers 1-3)87.7%—
FrontierMath Tier 478%—
OTIS Mock AIME 2024-2025100%—
FrontierMath (Feb 2025 set)52.4%—
FrontierMath Tier 4 (v1)39.6%—
GSM8K—57.7%

Knowledge Not comparable

GPT-5.5 Pro: 64.1 (#19), StarCoder 2 15B: —

Knowledge benchmarks
BenchmarkGPT-5.5 ProStarCoder 2 15B
GPQA Diamond93.9%—
ARC (AI2) Challenge—47.2%
MMLU—64.1%

Frequently asked questions

Is GPT-5.5 Pro better than StarCoder 2 15B?

GPT-5.5 Pro has enough public results to be ranked (#8); StarCoder 2 15B does not yet, so treat this comparison as directional.

How many benchmarks do GPT-5.5 Pro and StarCoder 2 15B share?

1 benchmark has published results for both models. GPT-5.5 Pro has 14 scored results on Noometry and StarCoder 2 15B has 7.

Related comparisons

Go deeper