Model comparison

GPT-5.2 vs Llama 2-13B

GPT-5.2 is the stronger model overall, scoring 54.1 to 29.1 on the Noometry Index.

Last verified . 20 shared benchmarks.

GPT-5.2 OpenAI

54.1

Rank #31 Confirmed

Llama 2-13B Meta

29.1

Rank #304 Confirmed

Summary

  • They share 20 benchmarks with published results for both. GPT-5.2 scores higher in 8 categories and Llama 2-13B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.2 leads 50.1 to 12.3.
  • The biggest single-benchmark swing is Chess Puzzles: 49% for GPT-5.2 and 0% for Llama 2-13B.
  • Llama 2-13B has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 and Llama 2-13B specifications
GPT-5.2Llama 2-13B
ProviderOpenAIMeta
Noometry Index54.129.1
Released2025-12-112023-07-18
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.75—
Output $ / M tokens$14—
Results tracked6732

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 leads

GPT-5.2: 52.2 (#32), Llama 2-13B: 30.4 (#287)

Coding benchmarks
BenchmarkGPT-5.2Llama 2-13B
LMArena Coding14471062
SWE-bench Verified73.8%—
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1415—
SWE-bench Multilingual66.7%—
GSO27.4%—
WeirdML72.2%—
ALE-Bench1,294—
AlgoTune2.05—

Agentic & Tool Use Not comparable

GPT-5.2: 40.0 (#24), Llama 2-13B: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.2Llama 2-13B
Terminal-Bench64.9%—
Berkeley Function Calling Leaderboard55.9%—
GDPval49.7%—
Remote Labor Index2.5%—
τ²-bench Airline83%—
τ²-bench Banking32.2%—
τ²-bench Retail81.6%—
τ²-bench Telecom89.7%—
DeepResearch Bench41.1%—
LMArena Search1207—
METR Time Horizons75.3%—
Vending-Bench 23,591—

Reasoning GPT-5.2 leads

GPT-5.2: 50.1 (#33), Llama 2-13B: 12.3 (#333)

Reasoning benchmarks
BenchmarkGPT-5.2Llama 2-13B
Chess Puzzles49%0%
LMArena Hard Prompts14451051
DTBench90.9%42.2%
Epoch Capabilities Index153.45105.8
ARC-AGI-252.9%—
SimpleBench45.8%—
Kagi LLM Benchmark73.3%—
NYT Connections (extended)83.6%—
ARC-AGI-186.2%—
EnigmaEval10.4%—
EBR-Bench23%—
Mystery Game Puzzles23%—
LMCA43.9%—
BIG-Bench Hard—58.2%
ForecastBench60.1—
HellaSwag—80.7%
LAMBADA—76.5%
PIQA—80.8%
WinoGrande—72.8%

Math GPT-5.2 leads

GPT-5.2: 59.8 (#32), Llama 2-13B: 28.7 (#226)

Knowledge GPT-5.2 leads

GPT-5.2: 59.2 (#29), Llama 2-13B: 27.5 (#244)

Knowledge benchmarks
BenchmarkGPT-5.2Llama 2-13B
LMArena Expert14451030
GPQA Diamond91.4%—
Humanity's Last Exam27.8%—
SimpleQA Verified37.1%—
Vectara Hallucination Rate8.4%—
ARC (AI2) Challenge—60.3%
BoolQ—82.4%
MMLU—55.6%
OpenBookQA—57%
TriviaQA—79.6%

Multimodal Not comparable

GPT-5.2: 50.9 (#7), Llama 2-13B: —

Multimodal benchmarks
BenchmarkGPT-5.2Llama 2-13B
LMArena Vision1268—
VPCT84%—
Furniture Assembly38.3%—
LMArena Document1405—
ScienceQA—55.8%

Multilingual GPT-5.2 leads

GPT-5.2: 53.6 (#63), Llama 2-13B: 26.7 (#274)

Multilingual benchmarks
BenchmarkGPT-5.2Llama 2-13B
LMArena Non-English14251024
LMArena Chinese14601001
LMArena French14561043
LMArena German14481009
LMArena Japanese1421894
LMArena Korean1390953
LMArena Russian14401055
LMArena Spanish14331086

Instruction Following GPT-5.2 leads

GPT-5.2: 74.9 (#83), Llama 2-13B: 53.5 (#282)

Instruction Following benchmarks
BenchmarkGPT-5.2Llama 2-13B
LMArena Instruction Following14171046

Long Context GPT-5.2 leads

GPT-5.2: 44.0 (#74), Llama 2-13B: 32.3 (#264)

Long Context benchmarks
BenchmarkGPT-5.2Llama 2-13B
LMArena Longer Query14281064
CL-bench18.2%—

Writing & Preference GPT-5.2 leads

GPT-5.2: 67.0 (#30), Llama 2-13B: 30.0 (#284)

Writing & Preference benchmarks
BenchmarkGPT-5.2Llama 2-13B
LMArena Text14391085
LMArena Creative Writing14021047
LMArena Multi-Turn14581050
EQ-Bench Creative Writing1703—

Frequently asked questions

Is GPT-5.2 better than Llama 2-13B?

GPT-5.2 is the stronger model overall, scoring 54.1 to 29.1 on the Noometry Index.

Is GPT-5.2 or Llama 2-13B better for coding?

GPT-5.2 scores higher on coding benchmarks: 52.2 versus 30.4 in the Noometry coding category.

How many benchmarks do GPT-5.2 and Llama 2-13B share?

20 benchmarks have published results for both models. GPT-5.2 has 67 scored results on Noometry and Llama 2-13B has 32.

Related comparisons

Go deeper