Model comparison

GPT-5.5 vs Phi 3 Mini 4k Instruct June 2024

GPT-5.5 is the stronger model overall, scoring 63.4 to 31.3 on the Noometry Index.

Last verified . 15 shared benchmarks.

GPT-5.5 OpenAI

63.4

Rank #9 Confirmed

Summary

  • They share 15 benchmarks with published results for both. GPT-5.5 scores higher in 8 categories and Phi 3 Mini 4k Instruct June 2024 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.5 leads 72.8 to 20.8.
  • Phi 3 Mini 4k Instruct June 2024 has downloadable open weights; the other is API-only.

Side by side

GPT-5.5 and Phi 3 Mini 4k Instruct June 2024 specifications
GPT-5.5Phi 3 Mini 4k Instruct June 2024
ProviderOpenAIMicrosoft
Noometry Index63.431.3
Released2026-04-23—
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$5—
Output $ / M tokens$30—
Results tracked7115

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.5 leads

GPT-5.5: 58.2 (#17), Phi 3 Mini 4k Instruct June 2024: 31.8 (#279)

Coding benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Coding14941093
SWE-bench Verified80.6%—
DeepSWE67%—
FrontierCode43%—
LMArena WebDev1513—
SciCode56.1%—
GSO40.2%—
WeirdML84.9%—
MirrorCode10%—
ALE-Bench1,943—

Agentic & Tool Use Not comparable

GPT-5.5: 50.7 (#6), Phi 3 Mini 4k Instruct June 2024: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
Terminal-Bench84.7%—
APEX-Agents55.1%—
OSWorld 2.013%—
Remote Labor Index6.3%—
τ²-bench Banking44.6%—
DeepResearch Bench54%—
PostTrainBench27.2%—
ExploitBench47.4%—
GBAEval53.2%—
GDP.pdf26%—
LMArena Search1242—
Vending-Bench 27,524—

Reasoning GPT-5.5 leads

GPT-5.5: 72.8 (#11), Phi 3 Mini 4k Instruct June 2024: 20.8 (#231)

Reasoning benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Hard Prompts14891087
ARC-AGI-285%—
SimpleBench69%—
Kagi LLM Benchmark88.8%—
NYT Connections (extended)96.2%—
ARC-AGI-195%—
CritPt27.1%—
Chess Puzzles54%—
EBR-Bench34.3%—
Mystery Game Puzzles56%—
DTBench96%—
LMCA54.3%—
Surface Evolver Bench88.1%—
Bench to the Future 30.14—
Epoch Capabilities Index159.1—
ForecastBench60.6—

Math GPT-5.5 leads

GPT-5.5: 81.7 (#11), Phi 3 Mini 4k Instruct June 2024: 33.0 (#208)

Knowledge GPT-5.5 leads

GPT-5.5: 64.4 (#17), Phi 3 Mini 4k Instruct June 2024: 28.6 (#244)

Knowledge benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Expert15081051
GPQA Diamond94%—
SimpleQA Verified63%—
Vectara Hallucination Rate9.3%—

Multimodal Not comparable

GPT-5.5: 46.9 (#12), Phi 3 Mini 4k Instruct June 2024: —

Multimodal benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Vision1297—
Blueprint-Bench 236.2%—
Furniture Assembly44.2%—
LMArena Document1486—

Multilingual GPT-5.5 leads

GPT-5.5: 56.4 (#20), Phi 3 Mini 4k Instruct June 2024: 25.9 (#282)

Multilingual benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Non-English14671013
LMArena Chinese15331033
LMArena German14801031
LMArena Japanese1498954
LMArena Korean1460880
LMArena Russian14731019
LMArena French1486—
LMArena Spanish1468—

Instruction Following GPT-5.5 leads

GPT-5.5: 77.5 (#18), Phi 3 Mini 4k Instruct June 2024: 54.1 (#282)

Instruction Following benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Instruction Following14791058

Long Context GPT-5.5 leads

GPT-5.5: 48.3 (#12), Phi 3 Mini 4k Instruct June 2024: 31.7 (#277)

Long Context benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Longer Query14841042
CL-bench Life22.2%—

Writing & Preference GPT-5.5 leads

GPT-5.5: 72.7 (#13), Phi 3 Mini 4k Instruct June 2024: 29.6 (#294)

Writing & Preference benchmarks
BenchmarkGPT-5.5Phi 3 Mini 4k Instruct June 2024
LMArena Text14721080
LMArena Creative Writing14551045
LMArena Multi-Turn14761049
EQ-Bench Creative Writing1844—
EQ-Bench 41315—

Frequently asked questions

Is GPT-5.5 better than Phi 3 Mini 4k Instruct June 2024?

GPT-5.5 is the stronger model overall, scoring 63.4 to 31.3 on the Noometry Index.

Is GPT-5.5 or Phi 3 Mini 4k Instruct June 2024 better for coding?

GPT-5.5 scores higher on coding benchmarks: 58.2 versus 31.8 in the Noometry coding category.

How many benchmarks do GPT-5.5 and Phi 3 Mini 4k Instruct June 2024 share?

15 benchmarks have published results for both models. GPT-5.5 has 71 scored results on Noometry and Phi 3 Mini 4k Instruct June 2024 has 15.

Related comparisons

Go deeper