Model comparison

GPT-5.6 Sol vs Phi-3.5-MoE

GPT-5.6 Sol has enough public results to be ranked (#6); Phi-3.5-MoE does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

GPT-5.6 Sol OpenAI

64.4

Rank #6 Confirmed

Phi-3.5-MoE Microsoft

—

Unranked

Summary

  • Phi-3.5-MoE has downloadable open weights; the other is API-only.

Side by side

GPT-5.6 Sol and Phi-3.5-MoE specifications
GPT-5.6 SolPhi-3.5-MoE
ProviderOpenAIMicrosoft
Noometry Index64.4—
Released2026-07-092024-08-17
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$4—
Output $ / M tokens$20—
Results tracked643

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.6 Sol: 61.1 (#7), Phi-3.5-MoE: —

Coding benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
DeepSWE72.7%—
FrontierCode47.5%—
CursorBench41.7%—
LMArena WebDev1619—
FrontierSWE32.2%—
SciCode57.1%—
WeirdML89.4%—
LMArena Coding1493—
MirrorCode20%—
ALE-Bench2,177—

Agentic & Tool Use Not comparable

GPT-5.6 Sol: 50.2 (#7), Phi-3.5-MoE: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
APEX-Agents51.4%—
OSWorld 2.027.3%—
τ²-bench Banking46.9%—
PostTrainBench36.2%—
BALROG60%—
GBAEval52.6%—
GDP.pdf30.7%—
LMArena Search1257—
Vending-Bench 29,619—

Reasoning Not comparable

GPT-5.6 Sol: 74.7 (#6), Phi-3.5-MoE: —

Reasoning benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
ARC-AGI-292.5%—
SimpleBench71.7%—
Kagi LLM Benchmark67%—
NYT Connections (extended)93.8%—
ARC-AGI-197.5%—
CritPt32.3%—
Chess Puzzles64%—
EnigmaEval37.1%—
EBR-Bench44.8%—
LMArena Hard Prompts1481—
Mystery Game Puzzles58%—
DTBench96%—
LMCA59.2%—
Surface Evolver Bench93.1%—
Bench to the Future 30.14—
Epoch Capabilities Index161.99—
PIQA—88.6%

Math Not comparable

GPT-5.6 Sol: 85.5 (#7), Phi-3.5-MoE: —

Math benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
FrontierMath (Tiers 1-3)89.1%—
FrontierMath Tier 482.9%—
OTIS Mock AIME 2024-2025100%—
ProofBench83%—
LMArena Math1472—
FrontierMath Erdős0%—
GSM8K—88.7%

Knowledge Not comparable

GPT-5.6 Sol: 64.3 (#16), Phi-3.5-MoE: —

Knowledge benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
GPQA Diamond93.5%—
SimpleQA Verified69.7%—
Vectara Hallucination Rate12.4%—
LMArena Expert1517—
BoolQ—84.6%

Multimodal Not comparable

GPT-5.6 Sol: 48.9 (#8), Phi-3.5-MoE: —

Multimodal benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
LMArena Vision1281—
Blueprint-Bench 233.6%—
Furniture Assembly56.7%—
LMArena Document1483—

Multilingual Not comparable

GPT-5.6 Sol: 55.4 (#32), Phi-3.5-MoE: —

Multilingual benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
LMArena Non-English1450—
LMArena Chinese1523—
LMArena French1475—
LMArena German1476—
LMArena Japanese1475—
LMArena Korean1434—
LMArena Russian1466—
LMArena Spanish1449—

Instruction Following Not comparable

GPT-5.6 Sol: 77.8 (#16), Phi-3.5-MoE: —

Instruction Following benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
LMArena Instruction Following1480—

Long Context Not comparable

GPT-5.6 Sol: 45.3 (#42), Phi-3.5-MoE: —

Long Context benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
LMArena Longer Query1479—

Writing & Preference Not comparable

GPT-5.6 Sol: 73.5 (#12), Phi-3.5-MoE: —

Writing & Preference benchmarks
BenchmarkGPT-5.6 SolPhi-3.5-MoE
LMArena Text1456—
LMArena Creative Writing1450—
EQ-Bench Creative Writing1972—
EQ-Bench 41250—
LMArena Multi-Turn1456—

Frequently asked questions

Is GPT-5.6 Sol better than Phi-3.5-MoE?

GPT-5.6 Sol has enough public results to be ranked (#6); Phi-3.5-MoE does not yet, so treat this comparison as directional.

How many benchmarks do GPT-5.6 Sol and Phi-3.5-MoE share?

0 benchmarks have published results for both models. GPT-5.6 Sol has 64 scored results on Noometry and Phi-3.5-MoE has 3.

Related comparisons

Go deeper