Model comparison

gpt-oss-120b vs Phi-3.5-MoE

gpt-oss-120b has enough public results to be ranked (#210); Phi-3.5-MoE does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

gpt-oss-120b OpenAI

36.0

Rank #210 Confirmed

Phi-3.5-MoE Microsoft

—

Unranked

Side by side

gpt-oss-120b and Phi-3.5-MoE specifications
gpt-oss-120bPhi-3.5-MoE
ProviderOpenAIMicrosoft
Noometry Index36.0—
Released2025-08-052024-08-17
WeightsOpenOpen
Context window131K—
Max output41K—
Input $ / M tokens$0.037—
Output $ / M tokens$0.17—
Results tracked483

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

gpt-oss-120b: 33.2 (#251), Phi-3.5-MoE: —

Coding benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
SWE-bench Verified (bash only)26%—
Aider Polyglot41.8%—
SciCode36%—
WeirdML48.2%—
LMArena Coding1380—
ALE-Bench575.62—
AlgoTune1.41—

Agentic & Tool Use Not comparable

gpt-oss-120b: 12.1 (#145), Phi-3.5-MoE: —

Agentic & Tool Use benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
Terminal-Bench18.7%—
APEX-Agents4.4%—
METR Time Horizons56.6%—
Vending-Bench 2-21.53—

Reasoning Not comparable

gpt-oss-120b: 19.5 (#236), Phi-3.5-MoE: —

Reasoning benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
SimpleBench22.1%—
Kagi LLM Benchmark58.6%—
CritPt1.1%—
Chess Puzzles20%—
LMArena Hard Prompts1364—
Mystery Game Puzzles2%—
DTBench76.3%—
LMCA22.1%—
Surface Evolver Bench25%—
Epoch Capabilities Index139.94—
PIQA—88.6%

Math Not comparable

gpt-oss-120b: 50.6 (#43), Phi-3.5-MoE: —

Math benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
OTIS Mock AIME 2024-202588.9%—
Omni-MATH68.8%—
LMArena Math1388—
GSM8K—88.7%

Knowledge Not comparable

gpt-oss-120b: 42.3 (#89), Phi-3.5-MoE: —

Knowledge benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
GPQA Diamond75.8%—
MMLU-Pro79.5%—
Confabulations15.7%—
Vectara Hallucination Rate14.2%—
GPQA (HELM)68.4%—
LMArena Expert1356—
BoolQ—84.6%

Multilingual Not comparable

gpt-oss-120b: 48.2 (#142), Phi-3.5-MoE: —

Multilingual benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
LMArena Non-English1350—
LMArena Chinese1384—
LMArena French1370—
LMArena German1355—
LMArena Japanese1332—
LMArena Korean1283—
LMArena Russian1343—
LMArena Spanish1388—

Instruction Following Not comparable

gpt-oss-120b: 69.5 (#168), Phi-3.5-MoE: —

Instruction Following benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
IFEval83.6%—
LMArena Instruction Following1318—

Long Context Not comparable

gpt-oss-120b: 31.4 (#273), Phi-3.5-MoE: —

Long Context benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
Fiction.LiveBench44.4%—
LMArena Longer Query1319—

Writing & Preference Not comparable

gpt-oss-120b: 46.7 (#213), Phi-3.5-MoE: —

Writing & Preference benchmarks
Benchmarkgpt-oss-120bPhi-3.5-MoE
LMArena Text1366—
LMArena Creative Writing1274—
Short-Story Creative Writing77.1%—
EQ-Bench Creative Writing961—
WildBench84.5%—
LMArena Multi-Turn1340—

Frequently asked questions

Is gpt-oss-120b better than Phi-3.5-MoE?

gpt-oss-120b has enough public results to be ranked (#210); Phi-3.5-MoE does not yet, so treat this comparison as directional.

How many benchmarks do gpt-oss-120b and Phi-3.5-MoE share?

0 benchmarks have published results for both models. gpt-oss-120b has 48 scored results on Noometry and Phi-3.5-MoE has 3.

Related comparisons

Go deeper