Model comparison

Claude Haiku 5.5 vs Phi-4 Mini

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 30.9 on the Noometry Index. Phi-4 Mini costs 1.5× less per token, which makes it the better buy when Claude Haiku 5.5's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Claude Haiku 5.5 Anthropic

49.5

Rank #52 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in knowledge, where Claude Haiku 5.5 leads 50.8 to 25.3.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.10 / $0.50 for Claude Haiku 5.5.
  • Claude Haiku 5.5 accepts more context: 1M tokens versus 128K.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 5.5 and Phi-4 Mini specifications
Claude Haiku 5.5Phi-4 Mini
ProviderAnthropicMicrosoft
Noometry Index49.530.9
Released2026-10-072024-12-11
WeightsProprietaryOpen
Context window1M128K
Max output128K4K
Input $ / M tokens$0.10$0.075
Output $ / M tokens$0.50$0.30
Results tracked93

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 5.5 leads

Claude Haiku 5.5: 49.2 (#50), Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkClaude Haiku 5.5Phi-4 Mini
LMArena WebDev1587—
SciCode—10.8%

Reasoning Claude Haiku 5.5 leads

Claude Haiku 5.5: 35.2 (#69), Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkClaude Haiku 5.5Phi-4 Mini
NYT Connections (extended)65.7%—
CritPt—0%
Mystery Game Puzzles30%—

Math Not comparable

Claude Haiku 5.5: 73.6 (#18), Phi-4 Mini: —

Math benchmarks
BenchmarkClaude Haiku 5.5Phi-4 Mini
FrontierMath (Tiers 1-3)75.1%—
FrontierMath Tier 446.3%—
OTIS Mock AIME 2024-202598.9%—

Knowledge Claude Haiku 5.5 leads

Claude Haiku 5.5: 50.8 (#70), Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkClaude Haiku 5.5Phi-4 Mini
GPQA Diamond89.6%—
SimpleQA Verified23.8%—
Vectara Hallucination Rate—23.5%

Multimodal Not comparable

Claude Haiku 5.5: 43.7 (#21), Phi-4 Mini: —

Multimodal benchmarks
BenchmarkClaude Haiku 5.5Phi-4 Mini
Furniture Assembly47.5%—

Frequently asked questions

Is Claude Haiku 5.5 better than Phi-4 Mini?

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 30.9 on the Noometry Index. Phi-4 Mini costs 1.5× less per token, which makes it the better buy when Claude Haiku 5.5's lead doesn't matter for your workload.

Which is cheaper, Claude Haiku 5.5 or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Claude Haiku 5.5 lists at $0.10 and $0.50.

Is Claude Haiku 5.5 or Phi-4 Mini better for coding?

Claude Haiku 5.5 scores higher on coding benchmarks: 49.2 versus 28.1 in the Noometry coding category.

Which has the bigger context window?

Claude Haiku 5.5 does, with 1M tokens against 128K.

How many benchmarks do Claude Haiku 5.5 and Phi-4 Mini share?

0 benchmarks have published results for both models. Claude Haiku 5.5 has 9 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper