Model comparison

Palm 2 vs Phi-4 Mini

Palm 2 and Phi-4 Mini score almost the same on the Noometry Index (29.4 vs 30.4), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Palm 2 Google

29.4

Rank #296 Confirmed

Phi-4 Mini Microsoft

30.4

Rank #280 Reported

Summary

  • The widest gap is in reasoning, where Phi-4 Mini leads 21.7 to 18.2.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Palm 2 and Phi-4 Mini specifications
Palm 2Phi-4 Mini
ProviderGoogleMicrosoft
Noometry Index29.430.4
Released—2024-12-11
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.075
Output $ / M tokens—$0.30
Results tracked103

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Palm 2: 28.5 (#306), Phi-4 Mini: 27.6 (#312)

Coding benchmarks
BenchmarkPalm 2Phi-4 Mini
SciCode—10.8%
LMArena Coding995—

Reasoning Phi-4 Mini leads

Palm 2: 18.2 (#270), Phi-4 Mini: 21.7 (#190)

Reasoning benchmarks
BenchmarkPalm 2Phi-4 Mini
CritPt—0%
LMArena Hard Prompts1005—

Math Not comparable

Palm 2: 28.4 (#229), Phi-4 Mini: —

Math benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Math1049—

Knowledge Not comparable

Palm 2: —, Phi-4 Mini: 24.8 (#261)

Knowledge benchmarks
BenchmarkPalm 2Phi-4 Mini
Vectara Hallucination Rate—23.5%

Multilingual Not comparable

Palm 2: 21.1 (#290), Phi-4 Mini: —

Multilingual benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Non-English916—
LMArena Chinese887—

Instruction Following Not comparable

Palm 2: 51.3 (#291), Phi-4 Mini: —

Instruction Following benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Instruction Following1010—

Long Context Not comparable

Palm 2: 30.7 (#280), Phi-4 Mini: —

Long Context benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Longer Query1010—

Writing & Preference Not comparable

Palm 2: 25.7 (#299), Phi-4 Mini: —

Writing & Preference benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Text1027—
LMArena Creative Writing991—
LMArena Multi-Turn994—

Frequently asked questions

Is Palm 2 better than Phi-4 Mini?

Palm 2 and Phi-4 Mini score almost the same on the Noometry Index (29.4 vs 30.4), so choose on price, context window or the category you care about most.

Is Palm 2 or Phi-4 Mini better for coding?

They score almost the same on coding (28.5 vs 27.6); test both on your own repository before choosing.

How many benchmarks do Palm 2 and Phi-4 Mini share?

0 benchmarks have published results for both models. Palm 2 has 10 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper