Model comparison

Llama 3.2 3B vs Palm 2

Palm 2 is the stronger model overall, scoring 29.4 to 28.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Llama 3.2 3B Meta

28.4

Rank #318 Confirmed

Palm 2 Google

29.4

Rank #296 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Llama 3.2 3B scores higher in 5 categories and Palm 2 in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Llama 3.2 3B leads 26.4 to 21.1.
  • Llama 3.2 3B has downloadable open weights; the other is API-only.

Side by side

Llama 3.2 3B and Palm 2 specifications
Llama 3.2 3BPalm 2
ProviderMetaGoogle
Noometry Index28.429.4
Released2024-09-24—
WeightsOpenProprietary
Context window131K—
Max output118K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.33—
Results tracked1810

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Palm 2 leads

Llama 3.2 3B: 27.1 (#314), Palm 2: 28.5 (#306)

Coding benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Coding1098995
BigCodeBench Instruct23.4%—
BigCodeBench Complete28.3%—

Agentic & Tool Use Not comparable

Llama 3.2 3B: 19.9 (#135), Palm 2: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 3BPalm 2
Berkeley Function Calling Leaderboard21.9%—
BALROG10.1%—

Reasoning Llama 3.2 3B leads

Llama 3.2 3B: 20.1 (#225), Palm 2: 18.2 (#270)

Reasoning benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Hard Prompts10951005

Math Llama 3.2 3B leads

Llama 3.2 3B: 29.9 (#213), Palm 2: 28.4 (#229)

Math benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Math11261049

Knowledge Not comparable

Llama 3.2 3B: 29.1 (#232), Palm 2: —

Knowledge benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Expert1090—

Multilingual Llama 3.2 3B leads

Llama 3.2 3B: 26.4 (#276), Palm 2: 21.1 (#290)

Multilingual benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Non-English1019916
LMArena Chinese1017887
LMArena German1056—
LMArena Russian949—

Instruction Following Llama 3.2 3B leads

Llama 3.2 3B: 56.3 (#270), Palm 2: 51.3 (#291)

Instruction Following benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Instruction Following10891010

Long Context Llama 3.2 3B leads

Llama 3.2 3B: 33.4 (#256), Palm 2: 30.7 (#280)

Long Context benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Longer Query11011010

Writing & Preference Too close to call

Llama 3.2 3B: 24.9 (#302), Palm 2: 25.7 (#299)

Writing & Preference benchmarks
BenchmarkLlama 3.2 3BPalm 2
LMArena Text11101027
LMArena Creative Writing1094991
LMArena Multi-Turn1105994
EQ-Bench Creative Writing595—

Frequently asked questions

Is Llama 3.2 3B better than Palm 2?

Palm 2 is the stronger model overall, scoring 29.4 to 28.4 on the Noometry Index.

Is Llama 3.2 3B or Palm 2 better for coding?

Palm 2 scores higher on coding benchmarks: 28.5 versus 27.1 in the Noometry coding category.

How many benchmarks do Llama 3.2 3B and Palm 2 share?

10 benchmarks have published results for both models. Llama 3.2 3B has 18 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper