Model comparison

Palm 2 vs Qwen2.5-VL 72B Instruct

Palm 2 and Qwen2.5-VL 72B Instruct score almost the same on the Noometry Index (30.0 vs 29.9), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • Qwen2.5-VL 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Palm 2 and Qwen2.5-VL 72B Instruct specifications
Palm 2Qwen2.5-VL 72B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index30.029.9
Released—2024-09
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$2.80
Output $ / M tokens—$8.40
Results tracked106

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Palm 2: 29.0 (#311), Qwen2.5-VL 72B Instruct: —

Coding benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
LMArena Coding994—

Agentic & Tool Use Not comparable

Palm 2: —, Qwen2.5-VL 72B Instruct: 18.6 (#144)

Agentic & Tool Use benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
OSWorld—5%

Reasoning Qwen2.5-VL 72B Instruct leads

Palm 2: 19.1 (#271), Qwen2.5-VL 72B Instruct: 20.7 (#233)

Reasoning benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
Kagi LLM Benchmark—36%
LMArena Hard Prompts1005—

Math Not comparable

Palm 2: 30.8 (#231), Qwen2.5-VL 72B Instruct: —

Math benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
LMArena Math1049—

Multimodal Not comparable

Palm 2: —, Qwen2.5-VL 72B Instruct: 33.5 (#97)

Multimodal benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
LMArena Vision—1107
Video-MME—73.5%
GeoBench—62%
SpatialViz-Bench—33.3%

Multilingual Not comparable

Palm 2: 20.9 (#295), Qwen2.5-VL 72B Instruct: —

Multilingual benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
LMArena Non-English916—
LMArena Chinese887—

Instruction Following Not comparable

Palm 2: 51.0 (#296), Qwen2.5-VL 72B Instruct: —

Instruction Following benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
LMArena Instruction Following1010—

Long Context Not comparable

Palm 2: 30.8 (#285), Qwen2.5-VL 72B Instruct: —

Long Context benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
LMArena Longer Query1010—

Writing & Preference Not comparable

Palm 2: 25.6 (#304), Qwen2.5-VL 72B Instruct: —

Writing & Preference benchmarks
BenchmarkPalm 2Qwen2.5-VL 72B Instruct
LMArena Text1027—
LMArena Creative Writing991—
LMArena Multi-Turn994—

Frequently asked questions

Is Palm 2 better than Qwen2.5-VL 72B Instruct?

Palm 2 and Qwen2.5-VL 72B Instruct score almost the same on the Noometry Index (30.0 vs 29.9), so choose on price, context window or the category you care about most.

How many benchmarks do Palm 2 and Qwen2.5-VL 72B Instruct share?

0 benchmarks have published results for both models. Palm 2 has 10 scored results on Noometry and Qwen2.5-VL 72B Instruct has 6.

Related comparisons

Go deeper