Model comparison

DeepSeek-V2.5 (Sep 2024) vs Granite 4.2 30b

Granite 4.2 30b is the stronger model overall, scoring 41.4 to 37.0 on the Noometry Index.

Last verified . 11 shared benchmarks.

DeepSeek-V2.5 (Sep 2024) DeepSeek

37.0

Rank #197 Confirmed

Granite 4.2 30b IBM

41.4

Rank #126 Confirmed

Summary

  • They share 11 benchmarks with published results for both. DeepSeek-V2.5 (Sep 2024) scores higher in 0 categories and Granite 4.2 30b in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Granite 4.2 30b leads 40.4 to 31.3.

Side by side

DeepSeek-V2.5 (Sep 2024) and Granite 4.2 30b specifications
DeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
ProviderDeepSeekIBM
Noometry Index37.041.4
Released2024-09-06—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2211

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 30b leads

DeepSeek-V2.5 (Sep 2024): 31.3 (#274), Granite 4.2 30b: 40.4 (#127)

Coding benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Coding13101394
Aider Polyglot17.8%—
BigCodeBench Instruct48.6%—
BigCodeBench Complete53.2%—
HumanEval+83.5%—
MBPP+74.1%—

Reasoning Granite 4.2 30b leads

DeepSeek-V2.5 (Sep 2024): 24.5 (#145), Granite 4.2 30b: 26.7 (#114)

Reasoning benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Hard Prompts12891375

Math Not comparable

DeepSeek-V2.5 (Sep 2024): 33.3 (#177), Granite 4.2 30b: —

Math benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Math1289—

Knowledge Granite 4.2 30b leads

DeepSeek-V2.5 (Sep 2024): 34.2 (#190), Granite 4.2 30b: 38.5 (#134)

Knowledge benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Expert12661405

Multilingual Granite 4.2 30b leads

DeepSeek-V2.5 (Sep 2024): 42.7 (#188), Granite 4.2 30b: 47.4 (#146)

Multilingual benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Non-English12731340
LMArena Chinese13171415
LMArena Russian12891342
LMArena French1288—
LMArena German1258—
LMArena Japanese1228—
LMArena Korean1209—
LMArena Spanish1248—

Instruction Following Granite 4.2 30b leads

DeepSeek-V2.5 (Sep 2024): 67.7 (#189), Granite 4.2 30b: 71.3 (#150)

Instruction Following benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Instruction Following12801346

Long Context Granite 4.2 30b leads

DeepSeek-V2.5 (Sep 2024): 39.5 (#169), Granite 4.2 30b: 41.4 (#135)

Long Context benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Longer Query13011359

Writing & Preference Granite 4.2 30b leads

DeepSeek-V2.5 (Sep 2024): 50.0 (#182), Granite 4.2 30b: 54.3 (#147)

Writing & Preference benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.2 30b
LMArena Text12941363
LMArena Creative Writing12851294
LMArena Multi-Turn12971340

Frequently asked questions

Is DeepSeek-V2.5 (Sep 2024) better than Granite 4.2 30b?

Granite 4.2 30b is the stronger model overall, scoring 41.4 to 37.0 on the Noometry Index.

Is DeepSeek-V2.5 (Sep 2024) or Granite 4.2 30b better for coding?

Granite 4.2 30b scores higher on coding benchmarks: 40.4 versus 31.3 in the Noometry coding category.

How many benchmarks do DeepSeek-V2.5 (Sep 2024) and Granite 4.2 30b share?

11 benchmarks have published results for both models. DeepSeek-V2.5 (Sep 2024) has 22 scored results on Noometry and Granite 4.2 30b has 11.

Related comparisons

Go deeper