Noometry

Model comparison

Gemma 2 27B vs Granite 4.0 Micro

Gemma 2 27B and Granite 4.0 Micro score almost the same on the Noometry Index (29.4 vs 29.0), so choose on price, context window or the category you care about most.

Last verified . 2 shared benchmarks.

Gemma 2 27B Google

29.4

Rank #312 Confirmed

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Gemma 2 27B scores higher in 1 category and Granite 4.0 Micro in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Granite 4.0 Micro leads 69.9 to 60.5.
  • The biggest single-benchmark swing is GPQA Diamond: 36.5% for Gemma 2 27B and 28.3% for Granite 4.0 Micro.
  • Granite 4.0 Micro is cheaper at $0.017 / $0.11 per million input/output tokens, against $0.65 / $0.65 for Gemma 2 27B.
  • Granite 4.0 Micro accepts more context: 131K tokens versus 8K.

Side by side

Gemma 2 27BGranite 4.0 Micro
ProviderGoogleIBM
Noometry Index29.429.0
Released2024-06-242025-10-02
WeightsOpenOpen
Context window8K131K
Max output2K118K
Input $ / M tokens$0.65$0.017
Output $ / M tokens$0.65$0.11
Results tracked348

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 2 27B: 34.1 (#246), Granite 4.0 Micro: —

BenchmarkGemma 2 27BGranite 4.0 Micro
BigCodeBench Instruct42.8%—
LiveBench Coding36%—
LMArena Coding1211—
BigCodeBench Complete52.5%—

Reasoning Granite 4.0 Micro leads

Gemma 2 27B: 15.3 (#315), Granite 4.0 Micro: 19.2 (#265)

BenchmarkGemma 2 27BGranite 4.0 Micro
Chess Puzzles—0%
LiveBench Reasoning28.1%—
LMArena Hard Prompts1198—
DTBench48%—
LiveBench Data Analysis47.9%—
LMCA7.1%—
Epoch Capabilities Index122.08—
LiveBench38.2%—

Math Granite 4.0 Micro leads

Gemma 2 27B: 10.7 (#311), Granite 4.0 Micro: 12.0 (#307)

BenchmarkGemma 2 27BGranite 4.0 Micro
OTIS Mock AIME 2024-20251.4%2.8%
Omni-MATH—20.9%
LiveBench Math26.5%—
LMArena Math1212—
MATH Level 527.9%—

Knowledge Gemma 2 27B leads

Gemma 2 27B: 19.0 (#280), Granite 4.0 Micro: 9.9 (#304)

BenchmarkGemma 2 27BGranite 4.0 Micro
GPQA Diamond36.5%28.3%
MMLU-Pro—39.5%
Confabulations27.1%—
GPQA (HELM)—30.7%
LMArena Expert1172—
MMLU75.7%—

Multilingual Not comparable

Gemma 2 27B: 38.6 (#226), Granite 4.0 Micro: —

BenchmarkGemma 2 27BGranite 4.0 Micro
LMArena Non-English1217—
LMArena Chinese1221—
LMArena French1247—
LMArena German1209—
LMArena Japanese1175—
LMArena Korean1174—
LMArena Russian1234—
LMArena Spanish1228—

Instruction Following Granite 4.0 Micro leads

Gemma 2 27B: 60.5 (#249), Granite 4.0 Micro: 69.9 (#169)

BenchmarkGemma 2 27BGranite 4.0 Micro
LiveBench Instruction Following58.1%—
IFEval—84.9%
LMArena Instruction Following1206—

Long Context Not comparable

Gemma 2 27B: 37.3 (#218), Granite 4.0 Micro: —

BenchmarkGemma 2 27BGranite 4.0 Micro
LMArena Longer Query1231—

Writing & Preference Granite 4.0 Micro leads

Gemma 2 27B: 44.2 (#225), Granite 4.0 Micro: 46.7 (#216)

BenchmarkGemma 2 27BGranite 4.0 Micro
LMArena Text1231—
LMArena Creative Writing1241—
WildBench—67%
LMArena Multi-Turn1224—
LiveBench Language32.6%—

Frequently asked questions

Is Gemma 2 27B better than Granite 4.0 Micro?

Gemma 2 27B and Granite 4.0 Micro score almost the same on the Noometry Index (29.4 vs 29.0), so choose on price, context window or the category you care about most.

Which is cheaper, Gemma 2 27B or Granite 4.0 Micro?

Granite 4.0 Micro is cheaper. It lists at $0.017 per million input tokens and $0.11 per million output tokens; Gemma 2 27B lists at $0.65 and $0.65.

Which has the bigger context window?

Granite 4.0 Micro does, with 131K tokens against 8K.

How many benchmarks do Gemma 2 27B and Granite 4.0 Micro share?

2 benchmarks have published results for both models. Gemma 2 27B has 34 scored results on Noometry and Granite 4.0 Micro has 8.

Related comparisons

Go deeper