Noometry

Model comparison

GPT-4 vs Granite 4.0 Micro

GPT-4 and Granite 4.0 Micro score almost the same on the Noometry Index (29.1 vs 29.0), so choose on price, context window or the category you care about most.

Last verified . 3 shared benchmarks.

GPT-4 OpenAI

29.1

Rank #316 Confirmed

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Summary

  • They share 3 benchmarks with published results for both. GPT-4 scores higher in 1 category and Granite 4.0 Micro in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.0 Micro leads 46.7 to 34.9.
  • The biggest single-benchmark swing is GPQA Diamond: 35.7% for GPT-4 and 28.3% for Granite 4.0 Micro.
  • Granite 4.0 Micro is cheaper at $0.017 / $0.11 per million input/output tokens, against $30 / $60 for GPT-4.
  • Granite 4.0 Micro accepts more context: 131K tokens versus 8K.
  • Granite 4.0 Micro has downloadable open weights; the other is API-only.

Side by side

GPT-4Granite 4.0 Micro
ProviderOpenAIIBM
Noometry Index29.129.0
Released2023-03-142025-10-02
WeightsProprietaryOpen
Context window8K131K
Max output8K118K
Input $ / M tokens$30$0.017
Output $ / M tokens$60$0.11
Results tracked388

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-4: 31.6 (#283), Granite 4.0 Micro: —

BenchmarkGPT-4Granite 4.0 Micro
WeirdML12.4%—
BigCodeBench Instruct46%—
LMArena Coding1254—
BigCodeBench Complete57.2%—
HumanEval+79.3%—

Agentic & Tool Use Not comparable

GPT-4: —, Granite 4.0 Micro: —

BenchmarkGPT-4Granite 4.0 Micro
METR Time Horizons36.1%—

Reasoning Granite 4.0 Micro leads

GPT-4: 17.8 (#289), Granite 4.0 Micro: 19.2 (#265)

BenchmarkGPT-4Granite 4.0 Micro
Chess Puzzles4%0%
LMArena Hard Prompts1241—
Mystery Game Puzzles12%—
DTBench62.7%—
LMCA17.1%—
BIG-Bench Hard75.1%—
Epoch Capabilities Index125.89—
ForecastBench57.8—
HellaSwag95.3%—
WinoGrande87.5%—

Math Granite 4.0 Micro leads

GPT-4: 10.8 (#309), Granite 4.0 Micro: 12.0 (#307)

BenchmarkGPT-4Granite 4.0 Micro
OTIS Mock AIME 2024-20251.1%2.8%
Omni-MATH—20.9%
LMArena Math1269—
MATH Level 523%—
GSM8K92%—

Knowledge GPT-4 leads

GPT-4: 18.4 (#282), Granite 4.0 Micro: 9.9 (#304)

BenchmarkGPT-4Granite 4.0 Micro
GPQA Diamond35.7%28.3%
MMLU-Pro—39.5%
GPQA (HELM)—30.7%
LMArena Expert1211—
MMLU86.4%—
TriviaQA84.8%—

Multilingual Not comparable

GPT-4: 40.6 (#215), Granite 4.0 Micro: —

BenchmarkGPT-4Granite 4.0 Micro
LMArena Non-English1246—
LMArena Chinese1242—
LMArena French1283—
LMArena German1251—
LMArena Japanese1209—
LMArena Korean1184—
LMArena Russian1251—
LMArena Spanish1261—

Instruction Following Granite 4.0 Micro leads

GPT-4: 65.3 (#222), Granite 4.0 Micro: 69.9 (#169)

BenchmarkGPT-4Granite 4.0 Micro
IFEval—84.9%
LMArena Instruction Following1241—

Long Context Not comparable

GPT-4: 37.7 (#212), Granite 4.0 Micro: —

BenchmarkGPT-4Granite 4.0 Micro
LMArena Longer Query1244—

Writing & Preference Granite 4.0 Micro leads

GPT-4: 34.9 (#268), Granite 4.0 Micro: 46.7 (#216)

BenchmarkGPT-4Granite 4.0 Micro
LMArena Text1263—
LMArena Creative Writing1244—
EQ-Bench Creative Writing752—
WildBench—67%
LMArena Multi-Turn1257—

Frequently asked questions

Is GPT-4 better than Granite 4.0 Micro?

GPT-4 and Granite 4.0 Micro score almost the same on the Noometry Index (29.1 vs 29.0), so choose on price, context window or the category you care about most.

Which is cheaper, GPT-4 or Granite 4.0 Micro?

Granite 4.0 Micro is cheaper. It lists at $0.017 per million input tokens and $0.11 per million output tokens; GPT-4 lists at $30 and $60.

Which has the bigger context window?

Granite 4.0 Micro does, with 131K tokens against 8K.

How many benchmarks do GPT-4 and Granite 4.0 Micro share?

3 benchmarks have published results for both models. GPT-4 has 38 scored results on Noometry and Granite 4.0 Micro has 8.

Related comparisons

Go deeper