Model comparison

Chatgpt 4o Latest 20250326 vs Gemini 2.0 Pro

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 39.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.8

Rank #82 Confirmed

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Summary

  • They share 1 benchmark with published results for both. Chatgpt 4o Latest 20250326 scores higher in 5 categories and Gemini 2.0 Pro in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Chatgpt 4o Latest 20250326 leads 43.1 to 29.2.

Side by side

Chatgpt 4o Latest 20250326 and Gemini 2.0 Pro specifications
Chatgpt 4o Latest 20250326Gemini 2.0 Pro
ProviderOpenAIGoogle
Noometry Index43.839.1
Released—2025-02-05
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2114

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 41.6 (#122), Gemini 2.0 Pro: 37.8 (#187)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
Aider Polyglot—35.6%
LiveBench Coding—63.5%
LMArena Coding1413—

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 33.8 (#71), Gemini 2.0 Pro: 22.3 (#198)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
Kagi LLM Benchmark75%—
EnigmaEval—0.7%
LiveBench Reasoning—60.1%
LMArena Hard Prompts1424—
LiveBench Data Analysis—68%
Epoch Capabilities Index—135.06
LiveBench—65.1%

Math Gemini 2.0 Pro leads

Chatgpt 4o Latest 20250326: 38.6 (#134), Gemini 2.0 Pro: 39.7 (#100)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
LiveBench Math—71%
LMArena Math1407—
MATH Level 5—83.5%

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 39.2 (#137), Gemini 2.0 Pro: 36.5 (#167)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
Confabulations16.6%18.4%
GPQA Diamond—65.7%
LMArena Expert1401—

Multimodal Not comparable

Chatgpt 4o Latest 20250326: 39.6 (#58), Gemini 2.0 Pro: —

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
LMArena Vision1243—

Multilingual Not comparable

Chatgpt 4o Latest 20250326: 52.9 (#76), Gemini 2.0 Pro: —

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
LMArena Non-English1419—
LMArena Chinese1457—
LMArena French1446—
LMArena German1423—
LMArena Japanese1405—
LMArena Korean1396—
LMArena Russian1429—
LMArena Spanish1434—

Instruction Following Gemini 2.0 Pro leads

Chatgpt 4o Latest 20250326: 74.0 (#107), Gemini 2.0 Pro: 75.5 (#59)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
LiveBench Instruction Following—83.4%
LMArena Instruction Following1403—

Long Context Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 43.1 (#107), Gemini 2.0 Pro: 29.2 (#292)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
Fiction.LiveBench—41.7%
LMArena Longer Query1413—

Writing & Preference Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 62.6 (#72), Gemini 2.0 Pro: 52.7 (#165)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 2.0 Pro
LMArena Text1429—
LMArena Creative Writing1405—
EQ-Bench Creative Writing1501—
LMArena Multi-Turn1454—
LiveBench Language—44.9%

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Gemini 2.0 Pro?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 39.1 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or Gemini 2.0 Pro better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.6 versus 37.8 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Gemini 2.0 Pro share?

1 benchmark has published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Gemini 2.0 Pro has 14.

Related comparisons

Go deeper