Noometry

Model comparison

Gemini 2.5 Flash vs GPT-5.6 Sol

GPT-5.6 Sol is the stronger model overall, scoring 64.4 to 39.0 on the Noometry Index. Gemini 2.5 Flash costs 9.4× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Last verified . 34 shared benchmarks.

Gemini 2.5 Flash Google

39.0

Rank #162 Confirmed

GPT-5.6 Sol OpenAI

64.4

Rank #6 Confirmed

Summary

  • They share 34 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 1 category and GPT-5.6 Sol in 9 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.6 Sol leads 74.7 to 18.2.
  • The biggest single-benchmark swing is ARC-AGI-2: 2.5% for Gemini 2.5 Flash and 92.5% for GPT-5.6 Sol.
  • Gemini 2.5 Flash is cheaper at $0.30 / $2.50 per million input/output tokens, against $4 / $20 for GPT-5.6 Sol.
  • GPT-5.6 Sol accepts more context: 1.05M tokens versus 1.05M.

Side by side

Gemini 2.5 FlashGPT-5.6 Sol
ProviderGoogleOpenAI
Noometry Index39.064.4
Released2025-04-172026-07-09
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K128K
Input $ / M tokens$0.30$4
Output $ / M tokens$2.50$20
Results tracked5464

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Sol leads

Gemini 2.5 Flash: 35.5 (#210), GPT-5.6 Sol: 61.1 (#7)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
WeirdML41.9%89.4%
LMArena Coding14241493
ALE-Bench661.882,177
DeepSWE—72.7%
FrontierCode—47.5%
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
CursorBench—41.7%
LMArena WebDev—1619
FrontierSWE—32.2%
SciCode—57.1%
MirrorCode—20%

Agentic & Tool Use GPT-5.6 Sol leads

Gemini 2.5 Flash: 30.6 (#67), GPT-5.6 Sol: 50.2 (#7)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
BALROG33.5%60%
Vending-Bench 2548.849,619
Terminal-Bench17.1%—
APEX-Agents—51.4%
Berkeley Function Calling Leaderboard56.2%—
OSWorld 2.0—27.3%
TheAgentCompany41.1%—
τ²-bench Banking—46.9%
PostTrainBench—36.2%
GBAEval—52.6%
GDP.pdf—30.7%
LMArena Search—1257

Reasoning GPT-5.6 Sol leads

Gemini 2.5 Flash: 18.2 (#271), GPT-5.6 Sol: 74.7 (#6)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
ARC-AGI-22.5%92.5%
SimpleBench41.2%71.7%
Kagi LLM Benchmark56.8%67%
ARC-AGI-133.3%97.5%
CritPt1.1%32.3%
EnigmaEval2.7%37.1%
LMArena Hard Prompts14221481
DTBench76.5%96%
LMCA27.5%59.2%
Epoch Capabilities Index143.04161.99
NYT Connections (extended)—93.8%
Chess Puzzles—64%
EBR-Bench—44.8%
Mystery Game Puzzles—58%
Surface Evolver Bench—93.1%
Bench to the Future 3—0.14
ForecastBench60.6—

Math GPT-5.6 Sol leads

Gemini 2.5 Flash: 38.1 (#87), GPT-5.6 Sol: 85.5 (#7)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
OTIS Mock AIME 2024-202573.1%100%
LMArena Math14151472
FrontierMath (Tiers 1-3)—89.1%
FrontierMath Tier 4—82.9%
ProofBench—83%
Omni-MATH38.5%—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Erdős—0%
FrontierMath Tier 4 (v1)4.2%—

Knowledge GPT-5.6 Sol leads

Gemini 2.5 Flash: 36.1 (#162), GPT-5.6 Sol: 64.3 (#16)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
Vectara Hallucination Rate7.8%12.4%
LMArena Expert14261517
GPQA Diamond—93.5%
Humanity's Last Exam12.1%—
SimpleQA Verified—69.7%
MMLU-Pro63.9%—
Confabulations16.8%—
GPQA (HELM)39%—

Multimodal GPT-5.6 Sol leads

Gemini 2.5 Flash: 41.2 (#31), GPT-5.6 Sol: 48.9 (#8)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
LMArena Vision12541281
GeoBench76%—
VPCT46.2%—
Blueprint-Bench 2—33.6%
Furniture Assembly—56.7%
LMArena Document—1483
SpatialViz-Bench36.9%—

Multilingual GPT-5.6 Sol leads

Gemini 2.5 Flash: 52.5 (#83), GPT-5.6 Sol: 55.4 (#32)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
LMArena Non-English14101450
LMArena Chinese14501523
LMArena French14331475
LMArena German14191476
LMArena Japanese14031475
LMArena Korean13851434
LMArena Russian14151466
LMArena Spanish14211449

Instruction Following GPT-5.6 Sol leads

Gemini 2.5 Flash: 75.9 (#50), GPT-5.6 Sol: 77.8 (#16)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
LMArena Instruction Following14051480
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#16), GPT-5.6 Sol: 45.3 (#42)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
LMArena Longer Query14191479
Fiction.LiveBench77.8%—

Writing & Preference GPT-5.6 Sol leads

Gemini 2.5 Flash: 54.0 (#153), GPT-5.6 Sol: 73.5 (#12)

BenchmarkGemini 2.5 FlashGPT-5.6 Sol
LMArena Text14171456
LMArena Creative Writing14001450
EQ-Bench Creative Writing11371972
LMArena Multi-Turn14081456
Short-Story Creative Writing76.5%—
WildBench81.7%—
EQ-Bench 4—1250

Frequently asked questions

Is Gemini 2.5 Flash better than GPT-5.6 Sol?

GPT-5.6 Sol is the stronger model overall, scoring 64.4 to 39.0 on the Noometry Index. Gemini 2.5 Flash costs 9.4× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Which is cheaper, Gemini 2.5 Flash or GPT-5.6 Sol?

Gemini 2.5 Flash is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; GPT-5.6 Sol lists at $4 and $20.

Is Gemini 2.5 Flash or GPT-5.6 Sol better for coding?

GPT-5.6 Sol scores higher on coding benchmarks: 61.1 versus 35.5 in the Noometry coding category.

Which has the bigger context window?

GPT-5.6 Sol does, with 1.05M tokens against 1.05M.

How many benchmarks do Gemini 2.5 Flash and GPT-5.6 Sol share?

34 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and GPT-5.6 Sol has 64.

Related comparisons

Go deeper