Noometry

Model comparison

Gemini 3 Flash Preview vs GPT-5.1

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 48.8 on the Noometry Index.

Last verified . 45 shared benchmarks.

Gemini 3 Flash Preview Google

52.3

Rank #33 Confirmed

GPT-5.1 OpenAI

48.8

Rank #47 Confirmed

Summary

  • They share 45 benchmarks with published results for both. Gemini 3 Flash Preview scores higher in 8 categories and GPT-5.1 in 2 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Flash Preview leads 49.2 to 39.9.
  • The biggest single-benchmark swing is SimpleQA Verified: 66.8% for Gemini 3 Flash Preview and 48% for GPT-5.1.
  • Gemini 3 Flash Preview is cheaper at $0.50 / $3 per million input/output tokens, against $1.25 / $10 for GPT-5.1.
  • Gemini 3 Flash Preview accepts more context: 1.05M tokens versus 400K.

Side by side

Gemini 3 Flash PreviewGPT-5.1
ProviderGoogleOpenAI
Noometry Index52.348.8
Released2025-12-172025-11-13
WeightsProprietaryProprietary
Context window1.05M400K
Max output66K128K
Input $ / M tokens$0.50$1.25
Output $ / M tokens$3$10
Results tracked5963

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.5 (#35), GPT-5.1: 46.9 (#59)

BenchmarkGemini 3 Flash PreviewGPT-5.1
SWE-bench Verified75.4%68%
SWE-bench Verified (bash only)75.8%66%
LMArena WebDev14391395
GSO9.8%13.7%
WeirdML61.6%60.8%
LMArena Coding14601454
ALE-Bench1,3671,192
SWE-bench Multilingual72.7%—
SciCode—43.3%
LiveBench Coding—72.5%

Agentic & Tool Use Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 38.6 (#27), GPT-5.1: 32.5 (#55)

BenchmarkGemini 3 Flash PreviewGPT-5.1
Terminal-Bench64.3%47.6%
DeepResearch Bench49.8%42.8%
LMArena Search11981199
Vending-Bench 23,6351,473
τ²-bench Airline82.5%—
τ²-bench Banking27.3%—
τ²-bench Retail76.8%—
τ²-bench Telecom91.2%—
BALROG48.1%—
GDP.pdf10%—

Reasoning Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 49.2 (#35), GPT-5.1: 39.9 (#50)

BenchmarkGemini 3 Flash PreviewGPT-5.1
ARC-AGI-233.6%17.6%
SimpleBench61.1%53.2%
ARC-AGI-184.7%72.8%
Chess Puzzles40%32%
LMArena Hard Prompts14651457
Mystery Game Puzzles26%19%
DTBench89.1%90.1%
LMCA43.1%43.9%
Epoch Capabilities Index151.83149.66
ForecastBench58.558.1
NYT Connections (extended)83.1%—
CritPt—4.9%
EnigmaEval—11.2%
LiveBench Reasoning—95.8%
LiveBench Data Analysis—72.1%
LiveBench—78.8%

Math Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.4 (#42), GPT-5.1: 50.3 (#45)

BenchmarkGemini 3 Flash PreviewGPT-5.1
OTIS Mock AIME 2024-202595.6%88.6%
LMArena Math14721446
FrontierMath (Feb 2025 set)35.6%31%
FrontierMath Tier 4 (v1)4.2%12.5%
FrontierMath (Tiers 1-3)51.2%—
FrontierMath Tier 417.1%—
MathArena Final-Answer Competitions67.6%—
ProofBench15%—
Omni-MATH—46.4%
LiveBench Math—94.5%

Knowledge Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 58.8 (#30), GPT-5.1: 50.5 (#65)

BenchmarkGemini 3 Flash PreviewGPT-5.1
GPQA Diamond89.4%87.6%
SimpleQA Verified66.8%48%
Vectara Hallucination Rate13.5%10.9%
LMArena Expert14611470
Humanity's Last Exam—23.7%
MMLU-Pro—57.9%
GPQA (HELM)—44.2%

Multimodal Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 45.3 (#15), GPT-5.1: 44.0 (#17)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Vision12851250
VPCT72.6%58.7%
LMArena Document14131403
GeoBench88%—
Blueprint-Bench 20%—

Multilingual Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 55.9 (#26), GPT-5.1: 54.0 (#51)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Non-English14581431
LMArena Chinese15101495
LMArena French14781451
LMArena German14971439
LMArena Japanese14881453
LMArena Korean14431401
LMArena Russian14801435
LMArena Spanish14701430

Instruction Following GPT-5.1 leads

Gemini 3 Flash Preview: 75.8 (#52), GPT-5.1: 84.0 (#1)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Instruction Following14371442
LiveBench Instruction Following—93.3%
IFEval—93.5%

Long Context GPT-5.1 leads

Gemini 3 Flash Preview: 44.4 (#63), GPT-5.1: 47.6 (#14)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Longer Query14521448
CL-bench—23.7%
CL-bench Life—17.3%

Writing & Preference Too close to call

Gemini 3 Flash Preview: 65.6 (#44), GPT-5.1: 64.7 (#53)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Text14661443
LMArena Creative Writing14571427
LMArena Multi-Turn14711449
WildBench—86.3%
LiveBench Language—80.2%

Frequently asked questions

Is Gemini 3 Flash Preview better than GPT-5.1?

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 48.8 on the Noometry Index.

Which is cheaper, Gemini 3 Flash Preview or GPT-5.1?

Gemini 3 Flash Preview is cheaper. It lists at $0.50 per million input tokens and $3 per million output tokens; GPT-5.1 lists at $1.25 and $10.

Is Gemini 3 Flash Preview or GPT-5.1 better for coding?

Gemini 3 Flash Preview scores higher on coding benchmarks: 51.5 versus 46.9 in the Noometry coding category.

Which has the bigger context window?

Gemini 3 Flash Preview does, with 1.05M tokens against 400K.

How many benchmarks do Gemini 3 Flash Preview and GPT-5.1 share?

45 benchmarks have published results for both models. Gemini 3 Flash Preview has 59 scored results on Noometry and GPT-5.1 has 63.

Related comparisons

Go deeper