Model comparison

Gemini 3.8 Flash vs Step 5 Preview

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 47.9 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 3.8 Flash scores higher in 8 categories and Step 5 Preview in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.8 Flash leads 76.9 to 40.0.
  • The biggest single-benchmark swing is ProofBench: 48% for Gemini 3.8 Flash and 42% for Step 5 Preview.
  • Both cost about the same: $0.75 input and $3.75 output per million tokens.
  • Gemini 3.8 Flash accepts more context: 1.05M tokens versus 1.02M.

Side by side

Gemini 3.8 Flash and Step 5 Preview specifications
Gemini 3.8 FlashStep 5 Preview
ProviderGoogleStepFun
Noometry Index61.847.9
Released2026-09-022026-09-16
WeightsProprietaryProprietary
Context window1.05M1.02M
Max output66K66K
Input $ / M tokens$0.75$1
Output $ / M tokens$3.75$2.70
Results tracked5018

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

Gemini 3.8 Flash: 59.2 (#15), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
LMArena WebDev15841564
SciCode56.6%58.9%
LMArena Coding15101480
DeepSWE73.8%—
FrontierCode41.2%—
CursorBench39.6%—
FrontierSWE19.6%—
WeirdML84.8%—
ALE-Bench1,270—

Agentic & Tool Use Not comparable

Gemini 3.8 Flash: 41.8 (#21), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
APEX-Agents64.3%—
Remote Labor Index5.8%—
GDP.pdf23.4%—
Vending-Bench 25,094—

Reasoning Gemini 3.8 Flash leads

Gemini 3.8 Flash: 76.9 (#5), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
CritPt18.3%20.9%
LMArena Hard Prompts15081465
ARC-AGI-289.2%—
NYT Connections (extended)97.4%—
ARC-AGI-198.5%—
Chess Puzzles61%—
Mystery Game Puzzles47%—
DTBench95.7%—
LMCA52.9%—
Surface Evolver Bench76.9%—
Epoch Capabilities Index156.71—

Math Gemini 3.8 Flash leads

Gemini 3.8 Flash: 65.3 (#28), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
ProofBench48%42%
LMArena Math15281470
FrontierMath (Tiers 1-3)68.4%—
FrontierMath Tier 422%—
OTIS Mock AIME 2024-202598.9%—

Knowledge Gemini 3.8 Flash leads

Gemini 3.8 Flash: 74.8 (#2), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
LMArena Expert15241470
GPQA Diamond95.4%—
Humanity's Last Exam44.5%—
SimpleQA Verified69.7%—

Multimodal Too close to call

Gemini 3.8 Flash: 40.7 (#45), Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
LMArena Vision13141267
Blueprint-Bench 238.6%—
Furniture Assembly31.7%—

Multilingual Gemini 3.8 Flash leads

Gemini 3.8 Flash: 58.0 (#5), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
LMArena Non-English14911432
LMArena Chinese15541519
LMArena Russian15151436
LMArena Spanish14851439
LMArena French1498—
LMArena German1493—
LMArena Japanese1502—
LMArena Korean1459—

Instruction Following Gemini 3.8 Flash leads

Gemini 3.8 Flash: 78.0 (#13), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
LMArena Instruction Following14901444

Long Context Gemini 3.8 Flash leads

Gemini 3.8 Flash: 46.3 (#24), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
LMArena Longer Query15081455

Writing & Preference Gemini 3.8 Flash leads

Gemini 3.8 Flash: 72.2 (#15), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkGemini 3.8 FlashStep 5 Preview
LMArena Text14991442
LMArena Creative Writing14921410
LMArena Multi-Turn15011447
EQ-Bench Creative Writing1748—

Frequently asked questions

Is Gemini 3.8 Flash better than Step 5 Preview?

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 47.9 on the Noometry Index.

Which is cheaper, Gemini 3.8 Flash or Step 5 Preview?

Step 5 Preview is cheaper. It lists at $1 per million input tokens and $2.70 per million output tokens; Gemini 3.8 Flash lists at $0.75 and $3.75.

Is Gemini 3.8 Flash or Step 5 Preview better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 59.2 versus 51.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.8 Flash does, with 1.05M tokens against 1.02M.

How many benchmarks do Gemini 3.8 Flash and Step 5 Preview share?

18 benchmarks have published results for both models. Gemini 3.8 Flash has 50 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper