Noometry

Model comparison

Falcon-40B vs Gemini 3.5 Flash

Gemini 3.5 Flash has enough public results to be ranked (#32); Falcon-40B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Falcon-40B Technology Innovation Institute

—

Unranked

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Summary

  • They share 1 benchmark with published results for both.
  • Falcon-40B has downloadable open weights; the other is API-only.

Side by side

Falcon-40BGemini 3.5 Flash
ProviderTechnology Innovation InstituteGoogle
Noometry Index—54.2
Released2023-03-152026-05-19
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$1.50
Output $ / M tokens—$9
Results tracked1254

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 49.4 (#49)

BenchmarkFalcon-40BGemini 3.5 Flash
SWE-bench Verified—79.3%
DeepSWE—37.4%
LMArena WebDev—1499
SciCode—53.1%
WeirdML—62.6%
LMArena Coding—1492
ALE-Bench—911.02

Agentic & Tool Use Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 24.7 (#114)

BenchmarkFalcon-40BGemini 3.5 Flash
APEX-Agents—27.5%
GBAEval—6.7%
GDP.pdf—14%
Vending-Bench 2—5,396

Reasoning Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 62.8 (#18)

BenchmarkFalcon-40BGemini 3.5 Flash
Epoch Capabilities Index104.45154.46
ARC-AGI-2—72.1%
SimpleBench—76.7%
NYT Connections (extended)—92.6%
ARC-AGI-1—92.5%
CritPt—13.1%
Chess Puzzles—50%
EnigmaEval—25.4%
EBR-Bench—4.8%
LMArena Hard Prompts—1488
Mystery Game Puzzles—32%
DTBench—94.7%
LMCA—47.1%
Surface Evolver Bench—58.1%
BIG-Bench Hard37.1%—
ForecastBench—59
HellaSwag85.3%—
LAMBADA77.3%—
PIQA83%—
WinoGrande76.9%—

Math Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 60.7 (#36)

BenchmarkFalcon-40BGemini 3.5 Flash
FrontierMath (Tiers 1-3)—62.8%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—76.3%
OTIS Mock AIME 2024-2025—95.6%
ProofBench—31%
LMArena Math—1504
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%
GSM8K33.8%—

Knowledge Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 66.3 (#11)

BenchmarkFalcon-40BGemini 3.5 Flash
GPQA Diamond—92.8%
SimpleQA Verified—66.2%
LMArena Expert—1495
ARC (AI2) Challenge61.9%—
BoolQ83.1%—
MMLU56.9%—
OpenBookQA56.6%—
TriviaQA79.9%—

Multimodal Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 45.7 (#15)

BenchmarkFalcon-40BGemini 3.5 Flash
LMArena Vision—1310
Blueprint-Bench 2—33.6%
LMArena Document—1463

Multilingual Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 57.0 (#13)

BenchmarkFalcon-40BGemini 3.5 Flash
LMArena Non-English—1476
LMArena Chinese—1526
LMArena French—1490
LMArena German—1492
LMArena Japanese—1486
LMArena Korean—1451
LMArena Russian—1493
LMArena Spanish—1480

Instruction Following Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 77.0 (#30)

BenchmarkFalcon-40BGemini 3.5 Flash
LMArena Instruction Following—1467

Long Context Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 45.4 (#38)

BenchmarkFalcon-40BGemini 3.5 Flash
LMArena Longer Query—1482

Writing & Preference Not comparable

Falcon-40B: —, Gemini 3.5 Flash: 65.5 (#47)

BenchmarkFalcon-40BGemini 3.5 Flash
LMArena Text—1482
LMArena Creative Writing—1470
EQ-Bench 4—1087
LMArena Multi-Turn—1481

Frequently asked questions

Is Falcon-40B better than Gemini 3.5 Flash?

Gemini 3.5 Flash has enough public results to be ranked (#32); Falcon-40B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-40B and Gemini 3.5 Flash share?

1 benchmark has published results for both models. Falcon-40B has 12 scored results on Noometry and Gemini 3.5 Flash has 54.

Related comparisons

Go deeper