Noometry

Model comparison

Gemini 3.8 Flash vs Qwen2.5 14B Instruct

Gemini 3.8 Flash has enough public results to be ranked (#11); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

Qwen2.5 14B Instruct Alibaba (Qwen)

38.7

Unranked Sparse

Summary

  • The widest gap is in coding, where Gemini 3.8 Flash leads 59.2 to 37.7.
  • Qwen2.5 14B Instruct is cheaper at $0.35 / $1.40 per million input/output tokens, against $0.75 / $3.75 for Gemini 3.8 Flash.
  • Gemini 3.8 Flash accepts more context: 1.05M tokens versus 131K.
  • Qwen2.5 14B Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 3.8 FlashQwen2.5 14B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index61.838.7
Released2026-09-022024-09
WeightsProprietaryOpen
Context window1.05M131K
Max output66K8K
Input $ / M tokens$0.75$0.35
Output $ / M tokens$3.75$1.40
Results tracked503

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

Gemini 3.8 Flash: 59.2 (#15), Qwen2.5 14B Instruct: 37.7 (#191)

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
DeepSWE73.8%—
FrontierCode41.2%—
CursorBench39.6%—
LMArena WebDev1584—
FrontierSWE19.6%—
SciCode56.6%—
WeirdML84.8%—
BigCodeBench Instruct—39.8%
LMArena Coding1510—
BigCodeBench Complete—52.2%
ALE-Bench1,270—

Agentic & Tool Use Not comparable

Gemini 3.8 Flash: 41.8 (#21), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
APEX-Agents64.3%—
Remote Labor Index5.8%—
GDP.pdf23.4%—
Vending-Bench 25,094—

Reasoning Not comparable

Gemini 3.8 Flash: 76.9 (#5), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
ARC-AGI-289.2%—
NYT Connections (extended)97.4%—
ARC-AGI-198.5%—
CritPt18.3%—
Chess Puzzles61%—
LMArena Hard Prompts1508—
Mystery Game Puzzles47%—
DTBench95.7%—
LMCA52.9%—
Surface Evolver Bench76.9%—
Epoch Capabilities Index156.71—

Math Not comparable

Gemini 3.8 Flash: 65.3 (#28), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
FrontierMath (Tiers 1-3)68.4%—
FrontierMath Tier 422%—
OTIS Mock AIME 2024-202598.9%—
ProofBench48%—
LMArena Math1528—

Knowledge Not comparable

Gemini 3.8 Flash: 74.8 (#2), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
GPQA Diamond95.4%—
Humanity's Last Exam44.5%—
SimpleQA Verified69.7%—
LMArena Expert1524—
MMLU—79.9%

Multimodal Not comparable

Gemini 3.8 Flash: 40.7 (#45), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
LMArena Vision1314—
Blueprint-Bench 238.6%—
Furniture Assembly31.7%—

Multilingual Not comparable

Gemini 3.8 Flash: 58.0 (#5), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
LMArena Non-English1491—
LMArena Chinese1554—
LMArena French1498—
LMArena German1493—
LMArena Japanese1502—
LMArena Korean1459—
LMArena Russian1515—
LMArena Spanish1485—

Instruction Following Not comparable

Gemini 3.8 Flash: 78.0 (#13), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
LMArena Instruction Following1490—

Long Context Not comparable

Gemini 3.8 Flash: 46.3 (#24), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
LMArena Longer Query1508—

Writing & Preference Not comparable

Gemini 3.8 Flash: 72.2 (#15), Qwen2.5 14B Instruct: —

BenchmarkGemini 3.8 FlashQwen2.5 14B Instruct
LMArena Text1499—
LMArena Creative Writing1492—
EQ-Bench Creative Writing1748—
LMArena Multi-Turn1501—

Frequently asked questions

Is Gemini 3.8 Flash better than Qwen2.5 14B Instruct?

Gemini 3.8 Flash has enough public results to be ranked (#11); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Which is cheaper, Gemini 3.8 Flash or Qwen2.5 14B Instruct?

Qwen2.5 14B Instruct is cheaper. It lists at $0.35 per million input tokens and $1.40 per million output tokens; Gemini 3.8 Flash lists at $0.75 and $3.75.

Is Gemini 3.8 Flash or Qwen2.5 14B Instruct better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 59.2 versus 37.7 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.8 Flash does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 3.8 Flash and Qwen2.5 14B Instruct share?

0 benchmarks have published results for both models. Gemini 3.8 Flash has 50 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper