Noometry

Model comparison

Gemma 3 4B vs MiMo-V2-Flash

MiMo-V2-Flash is the stronger model overall, scoring 40.8 to 27.9 on the Noometry Index. Gemma 3 4B costs 3.5× less per token, which makes it the better buy when MiMo-V2-Flash's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

Gemma 3 4B Google

27.9

Rank #320 Confirmed

MiMo-V2-Flash Xiaomi

40.8

Rank #137 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 3 4B scores higher in 0 categories and MiMo-V2-Flash in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiMo-V2-Flash leads 39.1 to 11.8.
  • Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.14 / $0.28 for MiMo-V2-Flash.
  • MiMo-V2-Flash accepts more context: 262K tokens versus 131K.

Side by side

Gemma 3 4BMiMo-V2-Flash
ProviderGoogleXiaomi
Noometry Index27.940.8
Released2025-03-122025-12-16
WeightsOpenOpen
Context window131K262K
Max output4K66K
Input $ / M tokens$0.04$0.14
Output $ / M tokens$0.08$0.28
Results tracked2221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemma 3 4B: 35.3 (#214), MiMo-V2-Flash: 35.8 (#205)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Coding12301443
LMArena WebDev—1330
SciCode—25.9%
ALE-Bench—737.95

Agentic & Tool Use Not comparable

Gemma 3 4B: 20.7 (#134), MiMo-V2-Flash: —

BenchmarkGemma 3 4BMiMo-V2-Flash
Berkeley Function Calling Leaderboard19.6%—

Reasoning MiMo-V2-Flash leads

Gemma 3 4B: 12.7 (#330), MiMo-V2-Flash: 24.1 (#155)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Hard Prompts12531420
Kagi LLM Benchmark25.2%—
CritPt—0%
Chess Puzzles0%—
DTBench50.9%—
LMCA2.8%—
Epoch Capabilities Index116.02—

Math MiMo-V2-Flash leads

Gemma 3 4B: 15.8 (#286), MiMo-V2-Flash: 35.6 (#141)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Math12391396
OTIS Mock AIME 2024-20257.5%—

Knowledge MiMo-V2-Flash leads

Gemma 3 4B: 11.8 (#294), MiMo-V2-Flash: 39.1 (#126)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Expert12231425
GPQA Diamond23.2%—
Vectara Hallucination Rate6.4%—

Multilingual MiMo-V2-Flash leads

Gemma 3 4B: 42.7 (#189), MiMo-V2-Flash: 51.1 (#109)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Non-English12731391
LMArena German12811395
LMArena Russian12941387
LMArena Chinese—1463
LMArena French—1429
LMArena Japanese—1324
LMArena Korean—1358
LMArena Spanish—1420

Instruction Following MiMo-V2-Flash leads

Gemma 3 4B: 65.4 (#219), MiMo-V2-Flash: 73.7 (#115)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Instruction Following12391392

Long Context MiMo-V2-Flash leads

Gemma 3 4B: 38.6 (#189), MiMo-V2-Flash: 43.0 (#106)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Longer Query12741409

Writing & Preference MiMo-V2-Flash leads

Gemma 3 4B: 42.2 (#234), MiMo-V2-Flash: 59.9 (#101)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Text12911411
LMArena Creative Writing12701375
LMArena Multi-Turn12551404
EQ-Bench Creative Writing1068—

Frequently asked questions

Is Gemma 3 4B better than MiMo-V2-Flash?

MiMo-V2-Flash is the stronger model overall, scoring 40.8 to 27.9 on the Noometry Index. Gemma 3 4B costs 3.5× less per token, which makes it the better buy when MiMo-V2-Flash's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 4B or MiMo-V2-Flash?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; MiMo-V2-Flash lists at $0.14 and $0.28.

Is Gemma 3 4B or MiMo-V2-Flash better for coding?

They score almost the same on coding (35.3 vs 35.8); test both on your own repository before choosing.

Which has the bigger context window?

MiMo-V2-Flash does, with 262K tokens against 131K.

How many benchmarks do Gemma 3 4B and MiMo-V2-Flash share?

12 benchmarks have published results for both models. Gemma 3 4B has 22 scored results on Noometry and MiMo-V2-Flash has 21.

Related comparisons

Go deeper