Noometry

Model comparison

GPT-4.1 vs MiMo-V2-Flash

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 35.9 on the Noometry Index.

Last verified . 18 shared benchmarks.

GPT-4.1 OpenAI

35.9

Rank #219 Confirmed

MiMo-V2-Flash Xiaomi

41.3

Rank #138 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GPT-4.1 scores higher in 0 categories and MiMo-V2-Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where MiMo-V2-Flash leads 38.3 to 22.3.
  • MiMo-V2-Flash is cheaper at $0.14 / $0.28 per million input/output tokens, against $2 / $8 for GPT-4.1.
  • GPT-4.1 accepts more context: 1.05M tokens versus 262K.
  • MiMo-V2-Flash has downloadable open weights; the other is API-only.

Side by side

GPT-4.1MiMo-V2-Flash
ProviderOpenAIXiaomi
Noometry Index35.941.3
Released2025-04-142025-12-16
WeightsProprietaryOpen
Context window1.05M262K
Max output33K66K
Input $ / M tokens$2$0.14
Output $ / M tokens$8$0.28
Results tracked5221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2-Flash leads

GPT-4.1: 34.4 (#238), MiMo-V2-Flash: 36.1 (#211)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Coding13911443
ALE-Bench558.1737.95
SWE-bench Verified48.5%—
SWE-bench Verified (bash only)39.6%—
Aider Polyglot52.4%—
LMArena WebDev—1330
SciCode—25.9%
WeirdML39%—
CadEval42%—

Agentic & Tool Use Not comparable

GPT-4.1: 34.7 (#43), MiMo-V2-Flash: —

BenchmarkGPT-4.1MiMo-V2-Flash
Berkeley Function Calling Leaderboard54%—

Reasoning MiMo-V2-Flash leads

GPT-4.1: 11.7 (#339), MiMo-V2-Flash: 24.9 (#157)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Hard Prompts13841420
ARC-AGI-20.4%—
SimpleBench27%—
Kagi LLM Benchmark52.3%—
ARC-AGI-15.5%—
CritPt—0%
Chess Puzzles6%—
EnigmaEval2.2%—
DTBench68.3%—
LMCA25.6%—
Epoch Capabilities Index136.78—
ForecastBench61.5—

Math MiMo-V2-Flash leads

GPT-4.1: 22.3 (#280), MiMo-V2-Flash: 38.3 (#139)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Math13701396
FrontierMath (Tiers 1-3)6%—
OTIS Mock AIME 2024-202538.3%—
Omni-MATH47.1%—
MATH Level 583%—
FrontierMath (Feb 2025 set)5.5%—
FrontierMath Tier 4 (v1)0%—

Knowledge MiMo-V2-Flash leads

GPT-4.1: 37.1 (#160), MiMo-V2-Flash: 39.7 (#131)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Expert13641425
GPQA Diamond66.9%—
Humanity's Last Exam5.4%—
SimpleQA Verified31.1%—
MMLU-Pro81.1%—
Vectara Hallucination Rate5.6%—
GPQA (HELM)65.9%—

Multimodal Not comparable

GPT-4.1: 38.2 (#67), MiMo-V2-Flash: —

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Vision1211—
GeoBench72%—

Multilingual MiMo-V2-Flash leads

GPT-4.1: 49.4 (#133), MiMo-V2-Flash: 51.0 (#113)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Non-English13701392
LMArena Chinese13821462
LMArena French13821429
LMArena German13811395
LMArena Japanese13191325
LMArena Korean13391358
LMArena Russian13771387
LMArena Spanish13761420

Instruction Following MiMo-V2-Flash leads

GPT-4.1: 71.3 (#153), MiMo-V2-Flash: 73.5 (#120)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Instruction Following13671392
IFEval83.8%—

Long Context MiMo-V2-Flash leads

GPT-4.1: 40.0 (#163), MiMo-V2-Flash: 43.0 (#110)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Longer Query13851409
Fiction.LiveBench63.9%—

Writing & Preference MiMo-V2-Flash leads

GPT-4.1: 57.6 (#125), MiMo-V2-Flash: 59.7 (#106)

BenchmarkGPT-4.1MiMo-V2-Flash
LMArena Text13831411
LMArena Creative Writing13631375
LMArena Multi-Turn13981404
EQ-Bench Creative Writing1420—
WildBench85.4%—

Frequently asked questions

Is GPT-4.1 better than MiMo-V2-Flash?

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 35.9 on the Noometry Index.

Which is cheaper, GPT-4.1 or MiMo-V2-Flash?

MiMo-V2-Flash is cheaper. It lists at $0.14 per million input tokens and $0.28 per million output tokens; GPT-4.1 lists at $2 and $8.

Is GPT-4.1 or MiMo-V2-Flash better for coding?

MiMo-V2-Flash scores higher on coding benchmarks: 36.1 versus 34.4 in the Noometry coding category.

Which has the bigger context window?

GPT-4.1 does, with 1.05M tokens against 262K.

How many benchmarks do GPT-4.1 and MiMo-V2-Flash share?

18 benchmarks have published results for both models. GPT-4.1 has 52 scored results on Noometry and MiMo-V2-Flash has 21.

Related comparisons

Go deeper