Noometry

Model comparison

Grok 4.1 Fast vs o1-mini

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 33.7 on the Noometry Index.

Last verified . 18 shared benchmarks.

Grok 4.1 Fast xAI

40.9

Rank #131 Confirmed

o1-mini OpenAI

33.7

Rank #230 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Grok 4.1 Fast scores higher in 6 categories and o1-mini in 3 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 42.3 to 8.9.
  • The biggest single-benchmark swing is SimpleBench: 56% for Grok 4.1 Fast and 18.1% for o1-mini.

Side by side

Grok 4.1 Fasto1-mini
ProviderxAIOpenAI
Noometry Index40.933.7
Released2025-06-272024-09-12
WeightsProprietaryProprietary
Context window128K—
Max output30K—
Input $ / M tokens$0.20—
Output $ / M tokens$0.50—
Results tracked3239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o1-mini leads

Grok 4.1 Fast: 33.8 (#236), o1-mini: 35.1 (#218)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Coding14111362
Aider Polyglot—32.9%
LMArena WebDev1241—
WeirdML—36.3%
LiveBench Coding—48%
ALE-Bench394.93—
HumanEval+—89%
MBPP+—78.8%

Agentic & Tool Use Grok 4.1 Fast leads

Grok 4.1 Fast: 36.1 (#35), o1-mini: 24.3 (#112)

BenchmarkGrok 4.1 Fasto1-mini
Berkeley Function Calling Leaderboard69.6%—
τ²-bench Banking13.1%—
Cybench—10%
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 42.3 (#45), o1-mini: 8.9 (#340)

BenchmarkGrok 4.1 Fasto1-mini
SimpleBench56%18.1%
LMArena Hard Prompts14071333
ARC-AGI-2—0.8%
NYT Connections (extended)87.4%—
ARC-AGI-1—14%
LiveBench Reasoning—72.3%
DTBench87.7%—
LiveBench Data Analysis—57.9%
Epoch Capabilities Index—135.82
ForecastBench61—
LiveBench—57.8%

Math o1-mini leads

Grok 4.1 Fast: 30.9 (#201), o1-mini: 33.7 (#168)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Math14081358
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—46.9%
ProofBench4%—
LiveBench Math—62%
MATH Level 5—89.2%
FrontierMath (Feb 2025 set)—1.7%

Knowledge o1-mini leads

Grok 4.1 Fast: 32.6 (#203), o1-mini: 34.8 (#180)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Expert13981316
GPQA Diamond—62.4%
Confabulations—18.6%
Vectara Hallucination Rate17.8%—

Multimodal Not comparable

Grok 4.1 Fast: 36.3 (#71), o1-mini: —

BenchmarkGrok 4.1 Fasto1-mini
LMArena Vision1201—

Multilingual Grok 4.1 Fast leads

Grok 4.1 Fast: 51.1 (#110), o1-mini: 43.8 (#177)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Non-English13911289
LMArena Chinese14411314
LMArena French14161292
LMArena German14041278
LMArena Japanese13471245
LMArena Korean13611223
LMArena Russian13871283
LMArena Spanish14111302

Instruction Following Grok 4.1 Fast leads

Grok 4.1 Fast: 72.8 (#127), o1-mini: 67.0 (#200)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Instruction Following13761304
LiveBench Instruction Following—65.4%

Long Context Grok 4.1 Fast leads

Grok 4.1 Fast: 42.4 (#121), o1-mini: 40.1 (#156)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Longer Query13901321

Writing & Preference Grok 4.1 Fast leads

Grok 4.1 Fast: 57.4 (#126), o1-mini: 48.6 (#196)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Text14081317
LMArena Creative Writing13941244
LMArena Multi-Turn13891314
Short-Story Creative Writing—64.9%
EQ-Bench Creative Writing1327—
LiveBench Language—40.9%

Frequently asked questions

Is Grok 4.1 Fast better than o1-mini?

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 33.7 on the Noometry Index.

Is Grok 4.1 Fast or o1-mini better for coding?

o1-mini scores higher on coding benchmarks: 35.1 versus 33.8 in the Noometry coding category.

How many benchmarks do Grok 4.1 Fast and o1-mini share?

18 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and o1-mini has 39.

Related comparisons

Go deeper