Model comparison

Grok 2 Mini 2024 08 13 vs Nova Premier 1.0

Grok 2 Mini 2024 08 13 and Nova Premier 1.0 score almost the same on the Noometry Index (37.7 vs 38.3), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • The widest gap is in writing & preference, where Nova Premier 1.0 leads 51.0 to 47.3.

Side by side

Grok 2 Mini 2024 08 13 and Nova Premier 1.0 specifications
Grok 2 Mini 2024 08 13Nova Premier 1.0
ProviderxAIAmazon
Noometry Index37.738.3
Released2024-08-132025-04-30
WeightsProprietaryProprietary
Context window—1M
Max output—10K
Input $ / M tokens—$2.50
Output $ / M tokens—$12.50
Results tracked176

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Grok 2 Mini 2024 08 13: 37.0 (#199), Nova Premier 1.0: —

Coding benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
LMArena Coding1269—

Reasoning Grok 2 Mini 2024 08 13 leads

Grok 2 Mini 2024 08 13: 24.8 (#159), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
Kagi LLM Benchmark—44.8%
LMArena Hard Prompts1255—

Math Grok 2 Mini 2024 08 13 leads

Grok 2 Mini 2024 08 13: 35.4 (#185), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
Omni-MATH—35%
LMArena Math1265—

Knowledge Nova Premier 1.0 leads

Grok 2 Mini 2024 08 13: 33.9 (#200), Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
MMLU-Pro—72.6%
GPQA (HELM)—51.8%
LMArena Expert1238—

Multilingual Not comparable

Grok 2 Mini 2024 08 13: 41.4 (#208), Nova Premier 1.0: —

Multilingual benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
LMArena Non-English1257—
LMArena Chinese1262—
LMArena French1286—
LMArena German1273—
LMArena Japanese1213—
LMArena Korean1195—
LMArena Russian1261—
LMArena Spanish1279—

Instruction Following Nova Premier 1.0 leads

Grok 2 Mini 2024 08 13: 65.5 (#220), Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
IFEval—80.3%
LMArena Instruction Following1245—

Long Context Not comparable

Grok 2 Mini 2024 08 13: 38.4 (#196), Nova Premier 1.0: —

Long Context benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
LMArena Longer Query1266—

Writing & Preference Nova Premier 1.0 leads

Grok 2 Mini 2024 08 13: 47.3 (#211), Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkGrok 2 Mini 2024 08 13Nova Premier 1.0
LMArena Text1281—
LMArena Creative Writing1242—
WildBench—78.8%
LMArena Multi-Turn1265—

Frequently asked questions

Is Grok 2 Mini 2024 08 13 better than Nova Premier 1.0?

Grok 2 Mini 2024 08 13 and Nova Premier 1.0 score almost the same on the Noometry Index (37.7 vs 38.3), so choose on price, context window or the category you care about most.

How many benchmarks do Grok 2 Mini 2024 08 13 and Nova Premier 1.0 share?

0 benchmarks have published results for both models. Grok 2 Mini 2024 08 13 has 17 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper