Model comparison

GPT-4o mini vs Nova 2.0 Pro Preview

Nova 2.0 Pro Preview is the stronger model overall, scoring 32.8 to 25.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-4o mini OpenAI

25.4

Rank #337 Confirmed

Nova 2.0 Pro Preview Amazon

32.8

Rank #241 Reported

Summary

  • The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.2 to 21.6.

Side by side

GPT-4o mini and Nova 2.0 Pro Preview specifications
GPT-4o miniNova 2.0 Pro Preview
ProviderOpenAIAmazon
Noometry Index25.432.8
Released2024-07-182025-12-02
WeightsProprietaryProprietary
Context window128K—
Max output16K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.60—
Results tracked603

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

GPT-4o mini: 21.6 (#330), Nova 2.0 Pro Preview: 40.2 (#130)

Coding benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
Aider Polyglot3.6%—
SciCode—42.7%
WeirdML11.8%—
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
LMArena Coding1290—
BigCodeBench Complete57.4%—
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use GPT-4o mini leads

GPT-4o mini: 27.2 (#95), Nova 2.0 Pro Preview: 21.9 (#127)

Agentic & Tool Use benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
BALROG17.4%—
GDP.pdf—2%

Reasoning Nova 2.0 Pro Preview leads

GPT-4o mini: 8.7 (#343), Nova 2.0 Pro Preview: 21.7 (#189)

Reasoning benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
ARC-AGI-20%—
SimpleBench10.7%—
Kagi LLM Benchmark28.8%—
CritPt—0%
Chess Puzzles0%—
LiveBench Reasoning32.8%—
LMArena Hard Prompts1267—
Mystery Game Puzzles12%—
DTBench54.4%—
LiveBench Data Analysis50%—
LMCA10.4%—
Epoch Capabilities Index126.56—
LiveBench41.3%—
PIQA88.7%—

Math Not comparable

GPT-4o mini: 9.9 (#307), Nova 2.0 Pro Preview: —

Math benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.9%—
Omni-MATH28%—
LiveBench Math36.3%—
LMArena Math1267—
MATH Level 552.6%—
GSM8K91.3%—

Knowledge Not comparable

GPT-4o mini: 17.7 (#279), Nova 2.0 Pro Preview: —

Knowledge benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
GPQA Diamond37.7%—
SimpleQA Verified8.3%—
MMLU-Pro60.3%—
Confabulations37.2%—
GPQA (HELM)36.8%—
LMArena Expert1235—
BoolQ88.7%—
MMLU81.8%—

Multimodal Not comparable

GPT-4o mini: 25.3 (#117), Nova 2.0 Pro Preview: —

Multimodal benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
LMArena Vision1066—
Video-MME64.8%—
GeoBench64%—
VPCT34%—

Multilingual Not comparable

GPT-4o mini: 42.2 (#194), Nova 2.0 Pro Preview: —

Multilingual benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
LMArena Non-English1266—
LMArena Chinese1264—
LMArena French1296—
LMArena German1272—
LMArena Japanese1216—
LMArena Korean1195—
LMArena Russian1275—
LMArena Spanish1276—

Instruction Following Not comparable

GPT-4o mini: 62.1 (#234), Nova 2.0 Pro Preview: —

Instruction Following benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
LiveBench Instruction Following56.8%—
IFEval78.2%—
LMArena Instruction Following1259—

Long Context Not comparable

GPT-4o mini: 39.1 (#181), Nova 2.0 Pro Preview: —

Long Context benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
LMArena Longer Query1289—

Writing & Preference Not comparable

GPT-4o mini: 39.7 (#243), Nova 2.0 Pro Preview: —

Writing & Preference benchmarks
BenchmarkGPT-4o miniNova 2.0 Pro Preview
LMArena Text1286—
LMArena Creative Writing1268—
Short-Story Creative Writing67.2%—
EQ-Bench Creative Writing873—
WildBench79.1%—
LMArena Multi-Turn1285—
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than Nova 2.0 Pro Preview?

Nova 2.0 Pro Preview is the stronger model overall, scoring 32.8 to 25.4 on the Noometry Index.

Is GPT-4o mini or Nova 2.0 Pro Preview better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.2 versus 21.6 in the Noometry coding category.

How many benchmarks do GPT-4o mini and Nova 2.0 Pro Preview share?

0 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and Nova 2.0 Pro Preview has 3.

Related comparisons

Go deeper