Model comparison

Nova 2.0 Pro Preview vs Phi 3 Medium 4k Instruct

Nova 2.0 Pro Preview and Phi 3 Medium 4k Instruct score almost the same on the Noometry Index (33.4 vs 33.0), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Nova 2.0 Pro Preview Amazon

33.4

Rank #244 Reported

Phi 3 Medium 4k Instruct Microsoft

33.0

Rank #250 Confirmed

Summary

  • The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.8 to 32.9.
  • Phi 3 Medium 4k Instruct has downloadable open weights; the other is API-only.

Side by side

Nova 2.0 Pro Preview and Phi 3 Medium 4k Instruct specifications
Nova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
ProviderAmazonMicrosoft
Noometry Index33.433.0
Released2025-12-02—
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

Nova 2.0 Pro Preview: 40.8 (#133), Phi 3 Medium 4k Instruct: 32.9 (#268)

Coding benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
SciCode42.7%—
LMArena Coding—1130

Agentic & Tool Use Not comparable

Nova 2.0 Pro Preview: 21.9 (#136), Phi 3 Medium 4k Instruct: —

Agentic & Tool Use benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
GDP.pdf2%—

Reasoning Too close to call

Nova 2.0 Pro Preview: 22.4 (#194), Phi 3 Medium 4k Instruct: 21.7 (#214)

Reasoning benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
CritPt0%—
LMArena Hard Prompts—1127

Math Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Medium 4k Instruct: 33.4 (#202)

Math benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
LMArena Math—1173

Knowledge Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Medium 4k Instruct: 30.2 (#229)

Knowledge benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
LMArena Expert—1108

Multilingual Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Medium 4k Instruct: 30.6 (#263)

Multilingual benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
LMArena Non-English—1094
LMArena Chinese—1108
LMArena French—1110
LMArena German—1101
LMArena Japanese—1042
LMArena Korean—954
LMArena Russian—1145
LMArena Spanish—1095

Instruction Following Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Medium 4k Instruct: 57.6 (#268)

Instruction Following benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
LMArena Instruction Following—1113

Long Context Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Medium 4k Instruct: 34.0 (#255)

Long Context benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
LMArena Longer Query—1120

Writing & Preference Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Medium 4k Instruct: 34.1 (#272)

Writing & Preference benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Medium 4k Instruct
LMArena Text—1138
LMArena Creative Writing—1107
LMArena Multi-Turn—1088

Frequently asked questions

Is Nova 2.0 Pro Preview better than Phi 3 Medium 4k Instruct?

Nova 2.0 Pro Preview and Phi 3 Medium 4k Instruct score almost the same on the Noometry Index (33.4 vs 33.0), so choose on price, context window or the category you care about most.

Is Nova 2.0 Pro Preview or Phi 3 Medium 4k Instruct better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 32.9 in the Noometry coding category.

How many benchmarks do Nova 2.0 Pro Preview and Phi 3 Medium 4k Instruct share?

0 benchmarks have published results for both models. Nova 2.0 Pro Preview has 3 scored results on Noometry and Phi 3 Medium 4k Instruct has 17.

Related comparisons

Go deeper