Noometry

Model comparison

Amazon Nova Pro vs Qwen1.5-7B

Amazon Nova Pro and Qwen1.5-7B score almost the same on the Noometry Index (31.0 vs 31.4), so choose on price, context window or the category you care about most.

Last verified . 13 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Qwen1.5-7B Alibaba (Qwen)

31.4

Rank #273 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Amazon Nova Pro scores higher in 5 categories and Qwen1.5-7B in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Pro leads 43.9 to 29.6.
  • Qwen1.5-7B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova ProQwen1.5-7B
ProviderAmazonAlibaba (Qwen)
Noometry Index31.031.4
Released2024-12-032024-02-04
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3813

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Pro leads

Amazon Nova Pro: 35.1 (#229), Qwen1.5-7B: 32.2 (#276)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Coding12701107
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Qwen1.5-7B: —

BenchmarkAmazon Nova ProQwen1.5-7B
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Too close to call

Amazon Nova Pro: 20.0 (#243), Qwen1.5-7B: 20.4 (#240)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Hard Prompts12461065
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Qwen1.5-7B leads

Amazon Nova Pro: 28.5 (#243), Qwen1.5-7B: 31.4 (#224)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Math12521080
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Qwen1.5-7B leads

Amazon Nova Pro: 27.4 (#250), Qwen1.5-7B: 28.7 (#243)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Expert12111055
MMLU82%62.6%
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Qwen1.5-7B: —

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Vision980—

Multilingual Amazon Nova Pro leads

Amazon Nova Pro: 39.7 (#223), Qwen1.5-7B: 28.5 (#271)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Non-English12341058
LMArena Chinese12441141
LMArena Russian12401006
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Spanish1182—

Instruction Following Amazon Nova Pro leads

Amazon Nova Pro: 64.9 (#226), Qwen1.5-7B: 54.1 (#281)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Instruction Following12351058
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Amazon Nova Pro leads

Amazon Nova Pro: 38.1 (#205), Qwen1.5-7B: 33.1 (#266)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Longer Query12551090

Writing & Preference Amazon Nova Pro leads

Amazon Nova Pro: 43.9 (#226), Qwen1.5-7B: 29.6 (#293)

BenchmarkAmazon Nova ProQwen1.5-7B
LMArena Text12591083
LMArena Creative Writing12121035
LMArena Multi-Turn12461062
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Qwen1.5-7B?

Amazon Nova Pro and Qwen1.5-7B score almost the same on the Noometry Index (31.0 vs 31.4), so choose on price, context window or the category you care about most.

Is Amazon Nova Pro or Qwen1.5-7B better for coding?

Amazon Nova Pro scores higher on coding benchmarks: 35.1 versus 32.2 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Qwen1.5-7B share?

13 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Qwen1.5-7B has 13.

Related comparisons

Go deeper