Noometry

Model comparison

Amazon Nova Lite vs OLMo 2 Furious 13B

Amazon Nova Lite is the stronger model overall, scoring 31.4 to 29.2 on the Noometry Index.

Last verified . 12 shared benchmarks.

Amazon Nova Lite Amazon

31.4

Rank #262 Confirmed

OLMo 2 Furious 13B Allen Institute for AI (Ai2)

29.2

Rank #301 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Lite scores higher in 4 categories and OLMo 2 Furious 13B in 2 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Lite leads 26.0 to 18.0.
  • The biggest single-benchmark swing is MMLU-Pro: 60% for Amazon Nova Lite and 31% for OLMo 2 Furious 13B.
  • OLMo 2 Furious 13B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteOLMo 2 Furious 13B
ProviderAmazonAllen Institute for AI (Ai2)
Noometry Index31.429.2
Released2024-12-032024-12-31
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.24—
Results tracked3412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Lite leads

Amazon Nova Lite: 32.0 (#266), OLMo 2 Furious 13B: 28.1 (#309)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LiveBench Coding27.5%10.4%
LMArena Coding1239—
ALE-Bench236.25—

Reasoning Amazon Nova Lite leads

Amazon Nova Lite: 18.5 (#257), OLMo 2 Furious 13B: 14.8 (#312)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LiveBench Reasoning36.7%16.3%
LiveBench Data Analysis37.2%20.6%
LiveBench36.4%22.1%
LMArena Hard Prompts1220—

Math Amazon Nova Lite leads

Amazon Nova Lite: 25.8 (#243), OLMo 2 Furious 13B: 21.3 (#270)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
Omni-MATH23.3%15.6%
LiveBench Math36.7%13.6%
LMArena Math1227—

Knowledge Amazon Nova Lite leads

Amazon Nova Lite: 26.0 (#254), OLMo 2 Furious 13B: 18.0 (#278)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
MMLU-Pro60%31%
GPQA (HELM)39.7%31.6%
Humanity's Last Exam3.6%—
Vectara Hallucination Rate6.1%—
LMArena Expert1201—
MMLU77%—

Multimodal Not comparable

Amazon Nova Lite: 25.0 (#118), OLMo 2 Furious 13B: —

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LMArena Vision990—

Multilingual Not comparable

Amazon Nova Lite: 38.2 (#227), OLMo 2 Furious 13B: —

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LMArena Non-English1208—
LMArena Chinese1225—
LMArena French1237—
LMArena German1229—
LMArena Japanese1153—
LMArena Korean1153—
LMArena Russian1216—
LMArena Spanish1225—

Instruction Following OLMo 2 Furious 13B leads

Amazon Nova Lite: 59.6 (#250), OLMo 2 Furious 13B: 61.1 (#243)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LiveBench Instruction Following54.1%60.6%
IFEval77.6%73%
LMArena Instruction Following1205—

Long Context Not comparable

Amazon Nova Lite: 37.4 (#212), OLMo 2 Furious 13B: —

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LMArena Longer Query1234—

Writing & Preference Too close to call

Amazon Nova Lite: 42.3 (#232), OLMo 2 Furious 13B: 43.0 (#226)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
WildBench75%68.9%
LiveBench Language25.9%11.2%
LMArena Text1229—
LMArena Creative Writing1197—
LMArena Multi-Turn1199—

Frequently asked questions

Is Amazon Nova Lite better than OLMo 2 Furious 13B?

Amazon Nova Lite is the stronger model overall, scoring 31.4 to 29.2 on the Noometry Index.

Is Amazon Nova Lite or OLMo 2 Furious 13B better for coding?

Amazon Nova Lite scores higher on coding benchmarks: 32.0 versus 28.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Lite and OLMo 2 Furious 13B share?

12 benchmarks have published results for both models. Amazon Nova Lite has 34 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper