Noometry

Model comparison

Amazon Nova Micro vs Gemma 7B

Amazon Nova Micro and Gemma 7B score almost the same on the Noometry Index (30.4 vs 30.0), so choose on price, context window or the category you care about most.

Last verified . 14 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Gemma 7B Google

30.0

Rank #299 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Amazon Nova Micro scores higher in 5 categories and Gemma 7B in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Micro leads 39.5 to 27.1.
  • Gemma 7B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroGemma 7B
ProviderAmazonGoogle
Noometry Index30.430.0
Released2024-12-032024-02-21
WeightsProprietaryOpen
Context window128K—
Max output10K—
Input $ / M tokens$0.035—
Output $ / M tokens$0.14—
Results tracked3227

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Micro: 30.5 (#295), Gemma 7B: 30.5 (#294)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Coding12181048
LiveBench Coding20.2%—
HumanEval+—28.7%
MBPP+—43.4%

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Gemma 7B: —

BenchmarkAmazon Nova MicroGemma 7B
Berkeley Function Calling Leaderboard22.3%—

Reasoning Gemma 7B leads

Amazon Nova Micro: 17.4 (#294), Gemma 7B: 19.9 (#249)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Hard Prompts11911042
LiveBench Reasoning25.1%—
LiveBench Data Analysis34%—
Adversarial NLI—48.7%
BIG-Bench Hard—55.1%
Epoch Capabilities Index—111.99
HellaSwag—82.2%
LiveBench29.6%—
PIQA—81.2%
WinoGrande—79%

Math Gemma 7B leads

Amazon Nova Micro: 26.9 (#254), Gemma 7B: 31.2 (#228)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Math12061066
Omni-MATH21.4%—
LiveBench Math34.5%—
GSM8K—46.4%

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Gemma 7B: 27.3 (#252)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Expert11841001
MMLU70.8%66.1%
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
ARC (AI2) Challenge—78.3%
BoolQ—83.2%
OpenBookQA—78.6%
TriviaQA—72.3%

Multilingual Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#239), Gemma 7B: 25.1 (#287)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Non-English1186999
LMArena Chinese12091035
LMArena French12381025
LMArena Russian1185993
LMArena German1192—
LMArena Japanese1154—
LMArena Korean1150—
LMArena Spanish1225—

Instruction Following Amazon Nova Micro leads

Amazon Nova Micro: 56.3 (#272), Gemma 7B: 51.5 (#295)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Instruction Following11741017
LiveBench Instruction Following48%—
IFEval76%—

Long Context Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#229), Gemma 7B: 31.1 (#282)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Longer Query12051022

Writing & Preference Amazon Nova Micro leads

Amazon Nova Micro: 39.5 (#247), Gemma 7B: 27.1 (#302)

BenchmarkAmazon Nova MicroGemma 7B
LMArena Text12081056
LMArena Creative Writing11721024
LMArena Multi-Turn1178963
WildBench74.3%—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Gemma 7B?

Amazon Nova Micro and Gemma 7B score almost the same on the Noometry Index (30.4 vs 30.0), so choose on price, context window or the category you care about most.

Is Amazon Nova Micro or Gemma 7B better for coding?

They score almost the same on coding (30.5 vs 30.5); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Micro and Gemma 7B share?

14 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Gemma 7B has 27.

Related comparisons

Go deeper