Google, open weights
Gemma 7B
Gemma 7B by Google ranks 299th of 354 ranked models on the Noometry Index as of October 2026, with a score of 30.0. Its strongest category is math, where it ranks 228th.
Last verified
Specifications
- Noometry rank
- #299 of 354
- Index score
- 30.0
- Evidence
- Confirmed 27 results
- Provider
Google- Released
- February 21, 2024
- Weights
- Open weights
- Reasoning
- Unknown
- Context window
- —
- Max output
- —
- Input price
- Not listed
- Output price
- Not listed
- Blended price
- Not listed
- Output speed
- Not measured
- Value
- Not ranked
- Knowledge cutoff
- Unknown
Category scores
Each category score combines every public result we have in that category.
- Coding 30.5
- Reasoning 19.9
- Math 31.2
- Knowledge 27.3
- Multilingual 25.1
- Instruction Following 51.5
- Long Context 31.1
- Writing & Preference 27.1
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 30.5 | #294 | 1 |
| Reasoning | 19.9 | #249 | 1 |
| Math | 31.2 | #228 | 1 |
| Knowledge | 27.3 | #252 | 1 |
| Multilingual | 25.1 | #287 | 1 |
| Instruction Following | 51.5 | #295 | 1 |
| Long Context | 31.1 | #282 | 1 |
| Writing & Preference | 27.1 | #302 | 3 |
Strengths and weaknesses
Categories where Gemma 7B places highest and lowest among the models ranked in each, with its score against that category's median.
Strongest categories
Weakest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Writing & Preference | 27.1 | −26.7 | #302 of 312, top 97% |
| Instruction Following | 51.5 | −19.8 | #295 of 305, top 97% |
| Multilingual | 25.1 | −22.3 | #287 of 297, top 97% |
Closest competitors
The models ranked just above and below Gemma 7B. When scores are this close, price and speed are often the better way to choose.
| Model | Rank | Score | Blended $/M | Speed | |
|---|---|---|---|---|---|
| Olmo 7b Instruct | #295 | 30.3 | — | — | Compare |
| Magistral Small | #296 | 30.2 | $0.75 | 0 | Compare |
| Qwen2.5 32B Instruct | #297 | 30.1 | $1.22 | — | Compare |
| Palm 2 | #298 | 30.0 | — | — | Compare |
| Qwen2-72B | #300 | 30.0 | — | — | Compare |
| Gemini 1.5 Flash 8B | #301 | 29.9 | — | — | Compare |
| Qwen2.5-VL 72B Instruct | #302 | 29.9 | $4.20 | 43 | Compare |
| Mistral | #303 | 29.9 | — | — | Compare |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Coding | 1048 | #282 of 294, top 96% | LMArena | 2026-10-08 | |
| HumanEval+ | 28.7% | #42 of 45, top 94% | EvalPlus | ||
| HumanEval+ | 25% | EvalPlus | |||
| MBPP+ | 43.4% | #35 of 38, top 93% | EvalPlus | ||
| MBPP+ | 36.8% | EvalPlus |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Hard Prompts | 1042 | #284 of 297, top 96% | LMArena | 2026-10-08 | |
| Adversarial NLI | 48.7% | #7 of 9, top 78% | Epoch AI | ||
| BIG-Bench Hard | 55.1% | #17 of 27, top 63% | Epoch AI | ||
| Epoch Capabilities Index | 111.99 | #190 of 213, top 90% | Epoch AI | 2024-02-21 | |
| HellaSwag | 82.2% | #15 of 29, top 52% | Epoch AI | ||
| PIQA | 81.2% | #17 of 27, top 63% | Epoch AI | ||
| WinoGrande | 79% | #16 of 43, top 38% | Epoch AI |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Math | 1066 | #274 of 285, top 97% | LMArena | 2026-10-08 | |
| GSM8K | 46.4% | #23 of 38, top 61% | Epoch AI |
Knowledge
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Expert | 1001 | #270 of 273, top 99% | LMArena | 2026-10-08 | |
| ARC (AI2) Challenge | 78.3% | #14 of 39, top 36% | Epoch AI | ||
| BoolQ | 83.2% | #11 of 23, top 48% | Epoch AI | ||
| MMLU | 66.1% | #54 of 81, top 67% | Epoch AI | ||
| OpenBookQA | 78.6% | #8 of 19, top 43% | Epoch AI | ||
| TriviaQA | 72.3% | #18 of 25, top 72% | Epoch AI |
Multilingual
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Non-English | 999 | #287 of 297, top 97% | LMArena | 2026-10-08 | |
| LMArena Chinese | 1035 | #268 of 285, top 95% | LMArena | 2026-10-08 | |
| LMArena French | 1025 | #222 of 223, top 100% | LMArena | 2026-10-08 | |
| LMArena Russian | 993 | #277 of 283, top 98% | LMArena | 2026-10-08 |
Instruction Following
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Instruction Following | 1017 | #290 of 298, top 98% | LMArena | 2026-10-08 |
Long Context
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Longer Query | 1022 | #283 of 291, top 98% | LMArena | 2026-10-08 |
Writing & Preference
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Text | 1056 | #285 of 297, top 96% | LMArena | 2026-10-08 | |
| LMArena Creative Writing | 1024 | #288 of 295, top 98% | LMArena | 2026-10-08 | |
| LMArena Multi-Turn | 963 | #291 of 295, top 99% | LMArena | 2026-10-08 |
Compare Gemma 7B
- Gemma 7B vs Palm 2
- Gemma 7B vs Qwen2-72B
- Gemma 7B vs Qwen2.5 32B Instruct
- Gemma 7B vs Gemini 1.5 Flash 8B
- Gemma 7B vs Magistral Small
- Gemma 7B vs Qwen2.5-VL 72B Instruct
- Gemma 7B vs GPT-6 Astra
- Gemma 7B vs Claude Fable 5.1
- Gemma 7B vs Kimi K3
- Gemma 7B vs Grok 4.6
- Gemma 7B vs Qwen3.8 Max
- Gemma 7B vs GLM-5.3
- Gemma 7B vs Muse Spark 1.3
- Gemma 7B vs DeepSeek V4 Pro
Other Google models
Frequently asked questions
How good is Gemma 7B?
Gemma 7B by Google ranks 299th of 354 ranked models on the Noometry Index as of October 2026, with a score of 30.0. Its strongest category is math, where it ranks 228th.
Is Gemma 7B open source?
Yes. Gemma 7B's weights are downloadable; check the license for commercial terms.
What are Gemma 7B's strengths and weaknesses?
Relative to other ranked models, Gemma 7B places best in math, reasoning, knowledge and lowest in writing & preference, instruction following, multilingual.
What is Gemma 7B best at?
Its best category is math, where it ranks 228th on Noometry.