Model comparison
Gemma 3 4B vs Llama 3.2 3B
Gemma 3 4B and Llama 3.2 3B score almost the same on the Noometry Index (28.1 vs 28.9), so choose on price, context window or the category you care about most.
Last verified . 14 shared benchmarks.
Summary
- They share 14 benchmarks with published results for both. Gemma 3 4B scores higher in 6 categories and Llama 3.2 3B in 3 categories; 8 gaps are clear of the uncertainty.
- The widest gap is in knowledge, where Llama 3.2 3B leads 29.7 to 11.8.
- Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.05 / $0.33 for Llama 3.2 3B.
Side by side
| Gemma 3 4B | Llama 3.2 3B | |
|---|---|---|
| Provider | Meta | |
| Noometry Index | 28.1 | 28.9 |
| Released | 2025-03-12 | 2024-09-24 |
| Weights | Open | Open |
| Context window | 131K | 131K |
| Max output | 4K | 118K |
| Input $ / M tokens | $0.04 | $0.05 |
| Output $ / M tokens | $0.08 | $0.33 |
| Results tracked | 22 | 18 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Gemma 3 4B leads
Gemma 3 4B: 35.9 (#215), Llama 3.2 3B: 27.6 (#319)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Coding | 1230 | 1098 |
| BigCodeBench Instruct | — | 23.4% |
| BigCodeBench Complete | — | 28.3% |
Agentic & Tool Use Too close to call
Gemma 3 4B: 20.9 (#142), Llama 3.2 3B: 20.1 (#143)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| Berkeley Function Calling Leaderboard | 19.6% | 21.9% |
| BALROG | — | 10.1% |
Reasoning Llama 3.2 3B leads
Gemma 3 4B: 13.2 (#335), Llama 3.2 3B: 21.0 (#228)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Hard Prompts | 1253 | 1095 |
| Kagi LLM Benchmark | 25.2% | — |
| Chess Puzzles | 0% | — |
| DTBench | 50.9% | — |
| LMCA | 2.8% | — |
| Epoch Capabilities Index | 116.02 | — |
Math Llama 3.2 3B leads
Gemma 3 4B: 16.8 (#292), Llama 3.2 3B: 32.4 (#214)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Math | 1239 | 1126 |
| OTIS Mock AIME 2024-2025 | 7.5% | — |
Knowledge Llama 3.2 3B leads
Gemma 3 4B: 11.8 (#299), Llama 3.2 3B: 29.7 (#235)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Expert | 1223 | 1090 |
| GPQA Diamond | 23.2% | — |
| Vectara Hallucination Rate | 6.4% | — |
Multilingual Gemma 3 4B leads
Gemma 3 4B: 42.5 (#194), Llama 3.2 3B: 26.2 (#281)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Non-English | 1273 | 1019 |
| LMArena German | 1281 | 1056 |
| LMArena Russian | 1294 | 949 |
| LMArena Chinese | — | 1017 |
Instruction Following Gemma 3 4B leads
Gemma 3 4B: 65.2 (#225), Llama 3.2 3B: 56.0 (#275)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Instruction Following | 1239 | 1089 |
Long Context Gemma 3 4B leads
Gemma 3 4B: 38.7 (#194), Llama 3.2 3B: 33.4 (#261)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Longer Query | 1273 | 1100 |
Writing & Preference Gemma 3 4B leads
Gemma 3 4B: 42.0 (#239), Llama 3.2 3B: 24.7 (#307)
| Benchmark | Gemma 3 4B | Llama 3.2 3B |
|---|---|---|
| LMArena Text | 1291 | 1110 |
| LMArena Creative Writing | 1271 | 1094 |
| EQ-Bench Creative Writing | 1068 | 595 |
| LMArena Multi-Turn | 1255 | 1105 |
Frequently asked questions
Is Gemma 3 4B better than Llama 3.2 3B?
Gemma 3 4B and Llama 3.2 3B score almost the same on the Noometry Index (28.1 vs 28.9), so choose on price, context window or the category you care about most.
Which is cheaper, Gemma 3 4B or Llama 3.2 3B?
Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; Llama 3.2 3B lists at $0.05 and $0.33.
Is Gemma 3 4B or Llama 3.2 3B better for coding?
Gemma 3 4B scores higher on coding benchmarks: 35.9 versus 27.6 in the Noometry coding category.
Which has the bigger context window?
Both accept 131K tokens.
How many benchmarks do Gemma 3 4B and Llama 3.2 3B share?
14 benchmarks have published results for both models. Gemma 3 4B has 22 scored results on Noometry and Llama 3.2 3B has 18.