Model comparison
Gemma 3n E4b IT vs Yi-Lightning
Gemma 3n E4b IT and Yi-Lightning score almost the same on the Noometry Index (37.3 vs 37.1), so choose on price, context window or the category you care about most.
Last verified . 17 shared benchmarks.
GoogleSummary
- They share 17 benchmarks with published results for both. Gemma 3n E4b IT scores higher in 2 categories and Yi-Lightning in 6 categories; 6 gaps are clear of the uncertainty.
- The widest gap is in coding, where Gemma 3n E4b IT leads 37.0 to 27.4.
- Gemma 3n E4b IT has downloadable open weights; the other is API-only.
Side by side
| Gemma 3n E4b IT | Yi-Lightning | |
|---|---|---|
| Provider | 01.AI | |
| Noometry Index | 37.3 | 37.1 |
| Released | — | 2024-12-02 |
| Weights | Open | Proprietary |
| Context window | — | — |
| Max output | — | — |
| Input $ / M tokens | — | — |
| Output $ / M tokens | — | — |
| Results tracked | 18 | 18 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Gemma 3n E4b IT leads
Gemma 3n E4b IT: 37.0 (#198), Yi-Lightning: 27.4 (#320)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Coding | 1268 | 1312 |
| Aider Polyglot | — | 12.9% |
Reasoning Yi-Lightning leads
Gemma 3n E4b IT: 19.9 (#247), Yi-Lightning: 25.9 (#139)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Hard Prompts | 1284 | 1302 |
| Kagi LLM Benchmark | 31.5% | — |
Math Yi-Lightning leads
Gemma 3n E4b IT: 35.1 (#188), Yi-Lightning: 36.2 (#172)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Math | 1251 | 1300 |
Knowledge Yi-Lightning leads
Gemma 3n E4b IT: 34.2 (#198), Yi-Lightning: 35.4 (#185)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Expert | 1246 | 1286 |
Multilingual Gemma 3n E4b IT leads
Gemma 3n E4b IT: 43.4 (#183), Yi-Lightning: 42.2 (#196)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Non-English | 1285 | 1269 |
| LMArena Chinese | 1309 | 1320 |
| LMArena French | 1330 | 1305 |
| LMArena German | 1311 | 1267 |
| LMArena Japanese | 1272 | 1228 |
| LMArena Korean | 1259 | 1192 |
| LMArena Russian | 1288 | 1255 |
| LMArena Spanish | 1305 | 1315 |
Instruction Following Yi-Lightning leads
Gemma 3n E4b IT: 66.1 (#210), Yi-Lightning: 67.4 (#196)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Instruction Following | 1255 | 1278 |
Long Context Too close to call
Gemma 3n E4b IT: 38.7 (#191), Yi-Lightning: 39.4 (#181)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Longer Query | 1276 | 1297 |
Writing & Preference Too close to call
Gemma 3n E4b IT: 50.1 (#186), Yi-Lightning: 50.2 (#184)
| Benchmark | Gemma 3n E4b IT | Yi-Lightning |
|---|---|---|
| LMArena Text | 1306 | 1302 |
| LMArena Creative Writing | 1287 | 1280 |
| LMArena Multi-Turn | 1276 | 1311 |
Frequently asked questions
Is Gemma 3n E4b IT better than Yi-Lightning?
Gemma 3n E4b IT and Yi-Lightning score almost the same on the Noometry Index (37.3 vs 37.1), so choose on price, context window or the category you care about most.
Is Gemma 3n E4b IT or Yi-Lightning better for coding?
Gemma 3n E4b IT scores higher on coding benchmarks: 37.0 versus 27.4 in the Noometry coding category.
How many benchmarks do Gemma 3n E4b IT and Yi-Lightning share?
17 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Yi-Lightning has 18.