Model comparison
Llama2 70b Steerlm Chat vs o1-pro
Llama2 70b Steerlm Chat and o1-pro score almost the same on the Noometry Index (31.8 vs 31.5), so choose on price, context window or the category you care about most.
Last verified . 0 shared benchmarks.
NVIDIASummary
- Llama2 70b Steerlm Chat has downloadable open weights; the other is API-only.
Side by side
| Llama2 70b Steerlm Chat | o1-pro | |
|---|---|---|
| Provider | NVIDIA | OpenAI |
| Noometry Index | 31.8 | 31.5 |
| Released | — | 2025-03-19 |
| Weights | Open | Proprietary |
| Context window | — | 200K |
| Max output | — | 100K |
| Input $ / M tokens | — | $150 |
| Output $ / M tokens | — | $600 |
| Results tracked | 9 | 3 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Llama2 70b Steerlm Chat: 29.9 (#300), o1-pro: —
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| LMArena Coding | 1025 | — |
Reasoning Too close to call
Llama2 70b Steerlm Chat: 20.0 (#246), o1-pro: 20.4 (#239)
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| ARC-AGI-1 | — | 23.3% |
| EnigmaEval | — | 6.1% |
| LMArena Hard Prompts | 1047 | — |
Math Not comparable
Llama2 70b Steerlm Chat: 31.3 (#226), o1-pro: —
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| LMArena Math | 1072 | — |
Knowledge Not comparable
Llama2 70b Steerlm Chat: —, o1-pro: 29.7 (#234)
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| Humanity's Last Exam | — | 8.1% |
Multilingual Not comparable
Llama2 70b Steerlm Chat: 28.8 (#270), o1-pro: —
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| LMArena Non-English | 1063 | — |
Instruction Following Not comparable
Llama2 70b Steerlm Chat: 54.2 (#279), o1-pro: —
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| LMArena Instruction Following | 1060 | — |
Long Context Not comparable
Llama2 70b Steerlm Chat: 30.4 (#288), o1-pro: —
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| LMArena Longer Query | 998 | — |
Writing & Preference Not comparable
Llama2 70b Steerlm Chat: 31.6 (#283), o1-pro: —
| Benchmark | Llama2 70b Steerlm Chat | o1-pro |
|---|---|---|
| LMArena Text | 1098 | — |
| LMArena Creative Writing | 1091 | — |
| LMArena Multi-Turn | 1058 | — |
Frequently asked questions
Is Llama2 70b Steerlm Chat better than o1-pro?
Llama2 70b Steerlm Chat and o1-pro score almost the same on the Noometry Index (31.8 vs 31.5), so choose on price, context window or the category you care about most.
How many benchmarks do Llama2 70b Steerlm Chat and o1-pro share?
0 benchmarks have published results for both models. Llama2 70b Steerlm Chat has 9 scored results on Noometry and o1-pro has 3.