Model comparison
Sonar vs Step 2 16k Exp 202412
Sonar and Step 2 16k Exp 202412 score almost the same on the Noometry Index (37.8 vs 38.6), so choose on price, context window or the category you care about most.
Last verified . 0 shared benchmarks.
Perplexity
StepFunSummary
- The widest gap is in reasoning, where Step 2 16k Exp 202412 leads 24.8 to 20.3.
Side by side
| Sonar | Step 2 16k Exp 202412 | |
|---|---|---|
| Provider | Perplexity | StepFun |
| Noometry Index | 37.8 | 38.6 |
| Released | 2024-01-01 | — |
| Weights | Proprietary | Proprietary |
| Context window | 128K | — |
| Max output | 4K | — |
| Input $ / M tokens | $1 | — |
| Output $ / M tokens | $1 | — |
| Results tracked | 7 | 12 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Step 2 16k Exp 202412 leads
Sonar: 35.1 (#217), Step 2 16k Exp 202412: 37.9 (#170)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LiveBench Coding | 35.1% | — |
| LMArena Coding | — | 1316 |
Reasoning Step 2 16k Exp 202412 leads
Sonar: 20.3 (#221), Step 2 16k Exp 202412: 24.8 (#140)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LiveBench Reasoning | 46.3% | — |
| LMArena Hard Prompts | — | 1299 |
| LiveBench Data Analysis | 37.9% | — |
| LiveBench | 46.9% | — |
Math Step 2 16k Exp 202412 leads
Sonar: 31.3 (#197), Step 2 16k Exp 202412: 33.6 (#171)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LiveBench Math | 41.6% | — |
| LMArena Math | — | 1305 |
Knowledge Not comparable
Sonar: —, Step 2 16k Exp 202412: 34.6 (#187)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LMArena Expert | — | 1279 |
Multilingual Not comparable
Sonar: —, Step 2 16k Exp 202412: 43.9 (#176)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LMArena Non-English | — | 1290 |
| LMArena Chinese | — | 1331 |
| LMArena Russian | — | 1324 |
Instruction Following Sonar leads
Sonar: 71.5 (#146), Step 2 16k Exp 202412: 68.1 (#187)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LiveBench Instruction Following | 76.2% | — |
| LMArena Instruction Following | — | 1287 |
Long Context Not comparable
Sonar: —, Step 2 16k Exp 202412: 39.7 (#165)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LMArena Longer Query | — | 1307 |
Writing & Preference Too close to call
Sonar: 52.6 (#166), Step 2 16k Exp 202412: 52.5 (#168)
| Benchmark | Sonar | Step 2 16k Exp 202412 |
|---|---|---|
| LMArena Text | — | 1321 |
| LMArena Creative Writing | — | 1328 |
| LMArena Multi-Turn | — | 1292 |
| LiveBench Language | 44.1% | — |
Frequently asked questions
Is Sonar better than Step 2 16k Exp 202412?
Sonar and Step 2 16k Exp 202412 score almost the same on the Noometry Index (37.8 vs 38.6), so choose on price, context window or the category you care about most.
Is Sonar or Step 2 16k Exp 202412 better for coding?
Step 2 16k Exp 202412 scores higher on coding benchmarks: 37.9 versus 35.1 in the Noometry coding category.
How many benchmarks do Sonar and Step 2 16k Exp 202412 share?
0 benchmarks have published results for both models. Sonar has 7 scored results on Noometry and Step 2 16k Exp 202412 has 12.