Model comparison

Amazon Nova Experimental Chat 10 20 vs Step 3.5 Flash

Amazon Nova Experimental Chat 10 20 and Step 3.5 Flash score almost the same on the Noometry Index (42.1 vs 42.3), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 10 20 scores higher in 1 category and Step 3.5 Flash in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Amazon Nova Experimental Chat 10 20 leads 28.4 to 22.2.
  • Step 3.5 Flash has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 20 and Step 3.5 Flash specifications
Amazon Nova Experimental Chat 10 20Step 3.5 Flash
ProviderAmazonStepFun
Noometry Index42.142.3
Released—2026-01-29
WeightsProprietaryOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked1719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Experimental Chat 10 20: 41.6 (#123), Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Coding14121436

Reasoning Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 28.4 (#106), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Hard Prompts13961411
NYT Connections (extended)—28.4%

Math Step 3.5 Flash leads

Amazon Nova Experimental Chat 10 20: 39.0 (#119), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Math14251408
MathArena Final-Answer Competitions—66.8%

Knowledge Step 3.5 Flash leads

Amazon Nova Experimental Chat 10 20: 38.5 (#144), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Expert13861421

Multilingual Too close to call

Amazon Nova Experimental Chat 10 20: 49.5 (#131), Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Non-English13721385
LMArena Chinese14041447
LMArena French14251421
LMArena German13911405
LMArena Japanese13601354
LMArena Korean13241352
LMArena Russian13711385
LMArena Spanish13821419

Instruction Following Step 3.5 Flash leads

Amazon Nova Experimental Chat 10 20: 72.1 (#141), Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Instruction Following13651385

Long Context Step 3.5 Flash leads

Amazon Nova Experimental Chat 10 20: 41.7 (#133), Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Longer Query13701402

Writing & Preference Step 3.5 Flash leads

Amazon Nova Experimental Chat 10 20: 56.6 (#136), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3.5 Flash
LMArena Text13941403
LMArena Creative Writing13181357
LMArena Multi-Turn13641405

Frequently asked questions

Is Amazon Nova Experimental Chat 10 20 better than Step 3.5 Flash?

Amazon Nova Experimental Chat 10 20 and Step 3.5 Flash score almost the same on the Noometry Index (42.1 vs 42.3), so choose on price, context window or the category you care about most.

Is Amazon Nova Experimental Chat 10 20 or Step 3.5 Flash better for coding?

They score almost the same on coding (41.6 vs 42.4); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Experimental Chat 10 20 and Step 3.5 Flash share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 20 has 17 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper