Model comparison

Chatgpt 4o Latest 20250326 vs Step 3

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 39.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.2

Rank #84 Confirmed

Step 3 StepFun

39.9

Rank #145 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 9 categories and Step 3 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Chatgpt 4o Latest 20250326 leads 62.8 to 54.5.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 75% for Chatgpt 4o Latest 20250326 and 62.3% for Step 3.
  • Step 3 has downloadable open weights; the other is API-only.

Side by side

Chatgpt 4o Latest 20250326 and Step 3 specifications
Chatgpt 4o Latest 20250326Step 3
ProviderOpenAIStepFun
Noometry Index43.239.9
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2117

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 41.0 (#122), Step 3: 39.5 (#144)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Coding14131367

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 32.8 (#64), Step 3: 27.6 (#102)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
Kagi LLM Benchmark75%62.3%
LMArena Hard Prompts14241355

Math Too close to call

Chatgpt 4o Latest 20250326: 35.8 (#134), Step 3: 34.9 (#148)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Math14071366

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.7 (#131), Step 3: 36.2 (#161)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Expert14001333
Confabulations16.6%—

Multimodal Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.9 (#54), Step 3: 34.9 (#81)

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Vision12431176

Multilingual Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 53.1 (#72), Step 3: 46.5 (#154)

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Non-English14191327
LMArena Chinese14561396
LMArena German14241371
LMArena Korean13971271
LMArena Russian14291331
LMArena Spanish14351372
LMArena French1447—
LMArena Japanese1406—

Instruction Following Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 74.2 (#102), Step 3: 70.6 (#159)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Instruction Following14031332

Long Context Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 43.1 (#104), Step 3: 40.3 (#152)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Longer Query14131326

Writing & Preference Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 62.8 (#68), Step 3: 54.5 (#146)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Text14291351
LMArena Creative Writing14061322
LMArena Multi-Turn14541340
EQ-Bench Creative Writing1501—

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Step 3?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 39.9 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or Step 3 better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.0 versus 39.5 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Step 3 share?

17 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper