Noometry

Model comparison

Hunyuan Turbos 20250226 vs o1

Hunyuan Turbos 20250226 and o1 score almost the same on the Noometry Index (41.3 vs 40.9), so choose on price, context window or the category you care about most.

Last verified . 16 shared benchmarks.

Hunyuan Turbos 20250226 Tencent

41.3

Rank #139 Confirmed

o1 OpenAI

40.9

Rank #143 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Hunyuan Turbos 20250226 scores higher in 3 categories and o1 in 5 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in long context, where o1 leads 50.3 to 41.6.

Side by side

Hunyuan Turbos 20250226o1
ProviderTencentOpenAI
Noometry Index41.340.9
Released—2024-09-12
WeightsProprietaryProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$15
Output $ / M tokens—$60
Results tracked1652

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o1 leads

Hunyuan Turbos 20250226: 40.0 (#152), o1: 46.1 (#70)

BenchmarkHunyuan Turbos 20250226o1
LMArena Coding13611367
Aider Polyglot—61.7%
WeirdML—47.6%
LiveBench Coding—69.7%
CadEval—56%
HumanEval+—89%
MBPP+—80.2%

Agentic & Tool Use Not comparable

Hunyuan Turbos 20250226: —, o1: 24.6 (#117)

BenchmarkHunyuan Turbos 20250226o1
Cybench—10%
METR Time Horizons—51.1%

Reasoning Too close to call

Hunyuan Turbos 20250226: 27.8 (#113), o1: 27.9 (#111)

BenchmarkHunyuan Turbos 20250226o1
LMArena Hard Prompts13741371
SimpleBench—41.7%
ARC-AGI-1—30.7%
Chess Puzzles—15%
EnigmaEval—5.7%
LiveBench Reasoning—91.6%
DTBench—74.7%
LiveBench Data Analysis—65.5%
LMCA—22.3%
Epoch Capabilities Index—141.91
LiveBench—75.7%

Math Hunyuan Turbos 20250226 leads

Hunyuan Turbos 20250226: 37.5 (#154), o1: 36.1 (#175)

BenchmarkHunyuan Turbos 20250226o1
LMArena Math13591388
FrontierMath (Tiers 1-3)—14.7%
OTIS Mock AIME 2024-2025—73.3%
LiveBench Math—80.3%
MATH Level 5—94.7%
FrontierMath (Feb 2025 set)—9.3%

Knowledge o1 leads

Hunyuan Turbos 20250226: 37.0 (#161), o1: 41.5 (#110)

BenchmarkHunyuan Turbos 20250226o1
LMArena Expert13391361
GPQA Diamond—76.8%
Humanity's Last Exam—8%
SimpleQA Verified—41.1%
Confabulations—11.7%

Multimodal Not comparable

Hunyuan Turbos 20250226: —, o1: 34.2 (#93)

BenchmarkHunyuan Turbos 20250226o1
LMArena Vision—1168
GeoBench—80%
VPCT—37%
SpatialViz-Bench—41.4%

Multilingual Too close to call

Hunyuan Turbos 20250226: 48.9 (#136), o1: 48.6 (#142)

BenchmarkHunyuan Turbos 20250226o1
LMArena Non-English13631358
LMArena Chinese14171394
LMArena French13911344
LMArena German13551337
LMArena Japanese13421346
LMArena Korean13511396
LMArena Russian13681356
LMArena Spanish—1345

Instruction Following o1 leads

Hunyuan Turbos 20250226: 71.0 (#158), o1: 74.8 (#86)

BenchmarkHunyuan Turbos 20250226o1
LMArena Instruction Following13441367
LiveBench Instruction Following—81.5%

Long Context o1 leads

Hunyuan Turbos 20250226: 41.6 (#136), o1: 50.3 (#9)

BenchmarkHunyuan Turbos 20250226o1
LMArena Longer Query13661378
Fiction.LiveBench—83.3%

Writing & Preference Hunyuan Turbos 20250226 leads

Hunyuan Turbos 20250226: 57.4 (#128), o1: 55.6 (#144)

BenchmarkHunyuan Turbos 20250226o1
LMArena Text13771366
LMArena Creative Writing13591348
LMArena Multi-Turn13871369
Short-Story Creative Writing—70.2%
LiveBench Language—65.4%

Frequently asked questions

Is Hunyuan Turbos 20250226 better than o1?

Hunyuan Turbos 20250226 and o1 score almost the same on the Noometry Index (41.3 vs 40.9), so choose on price, context window or the category you care about most.

Is Hunyuan Turbos 20250226 or o1 better for coding?

o1 scores higher on coding benchmarks: 46.1 versus 40.0 in the Noometry coding category.

How many benchmarks do Hunyuan Turbos 20250226 and o1 share?

16 benchmarks have published results for both models. Hunyuan Turbos 20250226 has 16 scored results on Noometry and o1 has 52.

Related comparisons

Go deeper