Noometry

Model comparison

Claude Fable 5.1 vs Tulu 3 (Tülu 3) 70B

Claude Fable 5.1 is the stronger model overall, scoring 69.0 to 33.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Claude Fable 5.1 Anthropic

69.0

Rank #2 Confirmed

Tulu 3 (Tülu 3) 70B Allen Institute for AI (Ai2)

33.0

Rank #251 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Claude Fable 5.1 scores higher in 8 categories and Tulu 3 (Tülu 3) 70B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Fable 5.1 leads 89.6 to 14.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 100% for Claude Fable 5.1 and 4.4% for Tulu 3 (Tülu 3) 70B.
  • Tulu 3 (Tülu 3) 70B has downloadable open weights; the other is API-only.

Side by side

Claude Fable 5.1Tulu 3 (Tülu 3) 70B
ProviderAnthropicAllen Institute for AI (Ai2)
Noometry Index69.033.0
Released2026-09-012024-11-21
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$10—
Output $ / M tokens$50—
Results tracked5214

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Fable 5.1 leads

Claude Fable 5.1: 74.7 (#1), Tulu 3 (Tülu 3) 70B: 36.0 (#214)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
LMArena Coding15281235
FrontierCode50.9%—
CursorBench51.8%—
LMArena WebDev1744—
FrontierSWE56.3%—
SciCode63.1%—
GSO88.2%—
WeirdML92.9%—
MirrorCode73.3%—
ALE-Bench2,143—

Agentic & Tool Use Not comparable

Claude Fable 5.1: 50.7 (#5), Tulu 3 (Tülu 3) 70B: —

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
APEX-Agents68.6%—
Remote Labor Index17.9%—
GDP.pdf29.6%—
Vending-Bench 25,422—

Reasoning Claude Fable 5.1 leads

Claude Fable 5.1: 76.7 (#7), Tulu 3 (Tülu 3) 70B: 23.9 (#169)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
LMArena Hard Prompts15261220
ARC-AGI-290%—
NYT Connections (extended)90%—
ARC-AGI-197.5%—
CritPt31.1%—
Chess Puzzles47%—
EBR-Bench57.1%—
Mystery Game Puzzles58%—
DTBench97.6%—
LMCA65.5%—
Epoch Capabilities Index164.7—

Math Claude Fable 5.1 leads

Claude Fable 5.1: 89.6 (#4), Tulu 3 (Tülu 3) 70B: 14.2 (#303)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
OTIS Mock AIME 2024-2025100%4.4%
LMArena Math15251242
FrontierMath (Tiers 1-3)90.2%—
FrontierMath Tier 487.8%—
ProofBench100%—
MATH Level 5—42.7%
FrontierMath Erdős0%—

Knowledge Claude Fable 5.1 leads

Claude Fable 5.1: 69.6 (#6), Tulu 3 (Tülu 3) 70B: 25.0 (#264)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
GPQA Diamond—46.3%
Humanity's Last Exam46.5%—
SimpleQA Verified70.8%—
LMArena Expert1535—

Multimodal Not comparable

Claude Fable 5.1: 53.9 (#4), Tulu 3 (Tülu 3) 70B: —

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
LMArena Vision1318—
Blueprint-Bench 241.9%—
Furniture Assembly70%—
LMArena Document1513—

Multilingual Claude Fable 5.1 leads

Claude Fable 5.1: 59.1 (#3), Tulu 3 (Tülu 3) 70B: 39.9 (#222)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
LMArena Non-English15071236
LMArena Chinese15861249
LMArena Russian15211246
LMArena French1525—
LMArena German1500—
LMArena Japanese1543—
LMArena Korean1534—
LMArena Spanish1516—

Instruction Following Claude Fable 5.1 leads

Claude Fable 5.1: 79.2 (#6), Tulu 3 (Tülu 3) 70B: 64.8 (#227)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
LMArena Instruction Following15171233

Long Context Claude Fable 5.1 leads

Claude Fable 5.1: 46.7 (#20), Tulu 3 (Tülu 3) 70B: 37.1 (#222)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
LMArena Longer Query15221224

Writing & Preference Claude Fable 5.1 leads

Claude Fable 5.1: 79.2 (#2), Tulu 3 (Tülu 3) 70B: 45.6 (#223)

BenchmarkClaude Fable 5.1Tulu 3 (Tülu 3) 70B
LMArena Text15101256
LMArena Creative Writing15071231
LMArena Multi-Turn14921252
EQ-Bench Creative Writing2162—

Frequently asked questions

Is Claude Fable 5.1 better than Tulu 3 (Tülu 3) 70B?

Claude Fable 5.1 is the stronger model overall, scoring 69.0 to 33.0 on the Noometry Index.

Is Claude Fable 5.1 or Tulu 3 (Tülu 3) 70B better for coding?

Claude Fable 5.1 scores higher on coding benchmarks: 74.7 versus 36.0 in the Noometry coding category.

How many benchmarks do Claude Fable 5.1 and Tulu 3 (Tülu 3) 70B share?

12 benchmarks have published results for both models. Claude Fable 5.1 has 52 scored results on Noometry and Tulu 3 (Tülu 3) 70B has 14.

Related comparisons

Go deeper