Model comparison

Claude Fable 5.1 vs DeepSeek-V2 (MoE-236B, May 2024)

Claude Fable 5.1 has enough public results to be ranked (#2); DeepSeek-V2 (MoE-236B, May 2024) does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both. Claude Fable 5.1 scores higher in 1 category and DeepSeek-V2 (MoE-236B, May 2024) in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Claude Fable 5.1 leads 74.7 to 40.4.
  • DeepSeek-V2 (MoE-236B, May 2024) has downloadable open weights; the other is API-only.

Side by side

Claude Fable 5.1 and DeepSeek-V2 (MoE-236B, May 2024) specifications
Claude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
ProviderAnthropicDeepSeek
Noometry Index69.040.3
Released2026-09-012024-05-07
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$10—
Output $ / M tokens$50—
Results tracked5210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Fable 5.1 leads

Claude Fable 5.1: 74.7 (#1), DeepSeek-V2 (MoE-236B, May 2024): 40.4 (#139)

Coding benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
FrontierCode50.9%—
CursorBench51.8%—
LMArena WebDev1744—
FrontierSWE56.3%—
SciCode63.1%—
GSO88.2%—
WeirdML92.9%—
BigCodeBench Instruct—48.9%
LMArena Coding1528—
MirrorCode73.3%—
BigCodeBench Complete—59.4%
ALE-Bench2,143—

Agentic & Tool Use Not comparable

Claude Fable 5.1: 50.7 (#5), DeepSeek-V2 (MoE-236B, May 2024): —

Agentic & Tool Use benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
APEX-Agents68.6%—
Remote Labor Index17.9%—
GDP.pdf29.6%—
Vending-Bench 25,422—

Reasoning Not comparable

Claude Fable 5.1: 76.7 (#7), DeepSeek-V2 (MoE-236B, May 2024): —

Reasoning benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
Epoch Capabilities Index164.7124.77
ARC-AGI-290%—
NYT Connections (extended)90%—
ARC-AGI-197.5%—
CritPt31.1%—
Chess Puzzles47%—
EBR-Bench57.1%—
LMArena Hard Prompts1526—
Mystery Game Puzzles58%—
DTBench97.6%—
LMCA65.5%—
BIG-Bench Hard—78.8%
HellaSwag—87.1%
PIQA—83.9%
WinoGrande—86.3%

Math Not comparable

Claude Fable 5.1: 89.6 (#4), DeepSeek-V2 (MoE-236B, May 2024): —

Math benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
FrontierMath (Tiers 1-3)90.2%—
FrontierMath Tier 487.8%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
LMArena Math1525—
FrontierMath Erdős0%—

Knowledge Not comparable

Claude Fable 5.1: 69.6 (#6), DeepSeek-V2 (MoE-236B, May 2024): —

Knowledge benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
Humanity's Last Exam46.5%—
SimpleQA Verified70.8%—
LMArena Expert1535—
ARC (AI2) Challenge—92.2%
MMLU—78.4%
TriviaQA—80%

Multimodal Not comparable

Claude Fable 5.1: 53.9 (#4), DeepSeek-V2 (MoE-236B, May 2024): —

Multimodal benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
LMArena Vision1318—
Blueprint-Bench 241.9%—
Furniture Assembly70%—
LMArena Document1513—

Multilingual Not comparable

Claude Fable 5.1: 59.1 (#3), DeepSeek-V2 (MoE-236B, May 2024): —

Multilingual benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
LMArena Non-English1507—
LMArena Chinese1586—
LMArena French1525—
LMArena German1500—
LMArena Japanese1543—
LMArena Korean1534—
LMArena Russian1521—
LMArena Spanish1516—

Instruction Following Not comparable

Claude Fable 5.1: 79.2 (#6), DeepSeek-V2 (MoE-236B, May 2024): —

Instruction Following benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
LMArena Instruction Following1517—

Long Context Not comparable

Claude Fable 5.1: 46.7 (#20), DeepSeek-V2 (MoE-236B, May 2024): —

Long Context benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
LMArena Longer Query1522—

Writing & Preference Not comparable

Claude Fable 5.1: 79.2 (#2), DeepSeek-V2 (MoE-236B, May 2024): —

Writing & Preference benchmarks
BenchmarkClaude Fable 5.1DeepSeek-V2 (MoE-236B, May 2024)
LMArena Text1510—
LMArena Creative Writing1507—
EQ-Bench Creative Writing2162—
LMArena Multi-Turn1492—

Frequently asked questions

Is Claude Fable 5.1 better than DeepSeek-V2 (MoE-236B, May 2024)?

Claude Fable 5.1 has enough public results to be ranked (#2); DeepSeek-V2 (MoE-236B, May 2024) does not yet, so treat this comparison as directional.

Is Claude Fable 5.1 or DeepSeek-V2 (MoE-236B, May 2024) better for coding?

Claude Fable 5.1 scores higher on coding benchmarks: 74.7 versus 40.4 in the Noometry coding category.

How many benchmarks do Claude Fable 5.1 and DeepSeek-V2 (MoE-236B, May 2024) share?

1 benchmark has published results for both models. Claude Fable 5.1 has 52 scored results on Noometry and DeepSeek-V2 (MoE-236B, May 2024) has 10.

Related comparisons

Go deeper