Model comparison

Claude Sonnet 5.5 vs Hermes 4 405B

Claude Sonnet 5.5 has enough public results to be ranked (#10); Hermes 4 405B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Claude Sonnet 5.5 Anthropic

61.9

Rank #10 Confirmed

Hermes 4 405B Nous Research

37.6

Unranked Sparse

Summary

  • The widest gap is in reasoning, where Claude Sonnet 5.5 leads 54.0 to 26.1.
  • Hermes 4 405B is cheaper at $1 / $3 per million input/output tokens, against $2 / $10 for Claude Sonnet 5.5.
  • Claude Sonnet 5.5 accepts more context: 1M tokens versus 131K.
  • Hermes 4 405B has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 5.5 and Hermes 4 405B specifications
Claude Sonnet 5.5Hermes 4 405B
ProviderAnthropicNous Research
Noometry Index61.937.6
Released2026-09-28—
WeightsProprietaryOpen
Context window1M131K
Max output128K118K
Input $ / M tokens$2$1
Output $ / M tokens$10$3
Results tracked322

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Sonnet 5.5: 67.3 (#6), Hermes 4 405B: —

Coding benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
FrontierCode52.1%—
CursorBench55.5%—
LMArena WebDev1774—
FrontierSWE61.9%—
SciCode61%—
LMArena Coding1513—
ALE-Bench1,819—

Agentic & Tool Use Not comparable

Claude Sonnet 5.5: 45.0 (#16), Hermes 4 405B: —

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
APEX-Agents75.5%—

Reasoning Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 54.0 (#28), Hermes 4 405B: 26.1

Reasoning benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
Kagi LLM Benchmark—55.8%
NYT Connections (extended)80.5%—
CritPt31.4%—
LMArena Hard Prompts1495—
Mystery Game Puzzles65%—
Epoch Capabilities Index165.03—

Math Not comparable

Claude Sonnet 5.5: 87.9 (#6), Hermes 4 405B: —

Math benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
FrontierMath (Tiers 1-3)88.8%—
FrontierMath Tier 480.5%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
LMArena Math1510—
FrontierMath Erdős2.9%—

Knowledge Not comparable

Claude Sonnet 5.5: 66.0 (#12), Hermes 4 405B: —

Knowledge benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
GPQA Diamond95.6%—
SimpleQA Verified46.5%—
LMArena Expert1540—

Multimodal Not comparable

Claude Sonnet 5.5: 51.5 (#6), Hermes 4 405B: —

Multimodal benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
LMArena Vision1289—
Furniture Assembly75%—

Multilingual Not comparable

Claude Sonnet 5.5: 55.3 (#30), Hermes 4 405B: —

Multilingual benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
LMArena Non-English1452—
LMArena Chinese1522—
LMArena Russian1451—

Instruction Following Not comparable

Claude Sonnet 5.5: 78.3 (#11), Hermes 4 405B: —

Instruction Following benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
LMArena Instruction Following1495—

Long Context Not comparable

Claude Sonnet 5.5: 45.9 (#28), Hermes 4 405B: —

Long Context benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
LMArena Longer Query1498—

Writing & Preference Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#40), Hermes 4 405B: 52.9

Writing & Preference benchmarks
BenchmarkClaude Sonnet 5.5Hermes 4 405B
LMArena Text1471—
LMArena Creative Writing1465—
EQ-Bench Creative Writing—1421
LMArena Multi-Turn1474—

Frequently asked questions

Is Claude Sonnet 5.5 better than Hermes 4 405B?

Claude Sonnet 5.5 has enough public results to be ranked (#10); Hermes 4 405B does not yet, so treat this comparison as directional.

Which is cheaper, Claude Sonnet 5.5 or Hermes 4 405B?

Hermes 4 405B is cheaper. It lists at $1 per million input tokens and $3 per million output tokens; Claude Sonnet 5.5 lists at $2 and $10.

Which has the bigger context window?

Claude Sonnet 5.5 does, with 1M tokens against 131K.

How many benchmarks do Claude Sonnet 5.5 and Hermes 4 405B share?

0 benchmarks have published results for both models. Claude Sonnet 5.5 has 32 scored results on Noometry and Hermes 4 405B has 2.

Related comparisons

Go deeper