Model comparison

Claude Sonnet 4.5 vs Inkling-Small

Inkling-Small is the stronger model overall, scoring 46.5 to 44.0 on the Noometry Index.

Last verified . 32 shared benchmarks.

Claude Sonnet 4.5 Anthropic

44.0

Rank #76 Confirmed

Inkling-Small Thinking Machines Lab

46.5

Rank #57 Confirmed

Summary

  • They share 32 benchmarks with published results for both. Claude Sonnet 4.5 scores higher in 6 categories and Inkling-Small in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Inkling-Small leads 44.9 to 31.9.
  • The biggest single-benchmark swing is ARC-AGI-2: 13.6% for Claude Sonnet 4.5 and 40.1% for Inkling-Small.
  • Inkling-Small is cheaper at $0.45 / $1.20 per million input/output tokens, against $3 / $15 for Claude Sonnet 4.5.
  • Claude Sonnet 4.5 accepts more context: 1M tokens versus 524K.
  • Inkling-Small has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 4.5 and Inkling-Small specifications
Claude Sonnet 4.5Inkling-Small
ProviderAnthropicThinking Machines Lab
Noometry Index44.046.5
Released2025-09-292026-07-15
WeightsProprietaryOpen
Context window1M524K
Max output64K1.05M
Input $ / M tokens$3$0.45
Output $ / M tokens$15$1.20
Results tracked7333

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 47.8 (#54), Inkling-Small: 43.3 (#80)

Coding benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
LMArena WebDev13931408
SciCode44.7%48.7%
LMArena Coding14891451
SWE-bench Verified71.3%—
SWE-bench Verified (bash only)71.4%—
SWE-bench Multilingual67%—
GSO14.7%—
WeirdML47.7%—
ALE-Bench796.15—
AlgoTune1.52—

Agentic & Tool Use Not comparable

Claude Sonnet 4.5: 38.1 (#30), Inkling-Small: —

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
Terminal-Bench46.5%—
Berkeley Function Calling Leaderboard73.2%—
GDPval42.5%—
Remote Labor Index2.1%—
τ²-bench Airline72%—
τ²-bench Banking25.3%—
τ²-bench Retail72.4%—
τ²-bench Telecom84.9%—
Cybench60%—
DeepResearch Bench52.6%—
OSWorld62.9%—
LMArena Search1159—
METR Time Horizons67.4%—
Vending-Bench 23,839—

Reasoning Inkling-Small leads

Claude Sonnet 4.5: 26.9 (#113), Inkling-Small: 39.0 (#53)

Reasoning benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
ARC-AGI-213.6%40.1%
ARC-AGI-163.7%84%
CritPt1.1%8.3%
Chess Puzzles12%18%
LMArena Hard Prompts14621424
Mystery Game Puzzles17%6%
Epoch Capabilities Index146.84150.13
SimpleBench54.3%—
Kagi LLM Benchmark57.9%—
NYT Connections (extended)37.3%—
EnigmaEval6%—
EBR-Bench2.4%—
DTBench83.2%—
LMCA38.8%—
ForecastBench61.9—

Math Inkling-Small leads

Claude Sonnet 4.5: 31.9 (#190), Inkling-Small: 44.9 (#65)

Math benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
FrontierMath (Tiers 1-3)23.9%46.3%
FrontierMath Tier 42.4%17.1%
OTIS Mock AIME 2024-202577.8%90%
ProofBench19%6%
LMArena Math14481453
Omni-MATH55.3%—
MATH Level 597.7%—
FrontierMath (Feb 2025 set)15.2%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Too close to call

Claude Sonnet 4.5: 48.4 (#70), Inkling-Small: 48.3 (#71)

Knowledge benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
GPQA Diamond82.3%88.5%
SimpleQA Verified30.7%19.1%
LMArena Expert14831442
Humanity's Last Exam13.7%—
MMLU-Pro86.9%—
Vectara Hallucination Rate12%—
GPQA (HELM)68.6%—

Multimodal Inkling-Small leads

Claude Sonnet 4.5: 34.1 (#84), Inkling-Small: 38.4 (#59)

Multimodal benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
LMArena Vision—1235
VPCT39.8%—
LMArena Document1450—

Multilingual Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 53.6 (#65), Inkling-Small: 51.7 (#102)

Multilingual benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
LMArena Non-English14251400
LMArena Chinese14591458
LMArena French14591438
LMArena German14271412
LMArena Japanese13901399
LMArena Korean14031355
LMArena Russian14361392
LMArena Spanish14571426

Instruction Following Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 75.2 (#74), Inkling-Small: 73.9 (#112)

Instruction Following benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
LMArena Instruction Following14591397
IFEval85%—

Long Context Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 45.2 (#45), Inkling-Small: 42.7 (#113)

Long Context benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
LMArena Longer Query14761401

Writing & Preference Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 66.7 (#33), Inkling-Small: 59.8 (#102)

Writing & Preference benchmarks
BenchmarkClaude Sonnet 4.5Inkling-Small
LMArena Text14391413
LMArena Creative Writing14421330
EQ-Bench Creative Writing16781491
LMArena Multi-Turn14651420
WildBench85.4%—

Frequently asked questions

Is Claude Sonnet 4.5 better than Inkling-Small?

Inkling-Small is the stronger model overall, scoring 46.5 to 44.0 on the Noometry Index.

Which is cheaper, Claude Sonnet 4.5 or Inkling-Small?

Inkling-Small is cheaper. It lists at $0.45 per million input tokens and $1.20 per million output tokens; Claude Sonnet 4.5 lists at $3 and $15.

Is Claude Sonnet 4.5 or Inkling-Small better for coding?

Claude Sonnet 4.5 scores higher on coding benchmarks: 47.8 versus 43.3 in the Noometry coding category.

Which has the bigger context window?

Claude Sonnet 4.5 does, with 1M tokens against 524K.

How many benchmarks do Claude Sonnet 4.5 and Inkling-Small share?

32 benchmarks have published results for both models. Claude Sonnet 4.5 has 73 scored results on Noometry and Inkling-Small has 33.

Related comparisons

Go deeper