Model comparison

Falcon-180B vs Inkling-Small

Inkling-Small is the stronger model overall, scoring 46.5 to 31.8 on the Noometry Index.

Last verified . 7 shared benchmarks.

Summary

  • They share 7 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Inkling-Small in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Inkling-Small leads 59.8 to 29.3.

Side by side

Falcon-180B and Inkling-Small specifications
Falcon-180BInkling-Small
ProviderTechnology Innovation InstituteThinking Machines Lab
Noometry Index31.846.5
Released2023-09-062026-07-15
WeightsOpenOpen
Context window—524K
Max output—1.05M
Input $ / M tokens—$0.45
Output $ / M tokens—$1.20
Results tracked1633

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Inkling-Small: 43.3 (#80)

Coding benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena WebDev—1408
SciCode—48.7%
LMArena Coding—1451

Reasoning Inkling-Small leads

Falcon-180B: 18.3 (#266), Inkling-Small: 39.0 (#53)

Reasoning benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Hard Prompts10071424
Epoch Capabilities Index111.89150.13
ARC-AGI-2—40.1%
ARC-AGI-1—84%
CritPt—8.3%
Chess Puzzles—18%
Mystery Game Puzzles—6%
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Inkling-Small: 44.9 (#65)

Math benchmarks
BenchmarkFalcon-180BInkling-Small
FrontierMath (Tiers 1-3)—46.3%
FrontierMath Tier 4—17.1%
OTIS Mock AIME 2024-2025—90%
ProofBench—6%
LMArena Math—1453
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Inkling-Small: 48.3 (#71)

Knowledge benchmarks
BenchmarkFalcon-180BInkling-Small
GPQA Diamond—88.5%
SimpleQA Verified—19.1%
LMArena Expert—1442
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multimodal Not comparable

Falcon-180B: —, Inkling-Small: 38.4 (#59)

Multimodal benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Vision—1235

Multilingual Inkling-Small leads

Falcon-180B: 25.3 (#281), Inkling-Small: 51.7 (#102)

Multilingual benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Non-English10001400
LMArena Chinese—1458
LMArena French—1438
LMArena German—1412
LMArena Japanese—1399
LMArena Korean—1355
LMArena Russian—1392
LMArena Spanish—1426

Instruction Following Inkling-Small leads

Falcon-180B: 53.6 (#281), Inkling-Small: 73.9 (#112)

Instruction Following benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Instruction Following10471397

Long Context Not comparable

Falcon-180B: —, Inkling-Small: 42.7 (#113)

Long Context benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Longer Query—1401

Writing & Preference Inkling-Small leads

Falcon-180B: 29.3 (#290), Inkling-Small: 59.8 (#102)

Writing & Preference benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Text10541413
LMArena Creative Writing10891330
LMArena Multi-Turn10131420
EQ-Bench Creative Writing—1491

Frequently asked questions

Is Falcon-180B better than Inkling-Small?

Inkling-Small is the stronger model overall, scoring 46.5 to 31.8 on the Noometry Index.

How many benchmarks do Falcon-180B and Inkling-Small share?

7 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Inkling-Small has 33.

Related comparisons

Go deeper