Noometry

Model comparison

Inkling-Small vs Mistral Large 4

Inkling-Small is the stronger model overall, scoring 46.5 to 43.1 on the Noometry Index.

Last verified . 14 shared benchmarks.

Inkling-Small Thinking Machines Lab

46.5

Rank #63 Confirmed

Mistral Large 4 Mistral AI

43.1

Rank #99 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Inkling-Small scores higher in 3 categories and Mistral Large 4 in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling-Small leads 38.6 to 22.5.
  • Inkling-Small is cheaper at $0.45 / $1.20 per million input/output tokens, against $0.68 / $2.09 for Mistral Large 4.
  • Mistral Large 4 accepts more context: 1.05M tokens versus 524K.
  • Inkling-Small has downloadable open weights; the other is API-only.

Side by side

Inkling-SmallMistral Large 4
ProviderThinking Machines LabMistral AI
Noometry Index46.543.1
Released2026-07-152026-10-06
WeightsOpenProprietary
Context window524K1.05M
Max output1.05M262K
Input $ / M tokens$0.45$0.68
Output $ / M tokens$1.20$2.09
Results tracked3315

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 4 leads

Inkling-Small: 43.6 (#85), Mistral Large 4: 48.6 (#57)

BenchmarkInkling-SmallMistral Large 4
LMArena WebDev14091541
LMArena Coding14511475
SciCode48.7%—

Reasoning Inkling-Small leads

Inkling-Small: 38.6 (#63), Mistral Large 4: 22.5 (#192)

BenchmarkInkling-SmallMistral Large 4
LMArena Hard Prompts14231444
ARC-AGI-240.1%—
NYT Connections (extended)—27.4%
ARC-AGI-184%—
CritPt8.3%—
Chess Puzzles18%—
Mystery Game Puzzles6%—
Epoch Capabilities Index150.15—

Math Inkling-Small leads

Inkling-Small: 45.1 (#77), Mistral Large 4: 40.4 (#91)

BenchmarkInkling-SmallMistral Large 4
LMArena Math14591488
FrontierMath (Tiers 1-3)46.3%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202590%—
ProofBench6%—

Knowledge Inkling-Small leads

Inkling-Small: 48.2 (#77), Mistral Large 4: 36.6 (#166)

BenchmarkInkling-SmallMistral Large 4
SimpleQA Verified19.1%20%
LMArena Expert14421447
GPQA Diamond88.5%—

Multimodal Not comparable

Inkling-Small: 39.1 (#62), Mistral Large 4: —

BenchmarkInkling-SmallMistral Large 4
LMArena Vision1235—

Multilingual Too close to call

Inkling-Small: 51.7 (#104), Mistral Large 4: 52.6 (#82)

BenchmarkInkling-SmallMistral Large 4
LMArena Non-English14021415
LMArena Chinese14651491
LMArena Russian13911414
LMArena French1436—
LMArena German1405—
LMArena Japanese1405—
LMArena Korean1363—
LMArena Spanish1428—

Instruction Following Mistral Large 4 leads

Inkling-Small: 73.8 (#114), Mistral Large 4: 75.0 (#76)

BenchmarkInkling-SmallMistral Large 4
LMArena Instruction Following13991424

Long Context Too close to call

Inkling-Small: 42.7 (#118), Mistral Large 4: 43.6 (#89)

BenchmarkInkling-SmallMistral Large 4
LMArena Longer Query14011429

Writing & Preference Too close to call

Inkling-Small: 59.6 (#107), Mistral Large 4: 60.4 (#97)

BenchmarkInkling-SmallMistral Large 4
LMArena Text14141427
LMArena Creative Writing13311361
LMArena Multi-Turn14181424
EQ-Bench Creative Writing1491—

Frequently asked questions

Is Inkling-Small better than Mistral Large 4?

Inkling-Small is the stronger model overall, scoring 46.5 to 43.1 on the Noometry Index.

Which is cheaper, Inkling-Small or Mistral Large 4?

Inkling-Small is cheaper. It lists at $0.45 per million input tokens and $1.20 per million output tokens; Mistral Large 4 lists at $0.68 and $2.09.

Is Inkling-Small or Mistral Large 4 better for coding?

Mistral Large 4 scores higher on coding benchmarks: 48.6 versus 43.6 in the Noometry coding category.

Which has the bigger context window?

Mistral Large 4 does, with 1.05M tokens against 524K.

How many benchmarks do Inkling-Small and Mistral Large 4 share?

14 benchmarks have published results for both models. Inkling-Small has 33 scored results on Noometry and Mistral Large 4 has 15.

Related comparisons

Go deeper