Noometry

Model comparison

Inkling vs Magistral Medium

Inkling is the stronger model overall, scoring 44.1 to 34.8 on the Noometry Index.

Last verified . 21 shared benchmarks.

Inkling Thinking Machines Lab

44.1

Rank #75 Confirmed

Magistral Medium Mistral AI

34.8

Rank #224 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Inkling scores higher in 6 categories and Magistral Medium in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling leads 40.6 to 8.7.
  • The biggest single-benchmark swing is ARC-AGI-1: 79.5% for Inkling and 6.1% for Magistral Medium.
  • Inkling is cheaper at $1.87 / $4.68 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • Magistral Medium accepts more context: 128K tokens versus 66K.

Side by side

InklingMagistral Medium
ProviderThinking Machines LabMistral AI
Noometry Index44.134.8
Released2026-07-152025-03-17
WeightsOpenOpen
Context window66K128K
Max output66K16K
Input $ / M tokens$1.87$2
Output $ / M tokens$4.68$5
Results tracked4122

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Medium leads

Inkling: 34.1 (#229), Magistral Medium: 38.6 (#161)

BenchmarkInklingMagistral Medium
SciCode47%39.2%
LMArena Coding14631319
FrontierCode14%—
LMArena WebDev1412—
FrontierSWE4.1%—
WeirdML32.3%—
ALE-Bench946—

Agentic & Tool Use Not comparable

Inkling: 29.5 (#76), Magistral Medium: —

BenchmarkInklingMagistral Medium
APEX-Agents33.8%—
τ²-bench Banking25%—

Reasoning Inkling leads

Inkling: 40.6 (#48), Magistral Medium: 8.7 (#342)

BenchmarkInklingMagistral Medium
ARC-AGI-236.5%0%
ARC-AGI-179.5%6.1%
CritPt5.4%0.3%
LMArena Hard Prompts14521267
SimpleBench50%—
Kagi LLM Benchmark—16.2%
Chess Puzzles21%—
DTBench87.5%—
LMCA37.6%—
Epoch Capabilities Index148.6—

Math Magistral Medium leads

Inkling: 31.2 (#198), Magistral Medium: 32.4 (#187)

BenchmarkInklingMagistral Medium
LMArena Math14821249
FrontierMath (Tiers 1-3)33.3%—
FrontierMath Tier 44.9%—
OTIS Mock AIME 2024-202588.9%—
ProofBench0%—

Knowledge Inkling leads

Inkling: 55.2 (#44), Magistral Medium: 32.9 (#199)

BenchmarkInklingMagistral Medium
LMArena Expert14681222
GPQA Diamond88.3%—
SimpleQA Verified40.3%—

Multilingual Inkling leads

Inkling: 54.2 (#49), Magistral Medium: 39.8 (#219)

BenchmarkInklingMagistral Medium
LMArena Non-English14341232
LMArena Chinese14951225
LMArena French14531268
LMArena German14561248
LMArena Japanese14281176
LMArena Korean14011125
LMArena Russian14301224
LMArena Spanish14421269

Instruction Following Inkling leads

Inkling: 75.3 (#65), Magistral Medium: 66.2 (#207)

BenchmarkInklingMagistral Medium
LMArena Instruction Following14271254

Long Context Inkling leads

Inkling: 43.9 (#79), Magistral Medium: 39.3 (#178)

BenchmarkInklingMagistral Medium
LMArena Longer Query14361295

Writing & Preference Inkling leads

Inkling: 65.5 (#48), Magistral Medium: 46.5 (#214)

BenchmarkInklingMagistral Medium
LMArena Text14431255
LMArena Creative Writing13901245
LMArena Multi-Turn14361275
EQ-Bench Creative Writing1611—
EQ-Bench 41226—

Frequently asked questions

Is Inkling better than Magistral Medium?

Inkling is the stronger model overall, scoring 44.1 to 34.8 on the Noometry Index.

Which is cheaper, Inkling or Magistral Medium?

Inkling is cheaper. It lists at $1.87 per million input tokens and $4.68 per million output tokens; Magistral Medium lists at $2 and $5.

Is Inkling or Magistral Medium better for coding?

Magistral Medium scores higher on coding benchmarks: 38.6 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

Magistral Medium does, with 128K tokens against 66K.

How many benchmarks do Inkling and Magistral Medium share?

21 benchmarks have published results for both models. Inkling has 41 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper