Model comparison

Devstral 2 vs GPT-5.6 Luna

GPT-5.6 Luna has enough public results to be ranked (#30); Devstral 2 does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Devstral 2 Mistral AI

36.1

Unranked Sparse

GPT-5.6 Luna OpenAI

54.6

Rank #30 Confirmed

Summary

  • They share 1 benchmark with published results for both. Devstral 2 scores higher in 0 categories and GPT-5.6 Luna in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where GPT-5.6 Luna leads 54.5 to 33.2.
  • GPT-5.6 Luna is cheaper at $0.20 / $1.20 per million input/output tokens, against $0.40 / $2 for Devstral 2.
  • GPT-5.6 Luna accepts more context: 1.05M tokens versus 262K.
  • Devstral 2 has downloadable open weights; the other is API-only.

Side by side

Devstral 2 and GPT-5.6 Luna specifications
Devstral 2GPT-5.6 Luna
ProviderMistral AIOpenAI
Noometry Index36.154.6
Released2025-12-092026-07-09
WeightsOpenProprietary
Context window262K1.05M
Max output262K128K
Input $ / M tokens$0.40$0.20
Output $ / M tokens$2$1.20
Results tracked252

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Luna leads

Devstral 2: 33.2 (#261), GPT-5.6 Luna: 54.5 (#28)

Coding benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
LMArena WebDev11971519
DeepSWE—67.2%
FrontierCode—39.8%
SWE-bench Verified (bash only)53.8%—
CursorBench—35.9%
SciCode—53.6%
WeirdML—60.9%
LMArena Coding—1466
ALE-Bench—1,667

Agentic & Tool Use Not comparable

Devstral 2: —, GPT-5.6 Luna: 34.4 (#45)

Agentic & Tool Use benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
APEX-Agents—43%
BALROG—45.6%
GDP.pdf—22.7%
Vending-Bench 2—4,095

Reasoning Not comparable

Devstral 2: —, GPT-5.6 Luna: 47.6 (#43)

Reasoning benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
ARC-AGI-2—59.5%
SimpleBench—46.8%
Kagi LLM Benchmark—49.1%
NYT Connections (extended)—69.4%
ARC-AGI-1—88%
CritPt—20.6%
Chess Puzzles—40%
LMArena Hard Prompts—1451
Mystery Game Puzzles—21%
DTBench—89.1%
LMCA—48.5%
Surface Evolver Bench—61.9%
Epoch Capabilities Index—156.39

Math Not comparable

Devstral 2: —, GPT-5.6 Luna: 77.7 (#14)

Math benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
FrontierMath (Tiers 1-3)—82.1%
FrontierMath Tier 4—61%
OTIS Mock AIME 2024-2025—98.3%
ProofBench—60%
LMArena Math—1458

Knowledge Not comparable

Devstral 2: —, GPT-5.6 Luna: 58.5 (#34)

Knowledge benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
GPQA Diamond—91.6%
SimpleQA Verified—41%
LMArena Expert—1478

Multimodal Not comparable

Devstral 2: —, GPT-5.6 Luna: 42.7 (#28)

Multimodal benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
LMArena Vision—1258
Blueprint-Bench 2—22.6%
Furniture Assembly—42.5%
LMArena Document—1457

Multilingual Not comparable

Devstral 2: —, GPT-5.6 Luna: 52.8 (#78)

Multilingual benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
LMArena Non-English—1417
LMArena Chinese—1470
LMArena French—1456
LMArena German—1454
LMArena Japanese—1411
LMArena Korean—1415
LMArena Russian—1428
LMArena Spanish—1448

Instruction Following Not comparable

Devstral 2: —, GPT-5.6 Luna: 75.6 (#57)

Instruction Following benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
LMArena Instruction Following—1437

Long Context Not comparable

Devstral 2: —, GPT-5.6 Luna: 43.9 (#82)

Long Context benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
LMArena Longer Query—1436

Writing & Preference Not comparable

Devstral 2: —, GPT-5.6 Luna: 68.0 (#29)

Writing & Preference benchmarks
BenchmarkDevstral 2GPT-5.6 Luna
LMArena Text—1431
LMArena Creative Writing—1396
EQ-Bench Creative Writing—1829
EQ-Bench 4—1156
LMArena Multi-Turn—1434

Frequently asked questions

Is Devstral 2 better than GPT-5.6 Luna?

GPT-5.6 Luna has enough public results to be ranked (#30); Devstral 2 does not yet, so treat this comparison as directional.

Which is cheaper, Devstral 2 or GPT-5.6 Luna?

GPT-5.6 Luna is cheaper. It lists at $0.20 per million input tokens and $1.20 per million output tokens; Devstral 2 lists at $0.40 and $2.

Is Devstral 2 or GPT-5.6 Luna better for coding?

GPT-5.6 Luna scores higher on coding benchmarks: 54.5 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

GPT-5.6 Luna does, with 1.05M tokens against 262K.

How many benchmarks do Devstral 2 and GPT-5.6 Luna share?

1 benchmark has published results for both models. Devstral 2 has 2 scored results on Noometry and GPT-5.6 Luna has 52.

Related comparisons

Go deeper