Model comparison

Grok Build 0.1 vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 36.4 on the Noometry Index. Grok Build 0.1 costs 2.4× less per token, which makes it the better buy when Mistral Medium 3.5's lead doesn't matter for your workload.

Last verified October 10, 2026. 0 shared benchmarks.

Grok Build 0.1 xAI

36.4

Rank #216 Reported

Mistral Medium 3.5

Mistral AI

40.2

Rank #152 Confirmed

Summary

The widest gap is in reasoning, where Grok Build 0.1 leads 32.2 to 17.3.
Grok Build 0.1 is cheaper at $1 / $2 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium 3.5.
Mistral Medium 3.5 accepts more context: 262K tokens versus 256K.
Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Grok Build 0.1 and Mistral Medium 3.5 specifications
	Grok Build 0.1	Mistral Medium 3.5
Provider	xAI	Mistral AI
Noometry Index	36.4	40.2
Released	2026-04-16	—
Weights	Proprietary	Open
Context window	256K	262K
Max output	256K	210K
Input $ / M tokens	$1	$1.50
Output $ / M tokens	$2	$7.50
Results tracked	3	22

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Grok Build 0.1: 43.1 (#91), Mistral Medium 3.5: 36.0 (#213)

Coding benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena WebDev	—	1264
SciCode	50.2%	—
LMArena Coding	—	1461

Agentic & Tool Use Not comparable

Grok Build 0.1: 22.7 (#129), Mistral Medium 3.5: —

Agentic & Tool Use benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
GBAEval	2.4%	—

Reasoning Grok Build 0.1 leads

Grok Build 0.1: 32.2 (#77), Mistral Medium 3.5: 17.3 (#295)

Reasoning benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
Kagi LLM Benchmark	—	41.4%
NYT Connections (extended)	—	12.9%
CritPt	9.1%	—
LMArena Hard Prompts	—	1436
Epoch Capabilities Index	—	141.35

Math Not comparable

Grok Build 0.1: —, Mistral Medium 3.5: 39.1 (#113)

Math benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena Math	—	1431

Knowledge Not comparable

Grok Build 0.1: —, Mistral Medium 3.5: 40.0 (#126)

Knowledge benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena Expert	—	1432

Multimodal Not comparable

Grok Build 0.1: —, Mistral Medium 3.5: 38.3 (#65)

Multimodal benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena Vision	—	1223

Multilingual Not comparable

Grok Build 0.1: —, Mistral Medium 3.5: 51.9 (#100)

Multilingual benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena Non-English	—	1404
LMArena Chinese	—	1442
LMArena French	—	1448
LMArena German	—	1451
LMArena Korean	—	1385
LMArena Russian	—	1395
LMArena Spanish	—	1409

Instruction Following Not comparable

Grok Build 0.1: —, Mistral Medium 3.5: 74.6 (#90)

Instruction Following benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena Instruction Following	—	1415

Long Context Not comparable

Grok Build 0.1: —, Mistral Medium 3.5: 43.2 (#103)

Long Context benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena Longer Query	—	1415

Writing & Preference Not comparable

Grok Build 0.1: —, Mistral Medium 3.5: 58.5 (#117)

Writing & Preference benchmarks
Benchmark	Grok Build 0.1	Mistral Medium 3.5
LMArena Text	—	1421
LMArena Creative Writing	—	1374
EQ-Bench 4	—	993
LMArena Multi-Turn	—	1423

Frequently asked questions

Is Grok Build 0.1 better than Mistral Medium 3.5?

Which is cheaper, Grok Build 0.1 or Mistral Medium 3.5?

Grok Build 0.1 is cheaper. It lists at $1 per million input tokens and $2 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Is Grok Build 0.1 or Mistral Medium 3.5 better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 43.1 versus 36.0 in the Noometry coding category.

Which has the bigger context window?

Mistral Medium 3.5 does, with 262K tokens against 256K.

How many benchmarks do Grok Build 0.1 and Mistral Medium 3.5 share?

0 benchmarks have published results for both models. Grok Build 0.1 has 3 scored results on Noometry and Mistral Medium 3.5 has 22.