Model comparison

GPT-6.1 Sol vs Mistral Small

Mistral Small has enough public results to be ranked (#238); GPT-6.1 Sol does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

GPT-6.1 Sol OpenAI

42.1

Unranked Sparse

Mistral Small Mistral AI

33.1

Rank #238 Confirmed

Summary

  • The widest gap is in coding, where GPT-6.1 Sol leads 51.4 to 33.5.
  • Mistral Small is cheaper at $0.15 / $0.60 per million input/output tokens, against $2 / $10 for GPT-6.1 Sol.
  • GPT-6.1 Sol accepts more context: 1.05M tokens versus 256K.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

GPT-6.1 Sol and Mistral Small specifications
GPT-6.1 SolMistral Small
ProviderOpenAIMistral AI
Noometry Index42.133.1
Released2026-09-292024-02-26
WeightsProprietaryOpen
Context window1.05M256K
Max output128K256K
Input $ / M tokens$2$0.15
Output $ / M tokens$10$0.60
Results tracked239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

GPT-6.1 Sol: 51.4, Mistral Small: 33.5 (#242)

Coding benchmarks
BenchmarkGPT-6.1 SolMistral Small
DeepSWE75.2%—
SciCode—26.5%
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
LMArena Coding—1363
BigCodeBench Complete—46.6%
ALE-Bench—497.62

Agentic & Tool Use GPT-6.1 Sol leads

GPT-6.1 Sol: 34.3, Mistral Small: 27.9 (#87)

Agentic & Tool Use benchmarks
BenchmarkGPT-6.1 SolMistral Small
Berkeley Function Calling Leaderboard—37.1%
GDP.pdf32%—

Reasoning Not comparable

GPT-6.1 Sol: —, Mistral Small: 19.3 (#238)

Reasoning benchmarks
BenchmarkGPT-6.1 SolMistral Small
Kagi LLM Benchmark—37.8%
CritPt—0%
LiveBench Reasoning—44.8%
LMArena Hard Prompts—1336
DTBench—70.9%
LiveBench Data Analysis—53.7%
LMCA—20.6%
LiveBench—44%

Math Not comparable

GPT-6.1 Sol: —, Mistral Small: 15.4 (#287)

Math benchmarks
BenchmarkGPT-6.1 SolMistral Small
OTIS Mock AIME 2024-2025—5.8%
LiveBench Math—39.9%
LMArena Math—1341
MATH Level 5—46.8%

Knowledge Not comparable

GPT-6.1 Sol: —, Mistral Small: 30.9 (#214)

Knowledge benchmarks
BenchmarkGPT-6.1 SolMistral Small
GPQA Diamond—47.5%
Vectara Hallucination Rate—5.1%
LMArena Expert—1293
MMLU—68.7%

Multimodal Not comparable

GPT-6.1 Sol: —, Mistral Small: 32.9 (#91)

Multimodal benchmarks
BenchmarkGPT-6.1 SolMistral Small
LMArena Vision—1142

Multilingual Not comparable

GPT-6.1 Sol: —, Mistral Small: 45.7 (#164)

Multilingual benchmarks
BenchmarkGPT-6.1 SolMistral Small
LMArena Non-English—1315
LMArena Chinese—1342
LMArena French—1337
LMArena German—1341
LMArena Japanese—1275
LMArena Korean—1260
LMArena Russian—1324
LMArena Spanish—1346

Instruction Following Not comparable

GPT-6.1 Sol: —, Mistral Small: 66.6 (#204)

Instruction Following benchmarks
BenchmarkGPT-6.1 SolMistral Small
LiveBench Instruction Following—63.7%
LMArena Instruction Following—1310

Long Context Not comparable

GPT-6.1 Sol: —, Mistral Small: 40.4 (#151)

Long Context benchmarks
BenchmarkGPT-6.1 SolMistral Small
LMArena Longer Query—1327

Writing & Preference Not comparable

GPT-6.1 Sol: —, Mistral Small: 52.6 (#165)

Writing & Preference benchmarks
BenchmarkGPT-6.1 SolMistral Small
LMArena Text—1338
LMArena Creative Writing—1304
LMArena Multi-Turn—1344
LiveBench Language—30.5%

Frequently asked questions

Is GPT-6.1 Sol better than Mistral Small?

Mistral Small has enough public results to be ranked (#238); GPT-6.1 Sol does not yet, so treat this comparison as directional.

Which is cheaper, GPT-6.1 Sol or Mistral Small?

Mistral Small is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GPT-6.1 Sol lists at $2 and $10.

Is GPT-6.1 Sol or Mistral Small better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 51.4 versus 33.5 in the Noometry coding category.

Which has the bigger context window?

GPT-6.1 Sol does, with 1.05M tokens against 256K.

How many benchmarks do GPT-6.1 Sol and Mistral Small share?

0 benchmarks have published results for both models. GPT-6.1 Sol has 2 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper