Model comparison

GLM-4.6 vs Mistral Small

GLM-4.6 is the stronger model overall, scoring 40.9 to 33.1 on the Noometry Index. Mistral Small costs 3.8× less per token, which makes it the better buy when GLM-4.6's lead doesn't matter for your workload.

Last verified . 23 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

40.9

Rank #132 Confirmed

Mistral Small Mistral AI

33.1

Rank #238 Confirmed

Summary

  • They share 23 benchmarks with published results for both. GLM-4.6 scores higher in 9 categories and Mistral Small in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-4.6 leads 36.4 to 15.4.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 72.4% for GLM-4.6 and 37.1% for Mistral Small.
  • Mistral Small is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.60 / $2.20 for GLM-4.6.
  • Mistral Small accepts more context: 256K tokens versus 205K.

Side by side

GLM-4.6 and Mistral Small specifications
GLM-4.6Mistral Small
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index40.933.1
Released2025-09-302024-02-26
WeightsOpenOpen
Context window205K256K
Max output131K256K
Input $ / M tokens$0.60$0.15
Output $ / M tokens$2.20$0.60
Results tracked2939

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6 leads

GLM-4.6: 39.9 (#137), Mistral Small: 33.5 (#242)

Coding benchmarks
BenchmarkGLM-4.6Mistral Small
SciCode38.4%26.5%
LMArena Coding14491363
ALE-Bench340.82497.62
SWE-bench Verified (bash only)55.4%—
LMArena WebDev1339—
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
BigCodeBench Complete—46.6%

Agentic & Tool Use GLM-4.6 leads

GLM-4.6: 32.1 (#60), Mistral Small: 27.9 (#87)

Agentic & Tool Use benchmarks
BenchmarkGLM-4.6Mistral Small
Berkeley Function Calling Leaderboard72.4%37.1%
Terminal-Bench24.5%—

Reasoning GLM-4.6 leads

GLM-4.6: 23.1 (#168), Mistral Small: 19.3 (#238)

Reasoning benchmarks
BenchmarkGLM-4.6Mistral Small
Kagi LLM Benchmark47.4%37.8%
CritPt1.1%0%
LMArena Hard Prompts14401336
LiveBench Reasoning—44.8%
DTBench—70.9%
LiveBench Data Analysis—53.7%
LMCA—20.6%
LiveBench—44%

Math GLM-4.6 leads

GLM-4.6: 36.4 (#115), Mistral Small: 15.4 (#287)

Math benchmarks
BenchmarkGLM-4.6Mistral Small
LMArena Math14311341
OTIS Mock AIME 2024-2025—5.8%
LiveBench Math—39.9%
MATH Level 5—46.8%
FrontierMath (Feb 2025 set)3.8%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge GLM-4.6 leads

GLM-4.6: 39.6 (#118), Mistral Small: 30.9 (#214)

Knowledge benchmarks
BenchmarkGLM-4.6Mistral Small
Vectara Hallucination Rate9.5%5.1%
LMArena Expert14321293
GPQA Diamond—47.5%
MMLU—68.7%

Multimodal Not comparable

GLM-4.6: —, Mistral Small: 32.9 (#91)

Multimodal benchmarks
BenchmarkGLM-4.6Mistral Small
LMArena Vision—1142

Multilingual GLM-4.6 leads

GLM-4.6: 53.6 (#62), Mistral Small: 45.7 (#164)

Multilingual benchmarks
BenchmarkGLM-4.6Mistral Small
LMArena Non-English14261315
LMArena Chinese15001342
LMArena French14591337
LMArena German14471341
LMArena Japanese13941275
LMArena Korean14011260
LMArena Russian14181324
LMArena Spanish14361346

Instruction Following GLM-4.6 leads

GLM-4.6: 74.5 (#93), Mistral Small: 66.6 (#204)

Instruction Following benchmarks
BenchmarkGLM-4.6Mistral Small
LMArena Instruction Following14101310
LiveBench Instruction Following—63.7%

Long Context GLM-4.6 leads

GLM-4.6: 43.4 (#91), Mistral Small: 40.4 (#151)

Long Context benchmarks
BenchmarkGLM-4.6Mistral Small
LMArena Longer Query14231327

Writing & Preference GLM-4.6 leads

GLM-4.6: 61.3 (#86), Mistral Small: 52.6 (#165)

Writing & Preference benchmarks
BenchmarkGLM-4.6Mistral Small
LMArena Text14401338
LMArena Creative Writing14111304
LMArena Multi-Turn14271344
EQ-Bench Creative Writing1411—
LiveBench Language—30.5%

Frequently asked questions

Is GLM-4.6 better than Mistral Small?

GLM-4.6 is the stronger model overall, scoring 40.9 to 33.1 on the Noometry Index. Mistral Small costs 3.8× less per token, which makes it the better buy when GLM-4.6's lead doesn't matter for your workload.

Which is cheaper, GLM-4.6 or Mistral Small?

Mistral Small is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GLM-4.6 lists at $0.60 and $2.20.

Is GLM-4.6 or Mistral Small better for coding?

GLM-4.6 scores higher on coding benchmarks: 39.9 versus 33.5 in the Noometry coding category.

Which has the bigger context window?

Mistral Small does, with 256K tokens against 205K.

How many benchmarks do GLM-4.6 and Mistral Small share?

23 benchmarks have published results for both models. GLM-4.6 has 29 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper