Model comparison

GPT-5-Codex vs Kimi K3

Kimi K3 is the stronger model overall, scoring 59.5 to 37.9 on the Noometry Index. GPT-5-Codex costs 1.7× less per token, which makes it the better buy when Kimi K3's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

GPT-5-Codex OpenAI

37.9

Rank #192 Reported

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Summary

  • They share 1 benchmark with published results for both. GPT-5-Codex scores higher in 0 categories and Kimi K3 in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Kimi K3 leads 63.0 to 30.9.
  • The biggest single-benchmark swing is WeirdML: 54.5% for GPT-5-Codex and 82.6% for Kimi K3.
  • GPT-5-Codex is cheaper at $1.25 / $10 per million input/output tokens, against $3 / $15 for Kimi K3.
  • Kimi K3 accepts more context: 1.05M tokens versus 400K.
  • Kimi K3 has downloadable open weights; the other is API-only.

Side by side

GPT-5-Codex and Kimi K3 specifications
GPT-5-CodexKimi K3
ProviderOpenAIMoonshot AI
Noometry Index37.959.5
Released2025-09-152026-07-16
WeightsProprietaryOpen
Context window400K1.05M
Max output128K1.05M
Input $ / M tokens$1.25$3
Output $ / M tokens$10$15
Results tracked353

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K3 leads

GPT-5-Codex: 42.4 (#103), Kimi K3: 61.0 (#10)

Coding benchmarks
BenchmarkGPT-5-CodexKimi K3
WeirdML54.5%82.6%
DeepSWE—68.5%
FrontierCode—44.2%
LMArena WebDev—1654
FrontierSWE—25.9%
SciCode—59.5%
LMArena Coding—1508
ALE-Bench—1,524

Agentic & Tool Use Kimi K3 leads

GPT-5-Codex: 31.0 (#72), Kimi K3: 41.8 (#20)

Agentic & Tool Use benchmarks
BenchmarkGPT-5-CodexKimi K3
Terminal-Bench44.3%—
APEX-Agents—50.6%
τ²-bench Banking—37.1%
PostTrainBench—32%
GBAEval—48.3%
GDP.pdf—19%
Vending-Bench 2—5,165

Reasoning Kimi K3 leads

GPT-5-Codex: 30.9 (#83), Kimi K3: 63.0 (#17)

Reasoning benchmarks
BenchmarkGPT-5-CodexKimi K3
ARC-AGI-2—60.4%
SimpleBench—60.7%
Kagi LLM Benchmark70.3%—
NYT Connections (extended)—93.6%
ARC-AGI-1—94.5%
CritPt—23.4%
Chess Puzzles—39%
LMArena Hard Prompts—1496
Mystery Game Puzzles—26%
DTBench—91.2%
LMCA—52.7%
Surface Evolver Bench—95%
Epoch Capabilities Index—157.45
ForecastBench—61.1

Math Not comparable

GPT-5-Codex: —, Kimi K3: 74.2 (#16)

Math benchmarks
BenchmarkGPT-5-CodexKimi K3
FrontierMath (Tiers 1-3)—72.2%
FrontierMath Tier 4—39%
MathArena Final-Answer Competitions—87.8%
OTIS Mock AIME 2024-2025—97.2%
ProofBench—87%
LMArena Math—1491

Knowledge Not comparable

GPT-5-Codex: —, Kimi K3: 63.2 (#21)

Knowledge benchmarks
BenchmarkGPT-5-CodexKimi K3
GPQA Diamond—93.1%
SimpleQA Verified—50.6%
LMArena Expert—1521

Multimodal Not comparable

GPT-5-Codex: —, Kimi K3: 37.8 (#70)

Multimodal benchmarks
BenchmarkGPT-5-CodexKimi K3
Blueprint-Bench 2—29.5%
Furniture Assembly—34.2%

Multilingual Not comparable

GPT-5-Codex: —, Kimi K3: 56.3 (#21)

Multilingual benchmarks
BenchmarkGPT-5-CodexKimi K3
LMArena Non-English—1466
LMArena Chinese—1529
LMArena French—1491
LMArena German—1488
LMArena Japanese—1487
LMArena Korean—1458
LMArena Russian—1482
LMArena Spanish—1472

Instruction Following Not comparable

GPT-5-Codex: —, Kimi K3: 77.7 (#14)

Instruction Following benchmarks
BenchmarkGPT-5-CodexKimi K3
LMArena Instruction Following—1483

Long Context Not comparable

GPT-5-Codex: —, Kimi K3: 45.8 (#29)

Long Context benchmarks
BenchmarkGPT-5-CodexKimi K3
LMArena Longer Query—1494

Writing & Preference Not comparable

GPT-5-Codex: —, Kimi K3: 76.6 (#4)

Writing & Preference benchmarks
BenchmarkGPT-5-CodexKimi K3
LMArena Text—1476
LMArena Creative Writing—1454
EQ-Bench Creative Writing—2082
EQ-Bench 4—1339
LMArena Multi-Turn—1488

Frequently asked questions

Is GPT-5-Codex better than Kimi K3?

Kimi K3 is the stronger model overall, scoring 59.5 to 37.9 on the Noometry Index. GPT-5-Codex costs 1.7× less per token, which makes it the better buy when Kimi K3's lead doesn't matter for your workload.

Which is cheaper, GPT-5-Codex or Kimi K3?

GPT-5-Codex is cheaper. It lists at $1.25 per million input tokens and $10 per million output tokens; Kimi K3 lists at $3 and $15.

Is GPT-5-Codex or Kimi K3 better for coding?

Kimi K3 scores higher on coding benchmarks: 61.0 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Kimi K3 does, with 1.05M tokens against 400K.

How many benchmarks do GPT-5-Codex and Kimi K3 share?

1 benchmark has published results for both models. GPT-5-Codex has 3 scored results on Noometry and Kimi K3 has 53.

Related comparisons

Go deeper