Noometry

Model comparison

Molmo 2 8b vs Qwen3-30B-A3B

Molmo 2 8b and Qwen3-30B-A3B score almost the same on the Noometry Index (39.1 vs 38.9), so choose on price, context window or the category you care about most.

Last verified . 4 shared benchmarks.

Molmo 2 8b Allen Institute for AI (Ai2)

39.1

Rank #174 Confirmed

Qwen3-30B-A3B Alibaba (Qwen)

38.9

Rank #179 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Molmo 2 8b scores higher in 1 category and Qwen3-30B-A3B in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Qwen3-30B-A3B leads 49.5 to 42.7.

Side by side

Molmo 2 8bQwen3-30B-A3B
ProviderAllen Institute for AI (Ai2)Alibaba (Qwen)
Noometry Index39.138.9
Released—2025-04-28
WeightsOpenOpen
Context window—41K
Max output—16K
Input $ / M tokens—$0.12
Output $ / M tokens—$0.50
Results tracked532

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Molmo 2 8b: —, Qwen3-30B-A3B: 37.5 (#194)

BenchmarkMolmo 2 8bQwen3-30B-A3B
SciCode—33.3%
WeirdML—29.8%
LMArena Coding—1416

Agentic & Tool Use Not comparable

Molmo 2 8b: —, Qwen3-30B-A3B: 29.8 (#82)

BenchmarkMolmo 2 8bQwen3-30B-A3B
Berkeley Function Calling Leaderboard—41.4%

Reasoning Molmo 2 8b leads

Molmo 2 8b: 25.6 (#146), Qwen3-30B-A3B: 22.2 (#204)

BenchmarkMolmo 2 8bQwen3-30B-A3B
LMArena Hard Prompts12871398
Kagi LLM Benchmark—54.9%
CritPt—0.3%
Chess Puzzles—8%
DTBench—69.3%
LMCA—22.4%
Epoch Capabilities Index—139.63

Math Not comparable

Molmo 2 8b: —, Qwen3-30B-A3B: 37.4 (#157)

BenchmarkMolmo 2 8bQwen3-30B-A3B
MathArena Final-Answer Competitions—47.8%
OTIS Mock AIME 2024-2025—70.3%
LMArena Math—1394

Knowledge Not comparable

Molmo 2 8b: —, Qwen3-30B-A3B: 41.8 (#105)

BenchmarkMolmo 2 8bQwen3-30B-A3B
GPQA Diamond—70.1%
Confabulations—12.3%
LMArena Expert—1396

Multimodal Not comparable

Molmo 2 8b: 30.2 (#112), Qwen3-30B-A3B: —

BenchmarkMolmo 2 8bQwen3-30B-A3B
LMArena Vision1081—

Multilingual Qwen3-30B-A3B leads

Molmo 2 8b: 42.7 (#190), Qwen3-30B-A3B: 49.5 (#132)

BenchmarkMolmo 2 8bQwen3-30B-A3B
LMArena Non-English12761372
LMArena Chinese—1433
LMArena French—1418
LMArena German—1380
LMArena Japanese—1337
LMArena Korean—1331
LMArena Russian—1370
LMArena Spanish—1404

Instruction Following Qwen3-30B-A3B leads

Molmo 2 8b: 67.0 (#201), Qwen3-30B-A3B: 72.0 (#142)

BenchmarkMolmo 2 8bQwen3-30B-A3B
LMArena Instruction Following12701363

Long Context Not comparable

Molmo 2 8b: —, Qwen3-30B-A3B: 31.0 (#283)

BenchmarkMolmo 2 8bQwen3-30B-A3B
Fiction.LiveBench—40.6%
LMArena Longer Query—1379

Writing & Preference Qwen3-30B-A3B leads

Molmo 2 8b: 49.4 (#191), Qwen3-30B-A3B: 55.6 (#143)

BenchmarkMolmo 2 8bQwen3-30B-A3B
LMArena Text12881384
LMArena Creative Writing—1317
Short-Story Creative Writing—75.3%
LMArena Multi-Turn—1378

Frequently asked questions

Is Molmo 2 8b better than Qwen3-30B-A3B?

Molmo 2 8b and Qwen3-30B-A3B score almost the same on the Noometry Index (39.1 vs 38.9), so choose on price, context window or the category you care about most.

How many benchmarks do Molmo 2 8b and Qwen3-30B-A3B share?

4 benchmarks have published results for both models. Molmo 2 8b has 5 scored results on Noometry and Qwen3-30B-A3B has 32.

Related comparisons

Go deeper