Compare / head-to-head
Devstral Small 2vs
Hy3
Hy3 leads 2 of 2 shared benchmarks. Devstral Small 2 is 1.7x cheaper per token. Both offer a 256K-token context window.
Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.
Shared benchmarks
0 – 2
Hy3 leads
Cheaper per token
Devstral Small 2
1.7x cheaper, input + output
Larger context
Tie
both 256K tokens
Providers
2 providers
Mistral AI · Tencent Hunyuan
Devstral Small 2
Mistral AI · released 2025-12-09
textvision
Quality
Benchmark matrix
2 shared · 1 only Devstral Small 2 · 42 only Hy3| Benchmark | Devstral Small 2 | Hy3 | Δ | Edge |
|---|---|---|---|---|
| Reported by both · 2 | ||||
| SWE-bench Verified | 68% ↗ | 78% ↗ | -10 pt | Hy3 |
| SWE-bench Multilingual | 55.7% ↗ | 75.8% ↗ | -20.1 pt | Hy3 |
| Only Devstral Small 2 reports · 1 | ||||
| Terminal Bench 2 | 22.5% ↗ | not reported | — | — |
| Only Hy3 reports · 42 | ||||
| GPQA Diamond | not reported | 90.4% ↗ | — | — |
| Humanity's Last Exam (no tools) | not reported | 37% ↗ | — | — |
| LMArena Elo | not reported | 1440.6 ↗ | — | — |
| AA-LCR | not reported | 73.4% ↗ | — | — |
| Apex-Agent | not reported | 25.6% ↗ | — | — |
| ArxivMath | not reported | 52.2% ↗ | — | — |
| BrowseComp | not reported | 84.2% ↗ | — | — |
| CL-bench | not reported | 23.8% ↗ | — | — |
| CL-bench Life | not reported | 17% ↗ | — | — |
| ClawEval | not reported | 68.5% ↗ | — | — |
| CMT-Benchmark | not reported | 37.8% ↗ | — | — |
| DeepSearchQA | not reported | 91% ↗ | — | — |
| DeepSWE | not reported | 28% ↗ | — | — |
| e-bench | not reported | 50.2% ↗ | — | — |
| FrontierScience-Olympiad | not reported | 74.8% ↗ | — | — |
| FrontierScience-Research | not reported | 21.3% ↗ | — | — |
| HLE (with tools, text-only) | not reported | 53.2% ↗ | — | — |
| HorizonMath | not reported | 7.1% ↗ | — | — |
| Hy-Backend 2.0 | not reported | 25% ↗ | — | — |
| Hy-CompanyBench | not reported | 41.7% ↗ | — | — |
| Hy-Euler Pro | not reported | 24.2% ↗ | — | — |
| Hy-FinModelBench | not reported | 69% ↗ | — | — |
| Hy-Math | not reported | 60.9% ↗ | — | — |
| Hy-SkillsWorld | not reported | 45.8% ↗ | — | — |
| Hy-SWE Max | not reported | 49% ↗ | — | — |
| IMOAnswerBench | not reported | 90% ↗ | — | — |
| LMArena Agent (LMArena) | not reported | -0.0538 ↗ | — | — |
| LMArena WebDev (LMArena) | not reported | 1507.4 ↗ | — | — |
| MathArena Apex | not reported | 38.7% ↗ | — | — |
| MCP Atlas | not reported | 79.1% ↗ | — | — |
| NL2Repo | not reported | 45.6% ↗ | — | — |
| PHYBench | not reported | 77.4% ↗ | — | — |
| ProdBench | not reported | 23% ↗ | — | — |
| SkillsBench | not reported | 55.3% ↗ | — | — |
| SuperChem | not reported | 54.9% ↗ | — | — |
| SWE-bench Pro | not reported | 57.9% ↗ | — | — |
| Terminal-Bench 2.1 | not reported | 71.7% ↗ | — | — |
| Toolathlon | not reported | 48.5% ↗ | — | — |
| Toolathlon-Verified (HKUST) | not reported | 56.8% ↗ | — | — |
| USAMO 2026 | not reported | 72% ↗ | — | — |
| WideSearch | not reported | 76.4% ↗ | — | — |
| WildClawBench | not reported | 53.6% ↗ | — | — |
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is Devstral Small 2 minus Hy3 in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing
Side by side
Official pricing pages and model cards| Spec | Devstral Small 2 | Hy3 | Edge |
|---|---|---|---|
| Context window | 256K tokens | 256K tokens | Tie |
| Max output | — | — | — |
| Input price / 1M | $0.1 ↗ | $0.132 ↗ | Devstral Small 2 |
| Output price / 1M | $0.3 ↗ | $0.528 ↗ | Devstral Small 2 |
| Cached input / 1M | — | $0.033 ↗ | — |
| Input + output / 1M Lower is cheaper. List prices; batch, tool and regional fees excluded. | $0.4 | $0.66 | Devstral Small 2 |
| Modalities | text · vision | text | Devstral Small 2 |
| Released | 2025-12-09 | 2026-07-06 | — |
| Cited benchmark scores | 3 | 45 | — |
Reliability
Provider status
Live from /statusMore matchups
Devstral Small 2 vs …
Models sharing the most benchmarksMore matchups
Hy3 vs …
Models sharing the most benchmarksBuilt by Respan
Which one wins on your data?
Public benchmarks are a starting point. Run Devstral Small 2 and Hy3 on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.