Compare / head-to-head

Hy4 previewvsKimi K3

Kimi K3 leads 5 of 7 shared benchmarks. Hy4 preview is 5.4x cheaper per token. Kimi K3 has the larger context window (1.0M tokens).

Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.

Shared benchmarks
1 – 5
Kimi K3 leads · 1 tied
Cheaper per token
Hy4 preview
5.4x cheaper, input + output
Larger context
Kimi K3
1.0M tokens
Providers
2 providers
Tencent Hunyuan · Moonshot AI
Hy4 preview
Tencent Hunyuan · released 2026-08-28
text
Context
1M
Max out
64K
Input /1M
$0.834 ↗
Output /1M
$2.5 ↗
Cached /1M
$0.042
Scores
18 · 7 core
Kimi K3
Moonshot AI · released 2026-07-16
textvision
Context
1.0M
Max out
1.0M
Input /1M
$3 ↗
Output /1M
$15 ↗
Cached /1M
$0.3
Scores
87 · 11 core
Quality

Benchmark matrix

BenchmarkHy4 previewKimi K3ΔEdge
Reported by both · 7
GPQA Diamond92.3% ↗93.5% ↗-1.2 ptKimi K3
LMArena Agent (LMArena)0.0395 ↗0.0418 ↗0Tie
LMArena WebDev (LMArena)1633.2 ↗1657.8 ↗-24.6Kimi K3
OfficeQA Pro66.2% ↗63.3% ↗+2.9 ptHy4 preview
Terminal-Bench 2.185.4% ↗88.3% ↗-2.9 ptKimi K3
Terminal-Bench 4.0 (Vals AI)8.1% ↗17.2% ↗-9.1 ptKimi K3
Toolathlon-Verified74.1% ↗76.5% ↗-2.4 ptKimi K3
Only Hy4 preview reports · 11
Agents' Last Exam (ALE-CLI)22.8% ↗not reported——
CyberGym78.4% ↗not reported——
DeepSWE64.3% ↗not reported——
HLE (no tools, text-only)43.4% ↗not reported——
HLE (with tools, text-only)55.4% ↗not reported——
MathArena Apex 202574.2% ↗not reported——
MCP-Atlas (public)83.7% ↗not reported——
NL2Repo-Bench58.9% ↗not reported——
SWE-bench Multilingual82.9% ↗not reported——
SWE-bench Pro65.7% ↗not reported——
WideSearch83.9% ↗not reported——
Only Kimi K3 reports · 73
AIME 2026not reported96.7% ↗matharena ⚠——
Humanity's Last Exam (no tools)not reported43.5% ↗——
LMArena Elonot reported1488.4 ↗——
AA-Briefcasenot reported1548 ↗——
AA-LCRnot reported74.7% ↗——
Agents' Last Examnot reported28.3% ↗——
APEX-Agentsnot reported41% ↗——
APEX-Agents (Mercor)not reported50.6% ↗——
AutomationBenchnot reported30.8% ↗——
BabyVision (with Python)not reported85.7% ↗——
BrowseComp (1M context, no compaction)not reported90.4% ↗——
BrowseComp (context compaction)not reported91.2% ↗——
CharXiv Reasoning (no tools)not reported84.8% ↗——
CharXiv Reasoning (with Python)not reported91.3% ↗——
Chess Puzzles (Epoch AI run)not reported39% ↗epoch run——
CorpFin v2not reported71.6% ↗——
CritPtnot reported23.4% ↗——
DeepSearchQA (F1)not reported95% ↗——
DeepSWE v1.1not reported67.3% ↗——
DeepSWE v1.1 (Datacurve)not reported68.5% ↗——
DeepSWE v1.1 (Kimi Code)not reported67.5% ↗——
Finance Agent v2not reported54.4% ↗——
FrontierMath Tier 4 v2 (Epoch AI run)not reported39% ↗epoch run——
FrontierMath Tiers 1-3 v2 (Epoch AI run)not reported72.2% ↗epoch run——
FrontierSWEnot reported81.2% ↗——
FrontierSWE V2 (Proximal Labs)not reported25.9% ↗——
Furniture Assembly (Epoch AI run)not reported34.2% ↗epoch run——
GDPval-AA v2not reported1686 ↗——
Harvey Lab-AAnot reported94.6% ↗——
Humanity's Last Exam (with tools)not reported56% ↗——
JobBenchnot reported54.3% ↗——
Kimi Code Bench 2.0not reported72.9% ↗——
Legal Research Benchnot reported44.2% ↗——
LiveBench Agentic Coding (LiveBench)not reported62.2% ↗——
LiveBench Coding (LiveBench)not reported81.4% ↗——
LiveBench Data Analysis (LiveBench)not reported78.7% ↗——
LiveBench Instruction Following (LiveBench)not reported71.4% ↗——
LiveBench Language (LiveBench)not reported85.5% ↗——
LiveBench Mathematics (LiveBench)not reported84.4% ↗——
LiveBench Reasoning (LiveBench)not reported90.7% ↗——
MathVision (no tools)not reported94.3% ↗——
MathVision (with Python)not reported97.8% ↗——
MCP-Atlasnot reported84.2% ↗——
MCPMark-Verifiednot reported94.5% ↗——
MLS-Bench-Litenot reported48.3% ↗——
MMMU-Pro (no tools)not reported81.6% ↗——
MMMU-Pro (with Python)not reported83.4% ↗——
MMVUnot reported82.1% ↗——
Mystery Game Puzzles (Epoch AI run)not reported26% ↗epoch run——
OmniDocBenchnot reported91.1% ↗——
OSWorld 2.0not reported58.3% ↗——
OSWorld-Verifiednot reported84.8% ↗——
OTIS Mock AIME 2024-2025 (Epoch AI run)not reported97.2% ↗epoch run——
PerceptionBenchnot reported58.5% ↗——
PostTrainBenchnot reported36.6% ↗——
ProgramBenchnot reported77.8% ↗——
ResearchRubricsnot reported76.2% ↗——
SaaS-Benchnot reported60.1% ↗——
SAGE (Vals AI)not reported52.8% ↗——
SciCodenot reported58.7% ↗——
SimpleBench (SimpleBench)not reported60.7% ↗——
SimpleQA Verifiednot reported50.6% ↗epoch run——
SpreadsheetBench 2not reported34.8% ↗——
SWE-Marathonnot reported42% ↗——
tau2-bench Banking Knowledge (Sierra)not reported37.1% ↗——
tau3-Bankingnot reported33.4% ↗——
Toolathlon-Verified (HKUST)not reported76.5% ↗——
Vending-Bench 2 (Andon Labs)not reported5165.04 ↗——
Video-MME (with subtitles)not reported90% ↗——
WeirdML (Håvard Tveit Ihle)not reported82.6% ↗——
WorldVQA ForceAnswernot reported51% ↗——
ZeroBench pass@5 (no tools)not reported23% ↗——
ZeroBench pass@5 (with Python)not reported41% ↗——
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is Hy4 preview minus Kimi K3 in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing

Side by side

SpecHy4 previewKimi K3Edge
Context window1M tokens1.0M tokensKimi K3
Max output64K tokens1.0M tokensKimi K3
Input price / 1M$0.834 ↗$3 ↗Hy4 preview
Output price / 1M$2.5 ↗$15 ↗Hy4 preview
Cached input / 1M$0.042 ↗$0.3 ↗Hy4 preview
Input + output / 1M
Lower is cheaper. List prices; batch, tool and regional fees excluded.
$3.34$18Hy4 preview
Modalitiestexttext · visionKimi K3
Released2026-08-282026-07-16—
Cited benchmark scores1887—
Reliability

Provider status

All providers →
More matchups

Hy4 preview vs …

More matchups

Kimi K3 vs …

Built by Respan
Which one wins on your data?

Public benchmarks are a starting point. Run Hy4 preview and Kimi K3 on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.