Compare / head-to-head

GPT-6 SolvsPhi-4-mini-flash-reasoning

GPT-6 Sol leads 1 of 1 shared benchmark. GPT-6 Sol has the larger context window (1.1M tokens).

Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.

Shared benchmarks
1 – 0
GPT-6 Sol leads
Cheaper per token
—
list price, input + output
Larger context
GPT-6 Sol
1.1M tokens
Providers
2 providers
OpenAI · Microsoft
GPT-6 Sol
OpenAI · released 2026-09-22
textvision
Context
1.1M
Max out
128K
Input /1M
$2 ↗
Output /1M
$10 ↗
Cached /1M
$0.2
Scores
27 · 8 core
Phi-4-mini-flash-reasoning
Microsoft · released 2025-07-09
text
Context
64K
Max out
—
Input /1M
—
Output /1M
—
Cached /1M
—
Scores
4 · 3 core
Quality

Benchmark matrix

BenchmarkGPT-6 SolPhi-4-mini-flash-reasoningΔEdge
Reported by both · 1
GPQA Diamond94.3% ↗epoch run45.08% ↗+49.2 ptGPT-6 Sol
Only GPT-6 Sol reports · 26
LMArena Elo1457.2 ↗not reported——
Agents' Last Exam V156.4% ↗not reported——
APEX-Agents (Mercor)54.3% ↗not reported——
AutomationBench 1.0.633.2% ↗not reported——
DeepSWE v1.168.8% ↗not reported——
EBR-bench (Epoch AI run)53.3% ↗epoch runnot reported——
FrontierMath Tier 4 v2 (Epoch AI run)90% ↗epoch runnot reported——
FrontierMath Tiers 1-3 v2 (Epoch AI run)89.8% ↗epoch runnot reported——
Furniture Assembly (Epoch AI run)58.3% ↗epoch runnot reported——
LiveBench Agentic Coding (LiveBench)52.9% ↗not reported——
LiveBench Coding (LiveBench)81.8% ↗not reported——
LiveBench Data Analysis (LiveBench)81.2% ↗not reported——
LiveBench Instruction Following (LiveBench)68.6% ↗not reported——
LiveBench Language (LiveBench)85.3% ↗not reported——
LiveBench Mathematics (LiveBench)96.4% ↗not reported——
LiveBench Reasoning (LiveBench)88.7% ↗not reported——
LMArena Agent (LMArena)0.0971 ↗not reported——
LMArena WebDev (LMArena)1689 ↗not reported——
Mystery Game Puzzles (Epoch AI run)56% ↗epoch runnot reported——
OSWorld 2.0 (offline, partial)60.5% ↗not reported——
OTIS Mock AIME 2024-2025 (Epoch AI run)100% ↗epoch runnot reported——
SAGE (Vals AI)44.8% ↗not reported——
SimpleBench (SimpleBench)73.1% ↗not reported——
SimpleQA Verified60.7% ↗epoch runnot reported——
Terminal-Bench 4.0 (Vals AI)44.4% ↗not reported——
Vending-Bench 2 (Andon Labs)14427.85 ↗not reported——
Only Phi-4-mini-flash-reasoning reports · 3
AIME24not reported52.29% ↗——
AIME25not reported33.59% ↗——
Math500not reported92.45% ↗——
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is GPT-6 Sol minus Phi-4-mini-flash-reasoning in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing

Side by side

SpecGPT-6 SolPhi-4-mini-flash-reasoningEdge
Context window1.1M tokens64K tokensGPT-6 Sol
Max output128K tokens——
Input price / 1M$2 ↗——
Output price / 1M$10 ↗——
Cached input / 1M$0.2 ↗——
Input + output / 1M
Lower is cheaper. List prices; batch, tool and regional fees excluded.
$12——
Modalitiestext · visiontextGPT-6 Sol
Released2026-09-222025-07-09—
Cited benchmark scores274—
Reliability

Provider status

All providers →
More matchups

GPT-6 Sol vs …

Built by Respan
Which one wins on your data?

Public benchmarks are a starting point. Run GPT-6 Sol and Phi-4-mini-flash-reasoning on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.