HEAD TO HEAD
Make the
right call.
Pick two to four models. Compare category evidence, price, context, speed and capabilities side by side.
Sign in to save this comparison →01 / SCORECARD
Coding focus · side by side
| Metric | Claude Fable 5.1 | GPT-6 Astra |
|---|---|---|
| Quantum Score | Insufficient verified data73% coverage | 60QUANTUM SCORE |
| Confidence / coverage | Limited evidence · 73% · 2 independent domains | Moderate confidence · 73% · 4 independent domains |
| Context window | 1,000,000 tokens | 1,050,000 tokens |
| Modalities / tools | text, image · tool use, vision | text, image · tool use, vision |
| Coding | 43 | 63 +20 vs first |
| Reasoning | 92 | 98 +6 vs first |
| Math | 99 | 87 -12 vs first |
| Research | — | — |
| Agents | 40 | 20 -20 vs first |
| Multimodal | — | — |
| Speed | — | — |
| Value | 23 | 22 -1 vs first |
| Input / 1M | $10.00 | $10.00 |
| Output / 1M | $50.00 | $50.00 |
| Measured output speed | — | 55 tokens/s · Max effort |
02 / EVIDENCE
Published benchmark evidence
| Benchmark | Claude Fable 5.1 | GPT-6 Astra |
|---|---|---|
| Terminal-Bench 4.0 Vals mini-SWE-agent avg@3 fallbacks failed · 4.0 · Vals mini-SWE-agent avg@3; Anthropic fallbacks treated as failures | 50 % independent lab ↗ | 59.6 % independent lab ↗ |
| ProofBench v1.1 Vals 100 proof tasks · 1.1 · Vals 100 proof tasks; ceiling effect at top scores | 100 % independent lab ↗ | 99 % independent lab ↗ |
| ProgramBench Vals 200 public tasks raw pass rate · Vals 2026-09-27 · Vals 200 public tasks; raw pass rate; mini-SWE-agent | 82.7 % independent lab ↗ | 85.4 % independent lab ↗ |
| LiveBench code_completion · 2026-06-25 · Public table; published model effort variant | 82.609 % benchmark maintainer ↗ | 80.435 % benchmark maintainer ↗ |
| LiveBench code_generation · 2026-06-25 · Public table; published model effort variant | 90.141 % benchmark maintainer ↗ | 80.282 % benchmark maintainer ↗ |
| LiveBench javascript · 2026-06-25 · Public table; published model effort variant | 68.182 % benchmark maintainer ↗ | 63.636 % benchmark maintainer ↗ |
| LiveBench AMPS_Hard · 2026-06-25 · Public table; published model effort variant | 99 % benchmark maintainer ↗ | 98 % benchmark maintainer ↗ |
| LiveBench olympiad · 2026-06-25 · Public table; published model effort variant | 92.968 % benchmark maintainer ↗ | 92.166 % benchmark maintainer ↗ |
| LiveBench theory_of_mind · 2026-06-25 · Public table; published model effort variant | 80.769 % benchmark maintainer ↗ | 84.615 % benchmark maintainer ↗ |
| LiveBench zebra_puzzle · 2026-06-25 · Public table; published model effort variant | 100 % benchmark maintainer ↗ | 100 % benchmark maintainer ↗ |
AS THE EVIDENCE CHANGED
Comparison history
Dated releases, price events, and benchmark publications. A price or test change can alter the factual comparison; this timeline does not pick a winner.
2026-09-03 · GPT-6 Astra released ↗ · source
2026-09-01 · Claude Fable 5.1 released ↗ · source
2026-09-30 verified (test date not published) · claude-fable-5-1 entered LiveBench code_completion (2026-06-25) at 82.609 % · source ↗
2026-09-30 verified (test date not published) · claude-fable-5-1 entered LiveBench code_generation (2026-06-25) at 90.141 % · source ↗
2026-09-30 verified (test date not published) · claude-fable-5-1 entered LiveBench javascript (2026-06-25) at 68.182 % · source ↗
2026-09-30 verified (test date not published) · claude-fable-5-1 entered LiveBench AMPS_Hard (2026-06-25) at 99 % · source ↗
2026-09-30 verified (test date not published) · claude-fable-5-1 entered LiveBench olympiad (2026-06-25) at 92.968 % · source ↗
2026-09-30 verified (test date not published) · claude-fable-5-1 entered LiveBench theory_of_mind (2026-06-25) at 80.769 % · source ↗
2026-09-30 verified (test date not published) · claude-fable-5-1 entered LiveBench zebra_puzzle (2026-06-25) at 100 % · source ↗
2026-09-30 verified (test date not published) · gpt-6-astra entered LiveBench code_completion (2026-06-25) at 80.435 % · source ↗
2026-09-30 verified (test date not published) · gpt-6-astra entered LiveBench code_generation (2026-06-25) at 80.282 % · source ↗
2026-09-30 verified (test date not published) · gpt-6-astra entered LiveBench javascript (2026-06-25) at 63.636 % · source ↗
2026-09-30 verified (test date not published) · gpt-6-astra entered LiveBench AMPS_Hard (2026-06-25) at 98 % · source ↗
2026-09-30 verified (test date not published) · gpt-6-astra entered LiveBench olympiad (2026-06-25) at 92.166 % · source ↗
An overall score appears only after enough current, comparable, independently sourced results exist. Pricing and individual benchmark results remain visible meanwhile.