| FrontierMath Tier 4 v2 | FrontierMath Tier 4 v2 | Publisher-reported configuration; see source | — | 98 % | 2026-09-03 | 2026-09-29 | provider first party | View source ↗ |
| ARC-AGI-3 Provider Adapter (High) | ARC-AGI-3 Provider Adapter (High) | Publisher-reported configuration; see source | — | 99.9 % | 2026-09-03 | 2026-09-29 | provider first party | View source ↗ |
| ARC-AGI-3 Semi-Private Standard harness best effort | 3 Semi-Private | ARC Prize Standard harness; best published effort per model | — | 62.7128 % | 2026-09-29 | 2026-11-07 | benchmark maintainer | View source ↗ |
| Terminal-Bench 4.0 Vals mini-SWE-agent avg@3 fallbacks failed | 4.0 | Vals mini-SWE-agent avg@3; Anthropic fallbacks treated as failures | — | 59.6 % | 2026-09-29 | 2026-09-29 | independent lab | View source ↗ |
| ProofBench v1.1 Vals 100 proof tasks | 1.1 | Vals 100 proof tasks; ceiling effect at top scores | — | 99 % | 2026-09-29 | 2026-09-29 | independent lab | View source ↗ |
| ProgramBench Vals 200 public tasks raw pass rate | Vals 2026-09-27 | Vals 200 public tasks; raw pass rate; mini-SWE-agent | — | 85.4 % | 2026-09-27 | 2026-09-29 | independent lab | View source ↗ |
| Humanity's Last Exam AA Index v4.3.2 (Opus Max fallback, Astra Max, Gemini High) | AA Index 4.3.2 | Opus Max with default fallback; Astra Max | — | 55 % | 2026-09-29 | 2026-09-29 | independent lab | View source ↗ |
| AutomationBench-AA Index v4.3.2 (Opus Max fallback, Astra Max, Gemini High) | AA Index 4.3.2 | Opus Max with default fallback; Astra Max | — | 68 % | 2026-09-29 | 2026-09-29 | independent lab | View source ↗ |
| LiveBench code_completion | 2026-06-25 | Public table; published model effort variant | LiveBench public table 2026-06-25 · gpt-6-astra-max | 80.435 % | not published | 2026-10-17 | benchmark maintainer | View source ↗ |
| LiveBench code_generation | 2026-06-25 | Public table; published model effort variant | LiveBench public table 2026-06-25 · gpt-6-astra-max | 80.282 % | not published | 2026-10-17 | benchmark maintainer | View source ↗ |
| LiveBench javascript | 2026-06-25 | Public table; published model effort variant | LiveBench public table 2026-06-25 · gpt-6-astra-max | 63.636 % | not published | 2026-10-17 | benchmark maintainer | View source ↗ |
| LiveBench AMPS_Hard | 2026-06-25 | Public table; published model effort variant | LiveBench public table 2026-06-25 · gpt-6-astra-max | 98 % | not published | 2026-10-17 | benchmark maintainer | View source ↗ |
| LiveBench olympiad | 2026-06-25 | Public table; published model effort variant | LiveBench public table 2026-06-25 · gpt-6-astra-max | 92.166 % | not published | 2026-10-17 | benchmark maintainer | View source ↗ |
| LiveBench theory_of_mind | 2026-06-25 | Public table; published model effort variant | LiveBench public table 2026-06-25 · gpt-6-astra-max | 84.615 % | not published | 2026-10-17 | benchmark maintainer | View source ↗ |
| LiveBench zebra_puzzle | 2026-06-25 | Public table; published model effort variant | LiveBench public table 2026-06-25 · gpt-6-astra-max | 100 % | not published | 2026-10-17 | benchmark maintainer | View source ↗ |
| MMMU-Pro Mercor public leaderboard | MMMU-Pro Mercor public set | Mercor independent evaluation | 1730 public tasks; Pass@1; model effort recorded separately · xHigh | 86.8 % | not published | 2026-09-30 | independent lab | View source ↗ |
| MedXpertQA MM Mercor public leaderboard | MedXpertQA MM Mercor 200 public tasks | Mercor independent evaluation | 200 public tasks; Pass@1; model effort recorded separately · Max | 86.8 % | not published | 2026-09-30 | independent lab | View source ↗ |
| DeepSWE v1.1 maintainer pass@1 | 1.1 | mini-swe-agent; 113-task set; best published reasoning configuration per model; provider/verifier/network errors excluded as documented | mini-swe-agent; 113 tasks; best published reasoning configuration · xhigh | 74.115044 % | not published | 2026-10-01 | benchmark maintainer | View source ↗ |
| LiveBench 2.0 coding | 20261025 | LiveBench 2.0 published release table | Published model configuration; effort not specified in table | 93.7 % | not published | 2026-11-07 | benchmark maintainer | View source ↗ |
| LiveBench 2.0 reasoning | 20261025 | LiveBench 2.0 published release table | Published model configuration; effort not specified in table | 92.7 % | not published | 2026-11-07 | benchmark maintainer | View source ↗ |
| LiveBench 2.0 long_agentic | 20261025 | LiveBench 2.0 published release table | Published model configuration; effort not specified in table | 77.5 % | not published | 2026-11-07 | benchmark maintainer | View source ↗ |