Evidence record
Internal Research Debugging Evaluation
Astra card snapshot, September 2026 · GPT-6 Astra · 2026-09-03
Reported result · numeric
78.05%
Success rate · percent
lab reported · extraction review: agent checked
Source and extraction
Published 2026-09-03
Evaluation protocol
| task count | 41 |
|---|
Not reported: split, task snapshot, attempts per task, run count, selection rule, aggregate method, token budget, wall clock budget, hardware, training budget, inference budget, monetary cost, tool access, internet access, filtering, scaffold, evaluator version, human intervention, task exclusions, contamination concerns, comparability caveats.
Comparability
Not compared with other results.
Limitations
- 41 debugging bugs; six additional alignment-auditing tasks are described separately.
- Internal suite; no cross-lab percentage comparison.
- Not a demonstration of recursive improvement.