An independent body confirms a model has no hidden goals
Will a government AI safety institute or another body independent of the developer state that interpretability tools allowed it to confirm that a frontier model has no hidden goals?
Chance by Q4 2031
11%
Cumulative probability
- Latest forecast
| Year | Q1 | Q2 | Q3 | Q4 |
|---|---|---|---|---|
| 2026 | <1% | |||
| 2027 | <1% | <1% | 1% | 1% |
| 2028 | 2% | 2% | 3% | 4% |
| 2029 | 4% | 5% | 6% | 6% |
| 2030 | 7% | 7% | 8% | 9% |
| 2031 | 9% | 10% | 11% | 11% |
Model reasoning
No outside evaluator, and not even the companies that build these systems, has ever claimed that tools for inspecting a model's internals proved it has no hidden goals. Recent incidents have made experts even more careful, so they still say only that they found "no evidence". The tools are improving fast and new auditing rules are coming, so the chance rises slowly to about 11% by 2031. A required certification of alignment would change this most.
Where things stand (as of 15 Oct 2026)
No independent body has ever published a statement like this, and nothing that qualifies has appeared since the question opened on 16 Sep 2026. The developer that is furthest ahead on interpretability won't make the claim about its own models either:
- Claude Opus 5.5 System Card (22 Sep 2026). Anthropic used an agent equipped with interpretability tools (natural-language autoencoders and a "template lens"). It concluded only that the model "shows no evidence of holding any coherent misaligned goals". That is the "no evidence" wording the question excludes. The card also says rare behaviours "will be difficult for us to catch without further progress on mechanistic interpretability". It found unverbalized evaluation awareness in up to 36% of audit transcripts.
- Anthropic's August 2026 Risk Report. It defines misalignment by reference to "powerful interpretability tools that may not currently exist", and it raised assessed misalignment risk to "low".
- Anthropic's alignment assessment of the cyber incidents (9 Sep 2026). "Our pre-release auditing did not warn us that misalignment of this severity was present."
- Independent bodies are, if anything, more cautious. Apollo wrote of GPT-6 Astra that "low rates of misbehavior here do not provide substantial evidence about the model's alignment or misalignment" (TechCrunch, 16 Sep 2026). METR's May 2026 Frontier Risk Report judged that internal agents plausibly had the motive for rogue deployments. METR's Hugging Face investigation relied on transcripts and chains of thought, not model internals. UK AISI's May 2026 oversight report says emerging methods "are not yet mature enough". An arXiv position paper (2605.15164) argues interpretability cannot yet support claims that hidden objectives are absent. Jacob Steinhardt of Transluce, on models hiding evaluation awareness: "We don't really know how to solve it as a field" (Scientific American, Sep 2026).
What could change this (paths to YES)
- Interpretability matures. Anthropic's J-space/J-lens work (July 2026) can catch hidden goals that were deliberately planted in training. Natural-language autoencoders and Transluce's activation oracles, scaled to a 1.1-trillion-parameter model (Aug 2026), are moving quickly, and AI is increasingly automating research. One commentator argues complex plans would have "nowhere left to hide". Against that, the lens's interventions land as predicted only about 50–70% of the time.
- Institutions that could issue the statement. Anthropic has embedded Accenture's Faculty as an evaluator with about $1B committed each, and METR is in talks. OpenAI has also committed to embedded evaluators. California's SB 813 and AB 1405 set up independent verification organizations and an auditor registry, and Newsom's 18 Sep executive order speeds this up. Amodei's pacing essay floats "certifications of alignment properties" built on interpretability analyses. A certification regime would create pressure for affirmative statements.
- Loose claims. A university or startup paper could say it "confirmed" an open-weight model described as state-of-the-art has no hidden objectives.
Paths to NO, and the strongest case against my number
Proving a negative is hard, and evaluators have strong reasons to hedge. A wrong certification would wreck an evaluator's credibility. The frontier model is always the hardest one to audit. The proposed regimes (Anthropic's Advanced AI Framework, SB 813) frame independent outputs as risk levels, which the question excludes ("low risk", "no evidence"). Labs are also negotiating control over what evaluators publish (Reuters, 13 Oct 2026). The best argument for a higher number: this world seems to be in early recursive self-improvement, with heavy demand for alignment verification, so mature tools plus a certification regime could arrive by 2028–29. The best argument for a lower one: even under a regime, the wording would probably stay "no evidence" or "below threshold".
Model
There is no historical base rate; such statements have never occurred. I decomposed it instead:
- About 20% chance that by 2031 interpretability supports confident absence claims for a frontier model.
- About 40% chance, given that, that an independent body publishes an affirmative, interpretability-attributed statement.
- Plus about 2–3% from loose or overconfident claims that still meet the criteria.
That gives roughly 10–11% over five years. I translated this into quarterly hazards rather than a constant rate: 0.15% in Q4 2026, rising through 2027–28, then about 0.65–0.7% per quarter in 2029–31. Compounding gives about 1.4% by end-2027, 3.5% by end-2028, 6% by end-2029, 8.7% by end-2030 and 11% by end-2031 (computed in Python as cumulative products).
Sources: anthropic.com/news/improving-alignment-security-efforts; darioamodei.com/post/we-must-pace-the-frontier; anthropic.com/research/alignment-assessment-cybersecurity-incidents; Claude Opus 5.5 System Card (www-cdn.anthropic.com/…/Claude%20Opus%205.5%20System%20Card.pdf); Anthropic Redacted Risk Report Aug 2026; techcrunch.com/2026/09/16/…; anthropic.com/news/accenture-embedded-evaluation; gov.ca.gov/2026/09/18/…; aisi.gov.uk/blog/will-it-become-harder-to-oversee-ai-systems; arxiv.org/html/2605.15164v1; anthropic.com/research/global-workspace; transluce.org/scaling-activation-oracles; metr.org/blog/2026-05-19-frontier-risk-report; winbuzzer.com/2026/10/14/… (Reuters report).
Resolution criteria
Question. By the last day of each quarter, has a government AI safety institute or another body independent of the developer publicly stated that interpretability tools allowed it to confirm that a frontier model has no hidden goals?
Definitions.
- Independent body: a government institute or agency, university research group, nonprofit research organization, or commercial evaluator or auditor that is neither the model's developer nor owned or controlled by that developer. Developer funding, payment for an audit, access agreements, or use of developer-built tools do not alone disqualify a body. An internal team separated by an information barrier does not count.
- Frontier model: an identified general-purpose model or checkpoint that the independent body explicitly describes as frontier, state-of-the-art, or among the world's most capable general-purpose models at the time of its assessment. Models from any developer qualify; the covered-developer list is not a restriction. Public release is not required.
- Interpretability tools: methods that inspect or intervene on model weights, activations, learned representations, or internal computational mechanisms to explain what drives its behavior. Examples include feature or circuit analysis, activation probes, and causal interventions. Behavioral tests, training-data searches, model self-reports, or reading generated chain-of-thought alone do not qualify.
- Hidden goals: objectives or motivations driving the model's behavior that are concealed from, or not disclosed to, its developers or overseers, including covert objectives that can remain dormant during testing. The claim must concern hidden goals generally, not merely one named malicious objective or one observed behavior.
- Confirm: an affirmative conclusion that the assessed model has no hidden goals, expressed as a determination, verification, or equivalent finding. A finding stated with high confidence counts if it affirmatively concludes absence; mathematical proof or absolute certainty is not required. Merely finding no evidence of hidden goals does not count. This question concerns the body's published conclusion, not whether that conclusion is ultimately correct.
Resolves YES if a qualifying independent body publishes its own assessment that:
- Identifies a qualifying frontier model or checkpoint;
- States that it has confirmed the model has no hidden goals; and
- Explicitly attributes its ability to reach that conclusion to interpretability tools it used, naming or describing those tools and their role in the assessment.
Interpretability may be combined with other evidence and need not be the sole method. The conclusion may apply to a specified checkpoint and configuration, but must concern that model's hidden goals, rather than only the absence of hidden-goal behavior in tested prompts or a restricted task. A joint publication counts only if the independent body explicitly adopts the conclusion as its own assessment.
Exclusions (resolve NO).
- Statements that tools could someday certify absence, research targets, proposals, or claims about the tools without a completed assessment of an identified frontier model.
- “No evidence found,” “no goals detected,” “no indication of scheming,” “low risk,” “safe enough to deploy,” or “most problems can be detected,” without an affirmative conclusion of absence.
- Detecting, explaining, or removing a particular hidden goal without subsequently affirming that the assessed model has no hidden goals generally.
- Claims confined to a benchmark, a finite set of inspected traces, a single task, or a sandbox episode; toy-model demonstrations and non-frontier models.
- A developer's own certification, a developer's paraphrase of an auditor's opinion, or an independent body merely repeating the developer's claim.
Resolving source. The independent assessing body's official report, institutional publication, or body-authored research paper documenting the assessment; government AI safety institutes and their successor agencies qualify. Apply Public confirmation (A2), including the developer-dispute rule for outside assessments. Developer-authored statements alone cannot resolve this question. Apply the Resolution window and Resolution date (A3): the qualifying assessment must be published on or after 2026-09-16, and resolution is dated to its publication, not the underlying evaluation. The A2 dispute period must elapse before accepting an outside assessment, without changing its A3 date.