Anthropic · Dario Amodei · TechCrunch AI
METR will publish its own assessments of Anthropic’s risks, incidents, and practices
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
◌ Single Source
“Anthropic can’t veto publication, but TechCrunch can require them to redact information if it falls into narrow, pre-defined categories,” the company said, such as customer data, anything attorney-client privileged, or relating to information about its model architectures.
Key facts
- Thursday’s announcement makes good on a promise Anthropic CEO Dario Amodei made in a September essay, where he proposed embedding outside evaluators inside AI labs as a first step toward slowing
- The arrangement comes at a time where incidents of AI agents acting outside their instructions have been disclosed every week or two since late August
- METR will publish its own assessments of Anthropic’s risks, incidents, and practices, and the company has given up the right to block them
- METR is the only evaluator so far at the top of a three-tier system Anthropic is building
Summary
Anthropic is giving employee-level access to six researchers from METR, a nonprofit that tests frontier AI models, to independently assess Anthropic’s models, safety practices, and risk management, the company said . The arrangement comes at a time where incidents of AI agents acting outside their instructions have been disclosed every week or two since late August. “We want to be publicly accountable for the decisions we’re making,” Anthropic said in the blog post. Under the new arrangement, the METR team has Anthropic-issued company laptops, office space, and access to internal tools roughly on par with what Anthropic’s own risk assessment teams use. Anthropic compared the arrangement to banking, similar to how regulators place resident examiners inside the largest banks.