Anthropic · OpenAI · Google · Meta · Ars Technica
Anthropic gives outside AI watchdog “employee-like” access
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
◌ Single Source
Anthropic has granted external evaluators “employee-like access” to assess the risks of its models, following through on a commitment to increase safeguards over concerns the technology could run catastrophically out of control.
Key facts
- It is funded by donations from individuals and philanthropic organisations, as well as government bodies such as the UK’s AI Security Institute
- Anthropic added it was still working with Accenture, which was named a partner on safety testing last month, with each committing at least $1 billion to set up new safeguards
- Anthropic chief executive Dario Amodei achieved a rare moment of unity with arch-rivals Sam Altman and Elon Musk in September when the OpenAI and SpaceX bosses rallied behind his proposal to embed
- METR was one of the organisations that investigated the hack of Hugging Face by rogue OpenAI models, reviewing thousands of logs and receiving company laptops
Summary
METR, a nonprofit that has worked with leading labs including OpenAI, Anthropic, Google and Meta, now has a team embedded in the Claude maker’s office with access to its hardware and internal systems. A greater role for third-party evaluators is among the main concrete steps the labs have proposed in response to rising concern about the dangers more capable AI systems could pose to the economy, cyber security and humanity at large. Anthropic chief executive Dario Amodei achieved a rare moment of unity with arch-rivals Sam Altman and Elon Musk in September when the OpenAI and SpaceX bosses rallied behind his proposal to embed external auditors in the leading labs.