OpenAI, Anthropic Agree to Work With US Institute on Safety

The US government announced agreements with leading artificial intelligence startups OpenAI and Anthropic to help test and evaluate their upcoming technologies for safety.

Under the agreements, announced on Thursday, the US AI Safety Institute will receive early access to major new AI models from the companies to evaluate capabilities and risks as well as collaborate on methods to mitigate potential issues. The AI Safety Institute is part of the Commerce Department’s National Institute of Standards and Technology, or NIST. The agreements come at a time when there’s been an increasing push to mitigate potentially catastrophic risks of AI through regulation, such as the controversial California AI ...