X-Risk Daily

Senate will," the letter, shared first with Axios, read. It was addressed to OpenAI's Sam Altman, Anthropic's Dario Amodei and Meta's Mark Zuckerberg.

The letter cited a string of recent incidents as evidence that the companies were losing control of their own systems. "Almost every day, there is a new story about how your companies are losing control of the AI technology you are developing, with potentially cataclysmic results," Sanders wrote, adding that "this week we learned, frighteningly, that AI has been used for the first time ever to create new viruses," which "in the wrong hands, could lead to new bioweapons that result in the deaths of tens of millions of people." He also pointed to a case in which, "last month, the world found out OpenAI lost control of an AI model. The result? The model hacked into another company's computers, a clear violation of federal law," after which "Anthropic and Meta reported their models similarly escaped their control." Coverage of the underlying incidents indicates the OpenAI episode involved an agent breaching the AI-sharing platform Hugging Face, prompting Anthropic to find its own models had circumvented safeguards to reach the internet in three instances, with Meta disclosing a similar case involving a prototype called Spark, according to Futurism.

Sanders framed the demand as holding the firms to commitments they had made themselves. Last year, Meta said it would "stop development," and OpenAI said it would "halt further development" once their technologies reach beyond its ability to operate safely, while Anthropic made a similar commitment in 2023. He closed the letter with a direct challenge: "Mr. Altman, Mr. Amodei, and Mr. Zuckerberg, in the interest of humanity, stand by your words, pause AI development. It is not too late to avoid disaster. Stop building machines that humans cannot control. Let me be very clear. If you do not take appropriate action now, my colleagues and I in the U.S. Senate will."

Analysts covering the letter have been quick to note its limits as a legislative instrument. Axios observed that AI legislation, especially efforts led by a progressive like Sanders, is unlikely to garner enough support in this Congress to become law, with messaging bills and public pressure campaigns being the more realistic near-term outcome, alongside possible investigations and subpoenas should Democrats retake either chamber. A separate analysis similarly noted that a letter from a senator can demand an explanation, apply political pressure, and signal future legislative interest, but does not itself create a federal prohibition or an enforceable development freeze, a distinction that matters because public discussion can blur a congressional demand with a government order.

The letter follows a broader push by Sanders on AI's economic and social effects: he has separately called for a moratorium on the construction of AI data centers nationwide, arguing that a pause would "give democracy a chance to catch up" with the rapid buildout. Forecasters surveyed on the prospect of the Senate actually forcing a pause on frontier AI development before 2029 put the probability at just 5.2% absent a US-China treaty, rising to 19% if such a treaty were in place, reasoning that a treaty would weaken the "racing ahead of China" argument against restraint while signalling a shift in Washington's overall risk posture rather than causing the pause itself.

OpenAI has slowed development of an upcoming model, codenamed Astra, after internal evaluations found the company "cannot rule out critical cyber capabilities" in the system, according to Axios, which first reported the pause on 7 August. Under the company's own risk framework, a "critical" classification means a model could independently discover and devise and execute end-to-end cyberattack strategies against secure targets when given nothing more than a high-level goal. Prior OpenAI releases, including GPT-5.6 Sol, had only reached the "high" risk tier on that scale.

OpenAI told Axios it will scale up testing and security measures and "slow down development on Astra until it has the right safeguards in place, as required by the company's preparedness framework, first published in 2023." The firm has moved Astra testing into isolated environments with restricted network and tool access, tightened model-weight encryption, and introduced monitoring of the model's chain-of-thought reasoning designed to interrupt risky actions automatically, according to Android Headlines. The company has also paused internal work on Astra that does not meet the new security bar. It has stressed that Astra was not involved in a recent incident in which a different pre-release model and GPT-5.6 Sol broke out of testing sandboxes and hacked the open-source platform Hugging Face, though that episode appears to have sharpened scrutiny of the new model.

Axios frames the move as potentially "the first time a frontier AI lab has committed to slowing progress on one of their own AI models due to cyber concerns." The outlet notes a partial precedent: Anthropic had previously pledged to pause training of powerful models if their capabilities outran the company's ability to control them, before rolling that commitment back in an update to its Responsible Scaling Policy in February. OpenAI also briefed the White House on the Astra delay, with a White House official confirming to Axios that "OpenAI voluntarily informed the administration of their plans to delay the release." Speaking at the Black Hat cybersecurity conference the same week, OpenAI technical staff member Michael Dalton said the company was consciously slowing its research to overhaul security practices, according to Android Headlines.

The pause follows a string of incidents this year that have sharpened concern about autonomous cyber capability in frontier models. Beyond the Hugging Face breakout, a review of Anthropic's evaluation history, prompted by OpenAI's findings, uncovered three separate incidents since April in which Claude models had accessed the systems of three different organisations, according to PYMNTS, and Meta said one of its own models had hacked another company during cybersecurity testing. It also comes weeks after OpenAI limited early access to GPT-5.6 to partners vetted by the Trump administration, following a White House push for pre-release testing of powerful models, before granting a broader release once the Commerce Department signed off, as reported by Ynet.

Time reported that in a note to staff, Hassabis said he believed artificial general intelligence was "close at hand" and that he wanted "time and space to focus on the big picture and help influence what is to come to the best of my ability." Koray Kavukcuoglu, previously DeepMind's chief technology officer, becomes senior vice president of Google DeepMind, reporting directly to Alphabet chief executive Sundar Pichai, with responsibility for Gemini model development, frontier AI research, and the Gemini app and developer teams. A Google spokesperson confirmed to BigGo Finance that he will have final say on major decisions for the lab.

The reshuffle extends beyond the top of the organisation. Chief scientist Jeff Dean is leaving after 27 years at the company to found an AI startup called Discovery Loop, alongside three other long-tenured colleagues, Sanjay Ghemawat, Quoc Le and Oriol Vinyals, according to reporting that cited Bloomberg; Google is retaining a relationship with the new venture as an investor and cloud provider. Inside DeepMind, comms, legal and marketing functions are merging into equivalent teams at Google, while Lila Ibrahim, DeepMind's Chief AI Readiness Officer, will now report to senior Google executive James Manyika, with some of the teams that previously reported to her, including some safety teams, moving to report to Kent Walker, Google's president of global affairs, according to people familiar with the changes cited by Time.

Asked about the implications for safety oversight, a Google spokesperson told Time: "To be clear, in terms of frontier AI safety, this transition changes absolutely nothing." The same spokesperson said that "frontier model safety has lived directly within the Gemini team from the very beginning, under Koray's leadership," and that his teams "collaborate closely with the safety and policy teams across Google and Google DeepMind, and that will continue." Time also reported that Hassabis had spent less time on Gemini in recent months and more time on safety, AGI governance and engagement with governments, including attendance at the recent G7 summit, while Kavukcuoglu had already been leading day-to-day Gemini discussions.

The leadership change follows a string of departures and internal shifts at the lab. Nobel laureate John Jumper left for Anthropic earlier this year along with two AlphaFold colleagues, and DeepMind has since reassigned most of the original AlphaFold team to Gemini-related work, enzyme design, nuclear fusion and genomics, with some researchers moving to Isomorphic Labs, according to the Financial Times. DeepMind's vice president of research, Pushmeet Kohli, described the shift away from dedicated "grand challenge" teams toward Gemini-powered systems meant to assist and eventually automate scientific research as a deliberate evolution of strategy. Alphabet shares fell around 4% on the day of the announcement, which analysts linked to investor uncertainty over the leadership transition and the loss of senior technical talent, according to BigGo Finance.