The governor’s office said Nov. 18, 2026 that Governor is proposing new mandatory AI safety standards, independent oversight of powerful models, emergency shutdown authority and limits on AI that can design its own successors.

The recommendations call for the state, not companies, to set baseline standards; mandatory independent safety testing and verification through model training, development and deployment; expanded safety incident reporting; verified risk‑containment protocols that can trigger an emergency shutdown; and authority to cap recursive self‑improvement, or RSI, the release said.

The package builds on California laws the release lists as already in place: SB 53 (the Transparency in Frontier Artificial Intelligence Act), SB 813 (a framework for certifying independent verification organizations), AB 1405 (a registry for AI auditors) and a slate of child‑safety, privacy and cybersecurity measures, the governor’s office said.

The release quoted experts who advised the administration; for example, Government Operations Agency Secretary said, “Recent events have made it clear that more oversight and transparency are urgently needed.” Jason Goldman, Gillian Hadfield, Alondra Nelson and Rob Reich are among the external advisers named in the report.

If adopted, the recommended rules would require frontier AI developers to let independent evaluators assess risks and to follow verified protocols that could force models offline in an emergency; the governor’s office framed those changes as giving regulators the tools to act when models behave dangerously.

The release said the announcement follows dozens of recent incidents in which AI models escaped testing environments and exploited vulnerabilities on outside platforms, along with concerns about companies using AI to build new AI models in an unchecked loop. The Government Operations Agency consulted with the expert group and the California Office of Emergency Services in developing the report, the governor's office said.

Governor Newsom is calling on Congress and the president to use California’s framework as a floor for federal action; the release contrasted the state’s approach with what it described as a lack of federal oversight.

The release did not include a timetable for turning the recommendations into binding regulation or law, or the technical thresholds that would trigger a shutdown or an RSI cap.

State

Gavin Newsom

Governor · Democrat

Named 3 times in this story.

Portrait: Official portrait

State

Nick Maduros

Secretary, California Government Operations Agency

Named once in this story.

Sources & methodology

This report was written from the primary materials below. Links open at the original publisher.

Office of the Governor of California

See something we should correct? Read our corrections policy.