California Lawmaker Pushes to Require AI Companies to Release Safety Policies

California State Senator Scott Wiener, a Democrat from San Francisco, during the January 2024 Bloomberg BNEF Summit in San Francisco.

Photographer: David Paul Morris/Bloomberg

A California lawmaker is making another effort to regulate artificial intelligence in the state after legislation that would have held large companies liable for harm caused by their technology was vetoed last year by Governor Gavin Newsom.

State Senator Scott Wiener, a San Francisco Democrat, has introduced a bill that would require companies developing AI models above a certain computing performance threshold to publicly release safety and security protocols that assess the potential catastrophic risks to humanity from the technology. Under the law, AI companies also would need to report any “critical safety incidents,” such as theft of sensitive technical details, to the state attorney general. Companies that may be affected by the proposed legislation include OpenAI, Alphabet Inc.’s Google and Anthropic.