California’s Landmark AI Safety Bill Advances, Sparking Debate in Tech Industry

California’s legislative bodies have taken a significant step towards regulating artificial intelligence (AI) by passing Senate Bill 1047 (SB 1047), also known as the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act. The bill, which passed the State Assembly, now awaits final approval from Governor Gavin Newsom, who has until September 30 to sign it into law or veto it.

SB 1047, authored by Democratic State Senator Scott Wiener of San Francisco, aims to implement stringent safety measures for AI development in California. The bill mandates safety testing for advanced AI models that cost over $100 million to develop or require substantial computing power. It also requires developers to outline methods for shutting down AI models if they become unmanageable and allows the state attorney general to sue companies for non-compliance, particularly in cases of ongoing threats such as potential AI takeover of critical infrastructure.

The legislation has sparked intense debate within the tech industry and political circles. Supporters, including Tesla CEO Elon Musk, argue that the bill is necessary to mitigate potential catastrophic risks associated with AI. Musk stated on his social media platform X that regulating AI is crucial, as it poses potential risks to the public.

However, the bill faces significant opposition from major tech companies and some politicians. Critics, including OpenAI, Anthropic, and former House Speaker Nancy Pelosi, contend that the legislation could stifle innovation and drive AI companies out of California. They argue that the bill is overly focused on catastrophic harms and may disproportionately affect smaller, open-source AI developers.

In response to these concerns, the bill has undergone several amendments. These changes include replacing potential criminal penalties with civil ones, narrowing the enforcement powers granted to California’s attorney general, and adjusting requirements for joining a “Board of Frontier Models” created by the bill.

The passage of SB 1047 in California could have far-reaching implications for the AI industry and potentially set a precedent for AI regulation across the United States. As the bill moves to Governor Newsom’s desk, the tech industry and policymakers alike are closely watching the outcome, which could shape the future of AI development and regulation in the country’s tech hub.