The invoice, SB 1047, was launched seven months in the past by Sen. Scott Weiner and handed the state meeting on Wednesday.
It is now on Gov. Gavin Newsom’s desk, and he has till September 30 to determine whether or not to signal it into legislation or veto it. He has not publicly signaled his place.
The invoice goals to drive security measure improvement at firms that spend $100 million or extra coaching AI fashions so their tech can’t be used to hurt society, similar to creating harmful weapons or endeavor cyberattacks.
The measures embody forcing firms working in California to report any security incidents to the federal government, defending whistleblowers, and permitting third events to check their fashions for security. If obligatory, they’d additionally push firms to enact a full shutdown.
Choosing groups
The invoice has drawn a line by way of Silicon Valley, and a few of tech’s largest figures have taken sides.
Jason Kwon, OpenAI’s chief technique officer, warned in a letter to Sen. Wiener on Wednesday that the invoice might stifle progress and drive firms out of California.
The ChatGPT maker joined heavyweight Meta in its lobbying towards the invoice. Meta stated that the invoice might discourage the open-source motion by exposing builders to vital authorized liabilities.
Former OpenAI workers stated that the corporate’s opposition to the invoice was disappointing — however in keeping with its current path.
“We joined OpenAI as a result of we wished to make sure the security of the extremely highly effective AI techniques the corporate is growing,” former OpenAI researchers, William Saunders and Daniel Kokotajlo, wrote within the letter. “However we resigned from OpenAI as a result of we misplaced belief that it could safely, actually, and responsibly develop its AI techniques.”
Elon Musk additionally supported the invoice.
In a social media publish on Monday, Musk, who based AI firm xAI final 12 months and has a long-standing rivalry with OpenAI’s Altman, stated that though it was “a tricky name and can make some individuals upset,” he thinks “California ought to most likely cross the SB 1047 AI security invoice.”
“For over 20 years, I’ve been an advocate for AI regulation, simply as we regulate any product/know-how that could be a potential threat to the general public,” Musk wrote on X.
Amazon-backed Anthropic appeared to have switched sides in the course of the talk, after the invoice was modified.
In a letter despatched to California Gov. Gavin Newsom final week, Anthropic’s CEO, Dario Amodei, stated the invoice’s “advantages seemingly outweigh the prices.” Nonetheless, he added that “we’re not sure of this, and there are nonetheless some features of the invoice which appear regarding or ambiguous to us.”
Amodei stated the invoice now “seems to us to be midway between our prompt model and the unique invoice.”
