California legislature passes sweeping AI safety bill

“The bill, which has been a flashpoint for debate in Silicon Valley and beyond, would obligate AI companies operating in California to implement a number of precautions before they train a sophisticated foundation model. Those include making it possible to quickly and fully shut the model down, ensuring the model is protected against ‘unsafe post-training modifications,’ and maintaining a testing procedure to evaluate whether a model or its derivatives is especially at risk of ‘causing or enabling a critical harm.’”