California advances landmark legislation to regulate large AI models

Groundbreaking bill aims to reduce potential AI risks – requiring model testing and disclosure of safety protocol

A California bill that would establish first-in-the-nation safety measures for the largest artificial intelligence systems cleared an important vote Wednesday. The proposal, aiming to reduce potential risks created by AI, would require companies to test their models and publicly disclose their safety protocols to prevent the models from being manipulated to, for example, wipe out the state’s electric grid or help build chemical weapons – scenarios experts say could be possible in the future with such rapid advancements in the industry.

The measure squeaked by in the state assembly Wednesday and now faces a final vote in the state senate, where it has passed once already, before it heads to the governor’s desk for his signature, though he has not indicated his position on it. Governor Gavin Newsom then has until the end of September to decide whether to sign it into law, veto it or allow it to become law without his signature. He declined to weigh in on the measure earlier this summer but had warned against AI overregulation.