Former AI Lab Researchers Warn NYC Council of Potential Loss of Human Control Over AI, Council Considers Regulation
During a New York City Council hearing, three former AI lab researchers, Jacob Coxon (formerly of OpenAI and Anthropic), Daniel Kokotajlo (formerly of OpenAI), and Alex Turner (formerly of Google DeepMind), warned that humanity risks losing control of advanced AI systems, potentially leading to human extinction. Coxon stated it's 'more likely than not that humanity loses control to these AIs.' The hearing, chaired by Speaker Julie Menin, also included policy staff from OpenAI, Anthropic, Google, and Meta, who appeared after being warned of subpoenas. The council is considering 10 bills to regulate AI in the city, including one that would require third-party validation and a human shutdown mechanism for any AI model marketed, sold, or deployed in NYC, with a $25,000 civil penalty for non-compliance. Other proposed bills address reporting AI violations, allowing New Yorkers to sue AI providers for foreseeable harm, and mandating incident reporting for city contractors using AI.