Helen Toner Discusses AI Safety, Regulation, and OpenAI's Commercial Shift
Helen Toner, Executive Director of the Center for Security and Emerging Technology at Georgetown University, recently discussed the evolving landscape of AI safety and regulation. Toner, a former OpenAI board member, highlighted the shift in AI companies like OpenAI and Anthropic from pure research labs to more commercial entities. She noted that the initial non-profit structure of OpenAI was intended to prioritize safety over profit, a mechanism she believes failed during the incident involving Sam Altman's temporary departure and return. Toner emphasized that while AI models are becoming increasingly capable, there's a significant gap in public understanding and regulatory frameworks. She pointed out that AI models have demonstrated abilities to 'hack' real companies, raising concerns about misuse and misalignment. The conversation also touched upon the concept of 'recursive self-improvement' (RSI) and the pursuit of 'superintelligence' by leading AI companies, which she believes is taken for granted in ...