AI Safety Experts Warn of Existential Risks, Urge Precaution by 2027
AI safety experts are issuing stark warnings about the potential for advanced Artificial Intelligence models to pose an existential threat to humanity within the next few years. According to one source, some pessimists suggest a 10-50% chance that humanity could be wiped out as a species by 2029. These concerns stem from the anticipated achievement of 'full' recursive self-improvement (RSI) by frontier AI models, such as those developed by Anthropic and OpenAI, which could enable AI to build more sophisticated versions of itself without human oversight. The San Francisco Bay Area is currently experiencing an 'AI fever-dream,' with advertisements promoting AI for various applications, from business optimization to curing diseases. The U.S. is noted as leading the world in AI development, several months ahead of China, but also characterized by a 'wild west' approach to regulation. Karl Berzins, an Australian engineer and co-founder of the SF-based non-profit FAR.AI, is among those sounding the alarm, advoca...