AI Researchers Express Significant Anxiety Over Self-Improving Systems and Catastrophic Risks
A recent Cybernews survey of 103 AI researchers reveals substantial concern regarding the rapid development of artificial intelligence, particularly self-improving systems. The survey, conducted between October 1 and 9, 2026, found that 30.4% of researchers consider it 'very plausible' and 33.3% 'somewhat plausible' that a self-improving AI could pose a major risk to humanity within the next five years. A significant portion, 43.1%, estimated at least a 10% chance of AI causing a catastrophic event this century. These concerns extend beyond job displacement, focusing on the potential for AI to advance faster than human institutions can control, especially through recursive self-improvement. Nearly 40% of those surveyed believe frontier AI development should be slowed, with an additional 15.7% advocating for it to be stopped entirely. The survey also highlighted that 37.9% of respondents identified human misuse of AI, such as cyberattacks, disinformation, and biological weapons, as the greatest source of AI...