Anthropic's Self-Replicating AI Warning Sparks Debate Over Fear-Mongering vs. Real Threat
Anthropic, an AI safety company, has issued a warning about the potential for self-replicating AI worms to colonize internet-connected consumer devices. The company published a report titled 'AI models may be capable of self-replicating without access to a datacenter,' suggesting that small AI models could autonomously replicate across devices like smart fridges and TVs, creating a decentralized botnet. To demonstrate feasibility, Anthropic researchers split Google's Gemma 4 model across 15 Android TV boxes, achieving a slow processing speed of 0.39 tokens per second. They also simulated a network where a large, externally hosted model orchestrated a smaller model's replication across emulated nodes with deliberately exposed debugging interfaces. However, critics, including Ciaran Martin, former head of Britain’s National Cyber Security Centre, argue that the findings show 'vendor exaggeration' and do not constitute a security crisis, pointing out the physical limitations of running large AI models on cons...
