What's Happening?
Dario Amodei, CEO of Anthropic, has published an essay asserting that AI growth is exponential, citing scaling laws that predict significant increases in cognitive capabilities with more computing power. However, this claim is contradicted by Anthropic's
own research, which suggests that the gains in AI intelligence are primarily due to human research rather than AI advancements. The essay references a 2020 paper co-authored by Jared Kaplan, which has been criticized by AI researcher Gary Marcus for its conclusions on AI scaling. Marcus argues that the scaling limits in deep learning are becoming apparent, as evidenced by the performance of models like OpenAI's GPT-3.
Why It's Important?
The debate over AI's growth trajectory has significant implications for the industry, particularly as companies like Anthropic and OpenAI prepare for public listings. If AI growth is not as rapid as some claim, it could affect investor confidence and the valuation of AI companies. Additionally, the reliance on human research for AI advancements highlights the need for continued investment in human capital and research capabilities. This situation underscores the importance of transparency and accuracy in reporting AI capabilities, as exaggerated claims could lead to misguided investments and policy decisions.
