New Study Reveals AI Models' Disproportionate Focus on Scientific Paper Appendices, Raising Concerns for Research Review
A new U.S. study indicates that advanced AI models, such as OpenAI’s GPT-6.1-Sol and GPT-6-Astra, are exhibiting a significant bias towards the appendices of scientific papers during review, often prioritizing minor details over the main findings. Researchers found that newer AI models derive 50-70% of their criticisms from appendices, a substantial increase compared to less than 30% for older models like GPT-5. This trend suggests that AI's 'egalitarian approach' to text, treating all sections as equally important, leads them to focus on appendices where errors or less curated information are more prevalent. The study, which analyzed 2,000 papers from four major AI and natural language processing conferences, highlights that human reviewers typically attribute less than 10% of weaknesses to appendices, underscoring a critical divergence in review methodology between AI and human experts. This unexpected focus could lead to lengthy reviews of limited practical value, as the AI may miss the core contributio...