Study finds AI peer reviewers fixate on paper appendices over main findings
AI-driven scientific progress threatened by an obsession
A new study titled AI Reviews Are Biased Towards the Appendix found that newer AI models draw roughly 50-70% of their review criticisms from paper appendices, compared with under 30% for GPT-5. Testing 2,000 papers from ACL 2026, EMNLP 2026, COLM 2026 and ICLR 2027 with GPT-6-Astra, GPT-6.1-Sol, Claude-Opus-5.5 and Claude-Sonnet-5.5, the authors report AI reviewers attributed 62% of weaknesses to appendix material versus 8.4% for humans, and the bias persisted across Codex, API and web access. The paper also reports that appendix-related criticism in human peer reviews rose to 27.6% in the latest reviews after years below 11%, and its code is available on GitHub.
Source:Hacker News · AI · unite.ai