iCreatAI News
Skip to content
Hacker News AI· 50kIters·· 1 hr agoAI score58

AI-driven scientific progress threatened by an obsession

AI-driven scientific progress threatened by an obsession

AI summary

A new US study finds that newer AI models reviewing scientific papers draw roughly 50–70% of their criticisms from appendices, compared with under 30% for GPT-5, and that this appendix bias appears to be spreading into human peer review, where appendix-related criticism rose to 27.6% in the latest reviews. Testing 2,000 papers from ACL 2026, EMNLP 2026, COLM 2026 and ICLR 2027, the authors found the bias persisted across API, Codex and web-interface access, with AI reviewers more than seven times as likely as humans to flag appendix weaknesses. The paper, titled "AI Reviews Are Biased Towards the Appendix," warns that attention to minor details can come at the expense of a paper's main findings.

Source: Hacker News AI · unite.ai