Harvard paper: Claude's peer reviews beat paid human experts
Why it matters
Gary King and Steven Worthington (Harvard IQSS) had Claude Opus 4.8, at its maximum reasoning setting, review the same 124 papers that paid expert reviewers had reviewed through rapidPeer, a double-blind pre-submission review service built at Harvard; 88% of 74 surveyed authors rated those human reviews high or very high quality. A GPT-5.5 judge preferred the AI review in all 132 decided pairs, and three former editors of leading journals, unaware one review was AI, chose it in 26 of 30 judgments (87%). The AI reviews cited no fabricated sources, and 5.5% of their claims were judged incorrect vs 15.9% for the human reviews; on 44 length-matched pairs AI was preferred in all 44. Caveats: the study measures advice to help authors improve papers, not how editors should make publication decisions, the editor test covered 10 pairs, and the authors warn AI could make science more homogeneous and ordinary.
Read the source: Harvard (Gary King, IQSS) (opens in a new tab)
All hits from 24 Oct 2026More ResearchGet the daily hits by email