When Reviews Disagree: Fine-Grained Contradiction Analysis in Scientific Peer Reviews
Sandeep Kumar † \dagger, Yash Kamdar † \dagger, Abid Hossain † \dagger, Bharti Kumari ‡ \ddagger, Tanik Saikh ‡ \ddagger, Asif Ekbal † \dagger · 2026
Read When Reviews Disagree: Fine-Grained Contradiction Analysis in Scientific Peer Reviews by Sandeep Kumar † \dagger, Yash Kamdar † \dagger, Abid Hossain † \dagger, Bharti Kumari ‡ \ddagger, Tanik Saikh ‡ \ddagger, Asif Ekbal † \dagger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10171.txt.
Description
Kumar and five co-authors study disagreements between scientific peer reviewers at a finer grain than before. Reviews often conflict, and growing submission volumes strain area chairs and editors who must interpret those conflicts. Past work treats disagreement as binary contradiction over isolated sentence pairs, losing review-level context and hiding how severe each judgement clash is.
Their framing works over full reviews, finding contradiction evidence spans and assigning graded intensity scores. RevCI, an expert-labelled benchmark of review pairs, carries evidence-level labels with graded marks. IMPACT, a structured multi-agent framework, combines aspect-conditioned evidence extraction, careful reasoning and ruling to model contradictions and their intensity. Distilled into TIDE, a small model predicting evidence and intensity in one forward pass, the approach beats strong single-agent and generic multi-agent rivals on evidence and intensity agreement. TIDE nearly matches at far lower inference cost.
Catalog record
| CREATOR | Sandeep Kumar † \dagger, Yash Kamdar † \dagger, Abid Hossain † \dagger, Bharti Kumari ‡ \ddagger, Tanik Saikh ‡ \ddagger, Asif Ekbal † \dagger |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10171