When Reviews Disagree: Fine-Grained Contradiction Analysis in Scientific Peer Reviews

Sandeep Kumar † \dagger, Yash Kamdar † \dagger, Abid Hossain † \dagger, Bharti Kumari ‡ \ddagger, Tanik Saikh ‡ \ddagger, Asif Ekbal † \dagger · 2026

Read When Reviews Disagree: Fine-Grained Contradiction Analysis in Scientific Peer Reviews by Sandeep Kumar † \dagger, Yash Kamdar † \dagger, Abid Hossain † \dagger, Bharti Kumari ‡ \ddagger, Tanik Saikh ‡ \ddagger, Asif Ekbal † \dagger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10171.txt.

Description

Kumar and five co-authors study disagreements between scientific peer reviewers at a finer grain than before. Reviews often conflict, and growing submission volumes strain area chairs and editors who must interpret those conflicts. Past work treats disagreement as binary contradiction over isolated sentence pairs, losing review-level context and hiding how severe each judgement clash is.

Their framing works over full reviews, finding contradiction evidence spans and assigning graded intensity scores. RevCI, an expert-labelled benchmark of review pairs, carries evidence-level labels with graded marks. IMPACT, a structured multi-agent framework, combines aspect-conditioned evidence extraction, careful reasoning and ruling to model contradictions and their intensity. Distilled into TIDE, a small model predicting evidence and intensity in one forward pass, the approach beats strong single-agent and generic multi-agent rivals on evidence and intensity agreement. TIDE nearly matches at far lower inference cost.

Catalog record

CREATORSandeep Kumar † \dagger, Yash Kamdar † \dagger, Abid Hossain † \dagger, Bharti Kumari ‡ \ddagger, Tanik Saikh ‡ \ddagger, Asif Ekbal † \dagger
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10171

Browse the full library · About the Tower of Babel