Peerispect : Claim Verification in Scientific Peer Reviews Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3808368 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Information extraction

Ali Ghorbanpour, Soroush Sadeghian, Alireza Daghighfarsoodeh, Sajad Ebrahimi, Negar Arabzadeh, Seyed Mohammad Hosseini, Ebrahim Bagheri · 2026

Read Peerispect : Claim Verification in Scientific Peer Reviews Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3808368 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Information extraction by Ali Ghorbanpour, Soroush Sadeghian, Alireza Daghighfarsoodeh, Sajad Ebrahimi, Negar Arabzadeh, Seyed Mohammad Hosseini, Ebrahim Bagheri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17667.txt.

Introduction

Ghorbanpour and six colleagues present Peerispect, a hands-on system for claim-level checking in research peer reviews. Reviewers often include claims that are opinion-based, showy, or off-target for the sent-in work, and manual grounding checks cannot scale to modern meetings and journals. Peerispect extracts check-worthy claims from reviews, pulls proof from the paper, and checks claims through natural language logic. Results appear in a visual display flagging proof in the paper, built as a modular search setup for reviewers, authors, and program panels.

Catalog record

CREATORAli Ghorbanpour, Soroush Sadeghian, Alireza Daghighfarsoodeh, Sajad Ebrahimi, Negar Arabzadeh, Seyed Mohammad Hosseini, Ebrahim Bagheri
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23138
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17667

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Peerispect : Claim Verification in Scientific Peer Reviews Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3808368 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Information extraction Ali Ghorbanpour, Soroush Sadeghian, Alireza Daghighfarsoodeh, Sajad Ebrahimi, Negar Arabzadeh, Seyed Mohammad Hosseini, Ebrahim Bagheri Abstract . Peer review is central to scientific publishing, yet reviewers frequently include claims that are subjective, rhetorical, or misaligned with the submitted work. Assessing whether review statements are factual and verifiable is crucial for fairness and accountability. At the scale of modern conferences and journals, manually inspecting the grounding of such claims is infeasible. We present Peerispect , an interactive system that operationalizes claim-level verification in peer reviews by extracting check-worthy claims from peer reviews, retrieving relevant evidence from the manuscript, and verifying the claims through natural language inference. Results are presented through a visual interface that highlights evidence directly in the paper, enabling rapid inspection and interpretation. Peerispect is designed as a modular Information Retrieval (IR) pipeline, supporting alternative retrievers, rerankers, and verifiers, and is intended for use by reviewers, authors, and program committees. We demonstrate Peerispect through a live, publicly available demo 1 1 1 https://app.reviewer.ly/app/peerispect and API services 2 2 2 https://github.com/Reviewerly-Inc/Peerispect , accompanied by a video tutorial 3 3 3 https://www.youtube.com/watch?v=pc9RkvkUh14 . † † cc-license: by-nc-nd 1. Introduction Peer review remains the cornerstone of scholarly publishing, ensuring that only research meeting standards of novelty, rigor, and clarity enters the scientific record. Despite its importance, peer review is far from flawless ( 20 ; 21 ; 8 ; 1 ) . Reviewers frequently include claims that go beyond objective evaluation, sometimes misinterpreting the content of the submission, overstating limitations, or questioning results in ways not fully supported by the manuscript itself ( 14 ; 5 ) . Such issues can compromise the fairness of reviews, mislead editors and program committees, and ultimately slow down the progress of scientific research ( 11 ) . While prior work on factuality assessment and claim verification has largely focused on pipelines for general fact-checking or scientific fact verification ( 22 ; 19 ; 24 ) , there has been little effort to address the unique setting of verifying reviewer statements against a manuscript. A substantial body of work has documented limitations of the peer review process, including bias, inconsistency, and noise ( 20 ; 21 ; 8 ; 14 ; 5 ; 10 ; 3 ) . Reviewers may misinterpret experimental settings, overlook details, or overstate shortcomings, leading to claims that are not fully grounded in the paper itself ( 23 ; 6 ; 2 ) . These issues are particularly consequential because review statements directly influence editorial decisions, acceptance outcomes, and author revisions. Yet, prior works on peer-review analysis have largely focused on systemic properties of the review process and high-level assessments of review quality. Studies such as 14 analyze sources of bias, including reviewer identity and institutional affiliation, while 21 provide a broad examination of transparency and fairness. Even recent benchmarks like RottenReviews ( 9 ) or models for review constructiveness ( 18 ) primarily operate at the document or discourse level. They assess overall tone or utility but do not perform the grounded, claim-level verification necessary to identify the specific inconsistencies described above. Addressing this verification gap presents a unique technical challenge. While the information retrieval community has developed mature techniques for factuality assessment, claim verification, and evidence retrieval, most prior work has focused on open domain fact checking or scientific claim verification against large external corpora ( 22 ; 19 ; 24 ) . In contrast, verifying reviewer claims requires grounding statements against a single submitted document, giving way to a distinct and underexplored retrieval problem. Figure 1 . Peerispect architecture and processing pipeline. The system consists of four stages: data acquisition, claim extraction, evidence retrieval, and claim verification. The need for scalable support has intensified as the volume of scientific submissions continues to grow ( 15 ; 4 ) . Major conferences now receive tens of thousands of papers per cycle. For example, AAAI received approximately 12,000 submissions in 2025, which increased to roughly 23,000 submissions in 2026 ( 12 ) . As submission volumes increase, so does the volume of review text, making it infeasible for program committees and editors to manually inspect whether review claims are well grounded. From an information retrieval perspective, this setting naturally raises the question of whether reviewer claims can be treated as information seeking queries over the submitted paper, and whether retrieval and inference techniques can be used to assess their grounding automatically. In this work, we introduce Peerispect , an interactive system that operationalizes claim level verification in peer reviews by framing reviewer statements as queries over the manuscript. The system extracts check worthy claims from reviews, retrieves the most relevant passages from the paper, and verifies alignment via natural language inference. The output indicates whether a claim is supported, partially supported, contradicted, or undetermined, and presents these judgments through a visual interface that highlights evidence directly in the manuscript. The system supports multiple stakeholders in the peer review process. Reviewers can inspect whether their factual statements are grounded in the manuscript. Authors can identify which review claims are supported or contradicted when preparing rebuttals or revisions. Program committees and editors can use the system as a discretionary aid to maintain review quality at scale. By making claim evidence alignments explicit, Peerispect increases transparency while preserving human judgment as the final authority. Beyond live demonstration, we empirically validate the underlying pipeline using two complementary datasets that reflect both controlled and real world conditions. The Controlled Manuscript Claims (CMC) benchmark consists of 500 paper derived claims extracted from 50 ICLR 2024 manuscripts, representing an upper bound scenario in which all claims are supported by construction. The Real World Review Claims (RRC) comprises 150 manually annotated reviewer claims from 25 papers. comprising 150 manually annotated reviewer claims from 25 papers. These complementary datasets allow us to rigorously assess evidence retrieval and verification accuracy, ensuring the demo reflects a tested, reliable system rather than a purely illustrative prototype. Our Peerispect tool demonstrates how retrieval, ranking, and inference techniques can be integrated to support accountability and transparency in peer review workflows. By treating review verification as a document grounded information retrieval problem and providing an interactive and extensible system, this work positions peer review analysis as a practical and impactful application area for the IR research community. 2. Tool Description Figure 2 . Screenshot of the Peerispect interface. Peerispect is an interactive system that operationalizes claim level verification in peer reviews through a modular information retrieval pipeline. The system processes a manuscript together with its associated reviews and produces structured annotations that characterize the grounding of individual review claims with respect to the paper. The design emphasizes modularity and extensibility, allowing alternative retrieval, ranking, and verification components to be integrated without altering the overall workflow. Figure 1 presents an overview of the pipeline, while Figure 2 illustrates the user facing interface. The pipeline consists

Read the complete text