Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Social and professional topics Intellectual property CCS: Social and professional topics Codes of ethics CCS: Applied computing CCS: Human-centered computing Empirical studies in HCI

Tatiana Chakravorti, Pranav Narayanan Venkit, Sourojit Ghosh, Sarah Rajtmajer · 2026

Read Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Social and professional topics Intellectual property CCS: Social and professional topics Codes of ethics CCS: Applied computing CCS: Human-centered computing Empirical studies in HCI by Tatiana Chakravorti, Pranav Narayanan Venkit, Sourojit Ghosh, Sarah Rajtmajer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20214.txt.

Introduction

Chakravorti and co-authors study how generative AI is entering academic peer review, and how it should be governed. They combine discourse analysis of 448 social media posts with interviews. Fourteen area and program chairs from top AI and HCI conferences took part. Both sources agree on a clear boundary. AI help with clarity or structure in reviews seems acceptable to most. Judging novelty, contribution, and acceptance should stay a human duty. Worries include epistemic harm, over standardization, and unclear responsibility.

Catalog record

CREATORTatiana Chakravorti, Pranav Narayanan Venkit, Sourojit Ghosh, Sarah Rajtmajer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65843
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.20214

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Social and professional topics Intellectual property CCS: Social and professional topics Codes of ethics CCS: Applied computing CCS: Human-centered computing Empirical studies in HCI Tatiana Chakravorti, Pranav Narayanan Venkit, Sourojit Ghosh, Sarah Rajtmajer Abstract . Generative AI (GenAI) tools are increasingly entering academic peer-review workflows, raising questions about fairness, accountability, and the legitimacy of evaluative judgment. While these systems promise efficiency gains amid growing reviewer overload, their use introduces new sociotechnical risks. This paper presents a convergent mixed-method study combining discourse analysis of 448 social media posts with interviews with 14 area chairs and program chairs from leading AI and HCI conferences to examine how GenAI is discussed and experienced in peer review. Across both datasets, we find broad agreement that GenAI may be acceptable for limited supportive tasks, such as improving clarity or structuring feedback, but that core evaluative judgments, assessing novelty, contribution, and acceptance, should remain human responsibilities. At the same time, participants highlight concerns about epistemic harm, over-standardization, unclear responsibility, and adversarial risks such as prompt injection. User interviews reveal how structural strain and institutional policy ambiguity shift interpretive and enforcement burdens onto individual scholars, disproportionately affecting junior authors and reviewers. By triangulating public governance discourse with lived review practices, this work reframes AI-mediated peer review as a sociotechnical governance challenge and offers recommendations for preserving accountability, trust, and meaningful human oversight. Overall, we argue that AI-assisted peer review is best governed not by blanket bans or detection alone, but by explicitly reserving evaluative judgment for humans while instituting enforceable, role-specific controls that preserve accountability. We conclude with role-specific recommendations that formalize the support–judgment boundary. 1. Introduction As generative AI (GenAI) is increasingly entering academic peer-review workflows, there is active discourse and a growing body of research around the opportunities for effective usage to reduce workloads on strained reviewers and increase academic equity ( Biswas et al. 2023 ; Chen et al. 2025 ; Doskaliuk et al. 2025 , e.g.,) , as well as concerns around the impact of GenAI usage on the fairness, accountability, and legitimacy of scholarly evaluation. As debates continue, GenAI usage in peer review is already prevalent; Liang et al. 2024a estimates that between 6.5% and 17% of reviews submitted to prominent NLP conferences during the 2023–2024 cycles contained AI-generated text, even where conference policies explicitly prohibited such use. In this environment, we explore the following research questions: • RQ1 : How do peer-review stakeholders understand and negotiate appropriate use of GenAI in peer review? • RQ2 : What risks and harms do stakeholders observe or anticipate from GenAI? • RQ3 : How do governance practices and institutional factors shape how GenAI is adopted, contested, and regulated in peer review? Our study centers the perspectives of area/program chairs (ACs/PCs) of AI/HCI venues triangulated with public social media discourse, connecting debates about governance and legitimacy with labor conditions and decision-making practices. Our contributions frame AI-mediated peer review as a sociotechnical governance challenge rather than a tool adoption problem, revealing how policy ambiguity functions as a governance strategy. We highlight responsibility/risk redistribution to individual scholars and ways in which GenAI is reshaping peer review as relational and care work. 2. Background 2.1. Peer Review as a Value-Laden Practice Peer reviewing has been a cornerstone of the academic process for centuries, dating back to the editorial practices for medical journals in the 17 th and 18 th centuries, where editors would almost independently assess the quality of submitted research for publication ( Drozdz and Ladomery 2024 ; Palmer 1908 ; Shiflett 1988 ) . The modern model of academic peer review emerged in the 19 th century, as editors began to acknowledge the limits of their own abilities and sought out others with some specialized knowledge required to evaluate a given submission ( Burnham 1990 ; Kronick 1990 ) . The practice of peer reviewing was adopted by scientific journals (including ACM journals such as the Journal for the ACM ) in the mid-20 th century, initially with the editor-only model before transitioning into the external-reviewers approach to account for growth and varying specializations. Peer reviewing research is more than evaluating science to pass muster for some conference/journal. Like much of the scientific process, peer reviewing is not value-neutral; it reflects and reinforces (and sometimes contests) disciplinary values about what and whose knowledges are considered legitimate, rigorous, and worth disseminating, through judgments about quality, novelty, and impact entangled with social norms, institutional incentives, and ethical commitments. Peer reviewing is a performance of power ( Berkenkotter 1995 ; Lipworth and Kerridge 2011 ) in which uncompensated reviewers can gatekeep the publication of knowledge to the scientific community. Authors are afforded little recourse, as resubmissions are more likely to face rejection ( Stelmakh et al. 2021 ) . This can be especially true for a conference with as broad a call for papers as FAccT, which can result in individuals being assigned reviews beyond their expertise ( Laufer et al. 2022 ) . While FAccT and similar conferences try to account for such subjectivity with reviewer guidelines requiring decisions to be strongly motivated and consensual decision-making among anonymous reviewers ( Rastogi et al. 2024 ) , it is still possible that a value alignment between reviewers unfairly affects authors. Although prevalent practice in journals and conferences is double-blind peer review,there is also ample evidence of peer reviewers exhibiting subconscious bias based on reviewers’ perceptions of authors’ identities along the lines of gender ( Borsuk et al. 2009 ; Helmer et al. 2017 ; Pontille and Torny 2014 ; Whittaker 2008 , e.g.,) , nationality and English proficiency ( Marsh et al. 2008 ; Tregenza 2002 , e.g.,) , and prestige and institutional affiliation ( Bornmann et al. 2010 ; Lee et al. 2013 , e.g.,) . Anonymizing authorial (and sponsor/institution) identities during peer review can sometimes create other issues, such as potentially ethically-conflicted research appearing benign ( Young et al. 2022 ) and reviewers consciously or subconsciously trying to identify authors ( Chung et al. 2015 ; Haffar et al. 2019 ; Pontille and Torny 2014 , e.g.,) . 2.2. GenAI in Peer Review: Approaches, Risks, and Concerns Peer reviewing as a practice has been radically impacted by the advent and popularity of GenAI tools, as their ability to generate natural language reviews for papers or respond to specific questions required during peer review means that reviewers can easily offload their tasks to these systems. There exist GenAI tools specifically for peer review, e.g., ReviewWriter ( Su et al. 2023 ) , which guides users through the writing process with intermittent nudges and instructions, without allowing them to upload a document and receive an AI-generated review 1 1 1 For information about other LLM-assisted generative review agents, see Sun 2025 . . This (and similar approaches ( Drori and Te’eni 2024 ; Neshaei et al. 2024 ; Thakkar et al. 2025 , e.g.,) ) attempts to strike a balance in AI-assisted peer review, whereby humans write their own reviews with augmentation and

Read the complete text