Towards A Sustainable Future for Peer Review in Software Engineering Conference: 2026 IEEE/ACM 48th International Conference on Software Engineering: Future of Software Engineering ; April 12–18, 2026; Rio de Janeiro, Brazil 2026 IEEE/ACM 48th International Conference on Software Engineering: Future
Esteban Parra, Sonia Haiduc, Preetha Chatterjee, Ramtin Ehsani, Polina Iaremchuk · 2026
Read Towards A Sustainable Future for Peer Review in Software Engineering Conference: 2026 IEEE/ACM 48th International Conference on Software Engineering: Future of Software Engineering ; April 12–18, 2026; Rio de Janeiro, Brazil 2026 IEEE/ACM 48th International Conference on Software Engineering: Future by Esteban Parra, Sonia Haiduc, Preetha Chatterjee, Ramtin Ehsani, Polina Iaremchuk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21761.txt.
Introduction
Esteban Parra, Sonia Haiduc, Preetha Chatterjee, Ramtin Ehsani, and Polina Iaremchuk chart a sustainable future for peer review in software engineering. Review is how the field vets its results. Submissions keep growing fast, while the pool of qualified reviewers does not.
The imbalance threatens the long-term growth of the whole research community. The authors examine the strain and look for paths that keep review rigorous without burning out the reviewers. Options touch incentives, tooling, and how venues match papers to expertise. The stakes are field-wide: when review fails, weak work slips through and strong work stalls.
Catalog record
| CREATOR | Esteban Parra, Sonia Haiduc, Preetha Chatterjee, Ramtin Ehsani, Polina Iaremchuk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21761
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards A Sustainable Future for Peer Review in Software Engineering Conference: 2026 IEEE/ACM 48th International Conference on Software Engineering: Future of Software Engineering ; April 12–18, 2026; Rio de Janeiro, Brazil 2026 IEEE/ACM 48th International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE), April 12–18, 2026, Rio de Janeiro, Brazil CCS: Software and its engineering CCS: Social and professional topics Esteban Parra, Sonia Haiduc, Preetha Chatterjee, Ramtin Ehsani, Polina Iaremchuk Abstract . Peer review is the main mechanism by which the software engineering community assesses the quality of scientific results. However, the rapid growth of paper submissions in software engineering venues has outpaced the availability of qualified reviewers, creating a growing imbalance that risks constraining and negatively impacting the long-term growth of the Software Engineering (SE) research community. Our vision of the Future of the SE research landscape involves a more scalable, inclusive, and resilient peer review process that incorporates additional mechanisms for: 1) attracting and training newcomers to serve as high-quality reviewers, 2) incentivizing more community members to serve as peer reviewers, and 3) cautiously integrating AI tools to support a high-quality review process. † † cc-license: by 1. Introduction Peer review is the backbone of trust, legitimacy, and collective knowledge-building in software engineering. Similarly to other disciplines, the decision on whether to accept a paper for a journal or a conference lies with editors and Program Committee (PC) chairs, respectively ( 12 ) . However, due to the volume of submissions and to avoid biases in the decision-making process, editors and chairs make their decision primarily based on the reviews provided by a set of expert reviewers ( 12 ) . Reviewers are trusted individuals invited to provide professional reviews for papers based on their expertise and standing in the research community. Generally speaking, reviewers are assigned a set of papers and have the following core responsibilities for each paper: reading the paper, assessing the paper’s quality and fit for publication in the venue using various criteria (e.g., novelty, soundness, relevance, presentation, etc.), giving a recommendation for acceptance or non-acceptance of the work, and providing clear and constructive feedback to the authors. Despite reviewers’ work being essential for the software engineering research community, reviewing research papers is unpaid, volunteer work performed by members of the community in addition to their multiple tasks as researchers and/or educators ( 18 ) . Submission volumes have grown faster than reviewer availability, leading to high reviewer load, with some members of the community conducting over 20 reviews per year for conferences alone ( 8 ) . Furthermore, reviewing is a time-consuming task; for example, 88% of reviewers spend over 2 hours to read and review a single journal paper ( 8 ) . This can lead reviewers to work on the weekends or late in the evenings ( 8 ) . At the same time, reviewing for the main tracks of larger conferences can be a year-long commitment, limiting reviewer availability for other venues or tracks. Figures 1 and 2 show the changes in the last five years with respect to the size of the program committee and number of submissions to the main tracks of some of the largest software engineering conferences ranked A* and A (i.e., ICSE, FSE, ASE, ICSME, MSR, and SANER). Figure 1. PC Size Over Time Figure 2. Submissions Over Time Figure 2 is the number of main track submissions that underwent peer review (i.e., without desk rejections). The figure shows that in the last two years, the number of submissions has increased significantly. To account for this increase in submissions, the largest conferences have also increased their PC size. However, even with the increased PC size, the reviewer workload has often increased given that each paper is usually assigned at least three reviewers. For example, for ASE, the size of the main track PC has more than doubled between 2020 and 2025 (from 148 to 326 PC members), while the number of main track submissions has nearly tripled (408 in 2020 vs 1136 in 2025), leading to a workload increase from 8.27 to 10.45 papers per PC member on average. Furthermore, many of the community members serve on the PC of multiple conferences or on the PCs of multiple tracks of the same conference, leading to an overall increasing review load. As it stands, the discrepancy between the growth in submissions and the availability of reviewers is not sustainable and risks harming the quality of the reviewing process and the potential for growth of the SE community. We envision a future of SE research in which quality peer review is made sustainable by expanding the pool of high-quality reviewers through scalable training, retaining, and incentivizing both established community members and newcomers to serve as peer reviewers. 2. What Is Working The feedback provided by reviewers on the quality of papers is incredibly valuable, as it allows authors to expand and strengthen their work before it is published. Even in cases of non-acceptance, the feedback provides actionable steps from experienced researchers on potential critical issues that, when addressed, should improve the paper for future submissions. Furthermore, the variety of tracks with different review criteria, such as the Reproducibility Studies and Negative Results at SANER 1 1 1 https://conf.researchr.org/track/saner-2026/saner-2026-reproducibility-studies-and-negative-results-rene-track and ICSME 2 2 2 https://conf.researchr.org/track/icsme-2026/icsme-2026-replication-and-negative-results , increases venue accessibility to a wider range of work and is a valuable tool for growing the community. 2.1. Distinguished Reviewer Awards Peer review is viewed by members of the community as a shared form of quality control. Although the reasons for accepting to be a reviewer vary, many reviewers accept this role from a sense of professional duty. The main mechanism used by most software engineering research conferences to recognize the reviewers’ labor is through the Distinguished Reviewer Award. This award is presented to a subset of reviewers who have made the greatest contributions to the review process ( 18 ) . This type of award represents a valuable recognition of a researcher’s efforts in the scientific community and an addition to the CV that could support their career goals ( 18 ) . Therefore, it can serve as an incentive to participate in the reviewing process. However, given that very few reviewers get this recognition, it should ideally be complemented by other types of incentives for recruiting reviewers. 2.2. Junior/Shadow PC The 18th edition of the IEEE/ACM International Conference on Mining Software Repositories (MSR’21) established the Shadow PC mentorship program, later renamed Junior PC, as a mechanism to provide opportunities for early-career researchers, namely PhD students, post-docs, new faculty members, and industry practitioners, to learn about and get involved in the academic peer review process, aiming to increase the pool of qualified reviewers ( 17 ) . The members of the Shadow/Junior PC are integrated in the peer review process with the members of the main technical track PC using a 2-1 model, where each paper is reviewed by 2 members of the regular PC and 1 member of the Junior PC. This way, Junior PC members have the opportunity to observe and learn from the reviews of more seasoned members of the community and can also receive feedback on their own reviews. The Junior PC mentorship program continues