Are Coding Agents Generating Over-Mocked Tests? An Empirical Study Conference: 23rd International Conference on Mining Software Repositories; April 13–14, 2026; Rio de Janeiro, Brazil 23rd International Conference on Mining Software Repositories (MSR ’26), April 13–14, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3793302.3793362 ISBN: 979-8-4007-2474-9/2026/04 CCS: Software and its engineering Software testing and debugging

Andre Hora, Romain Robbes · 2026

Read Are Coding Agents Generating Over-Mocked Tests? An Empirical Study Conference: 23rd International Conference on Mining Software Repositories; April 13–14, 2026; Rio de Janeiro, Brazil 23rd International Conference on Mining Software Repositories (MSR ’26), April 13–14, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3793302.3793362 ISBN: 979-8-4007-2474-9/2026/04 CCS: Software and its engineering Software testing and debugging by Andre Hora, Romain Robbes (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00409.txt.

Description

Andre Hora and Romain Robbes ask whether coding agents generate over mocked tests. Coding agents have gained significant adoption in software development, working with autonomy, invoking external tools, and leaving visible traces such as authoring commits. In their task mix, coding agents may autonomously generate software tests, yet test quality remains uncertain, and heavy mocking can make tests harder to grasp and maintain. This is the first study of mocks inside agent generated tests of real world software.

Catalog record

CREATORAndre Hora, Romain Robbes
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56340
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00409

Browse the full library · About the Tower of Babel