Test Behaviors, Not Methods! Detecting Tests Obsessed by Methods Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3794791 ISBN: 979-8-4007-2482-4/2026/04 CCS: Software and its engineering Software testing and debugging

Andre Hora, Andy Zaidman · 2026

Read Test Behaviors, Not Methods! Detecting Tests Obsessed by Methods Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3794791 ISBN: 979-8-4007-2482-4/2026/04 CCS: Software and its engineering Software testing and debugging by Andre Hora, Andy Zaidman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00761.txt.

Description

Andre Hora and colleagues argue tests should check one behaviour each, and propose a new smell for tests that check too much. The older Eager Test smell counts production method calls, but research suggests call counts poorly proxy functionality. The authors hypothesise that multi-behaviour tests tend to cover several paths of one production method. They name this Test Obsessed by Method: a test method covering multiple paths of a single production method. In 2,054 tests from 12 Python Standard Library suites, they detect 44 such tests across 11 suites.

Catalog record

CREATORAndre Hora, Andy Zaidman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20929
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00761

Browse the full library · About the Tower of Babel