On the Surprising Efficacy of LLMs for Penetration-Testing DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Security and privacy Systems security CCS: Security an

Andreas Happe, Jürgen Cito · 2025

Read On the Surprising Efficacy of LLMs for Penetration-Testing DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Security and privacy Systems security CCS: Security an by Andreas Happe, Jürgen Cito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00829.txt.

Description

Andreas Happe and Jürgen Cito review why large language models turn out to be surprisingly good at penetration testing, in this 2025 paper. Penetration testing means attacking systems on purpose to find their weaknesses before criminals do. The authors trace how language models grew into the job across research and industry, covering the phases of the cyber kill chain.

Models now help with everything from reconnaissance to exploitation, and criminals use them too, which makes the technology dual-use. The authors explain the fit: testing leans on pattern matching, a core model strength; testers must act under uncertainty, which models tolerate; and strong pretrained models are cheap to rent. Current practice splits into interactive sessions, nicknamed vibe-hacking, and emerging fully autonomous systems. Obstacles include reliability, safety, cost, privacy, accountability, and ethics. The review closes with research directions and safeguards for the field.

Catalog record

CREATORAndreas Happe, Jürgen Cito
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00829

Browse the full library · About the Tower of Babel