Skill-Inject : Measuring Agent Vulnerability to Skill File Attacks

David Schmotz, Luca Beurer-Kellner, Sahar Abdelnabi, Maksym Andriushchenko · 2026

Read Skill-Inject : Measuring Agent Vulnerability to Skill File Attacks by David Schmotz, Luca Beurer-Kellner, Sahar Abdelnabi, Maksym Andriushchenko (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-20156.txt.

Description

Agent skills let users extend language model applications with third-party code, knowledge, and instructions, but that supply chain opens a new attack surface: malicious instructions hidden in skill files. A 2026 arXiv paper by David Schmotz and three co-authors introduces Skill-Inject, a benchmark measuring how susceptible widely used language model agents are to injections through skill files.

Skill-Inject contains over two hundred injection-task pairs. Attacks range from obviously malicious injections to subtle attacks that depend on context and hide inside otherwise legitimate instructions. Agents are evaluated on security, avoiding harmful instructions, and on utility, complying with legitimate instructions. Results show today's agents are highly vulnerable. Attack success reaches up to four fifths with frontier models. Those models often execute extremely harmful instructions. The benchmark gives developers a concrete measure of skill-file risk.

Catalog record

CREATORDavid Schmotz, Luca Beurer-Kellner, Sahar Abdelnabi, Maksym Andriushchenko
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-20156

Browse the full library · About the Tower of Babel