Skill-Inject : Measuring Agent Vulnerability to Skill File Attacks
David Schmotz, Luca Beurer-Kellner, Sahar Abdelnabi, Maksym Andriushchenko · 2026
Read Skill-Inject : Measuring Agent Vulnerability to Skill File Attacks by David Schmotz, Luca Beurer-Kellner, Sahar Abdelnabi, Maksym Andriushchenko (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-20156.txt.
Description
Agent skills let users extend language model applications with third-party code, knowledge, and instructions, but that supply chain opens a new attack surface: malicious instructions hidden in skill files. A 2026 arXiv paper by David Schmotz and three co-authors introduces Skill-Inject, a benchmark measuring how susceptible widely used language model agents are to injections through skill files.
Skill-Inject contains over two hundred injection-task pairs. Attacks range from obviously malicious injections to subtle attacks that depend on context and hide inside otherwise legitimate instructions. Agents are evaluated on security, avoiding harmful instructions, and on utility, complying with legitimate instructions. Results show today's agents are highly vulnerable. Attack success reaches up to four fifths with frontier models. Those models often execute extremely harmful instructions. The benchmark gives developers a concrete measure of skill-file risk.
Catalog record
| CREATOR | David Schmotz, Luca Beurer-Kellner, Sahar Abdelnabi, Maksym Andriushchenko |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-20156