WebGuard: Building a Generalizable Guardrail for Web Agents
Boyuan Zheng Zeyi Liao Scott Salisbury Zeyuan Liu Michael Lin Qinyuan Zheng, Zifan Wang Xiang Deng Dawn Song Huan Sun Yu Su · 2025
Read WebGuard: Building a Generalizable Guardrail for Web Agents by Boyuan Zheng Zeyi Liao Scott Salisbury Zeyuan Liu Michael Lin Qinyuan Zheng, Zifan Wang Xiang Deng Dawn Song Huan Sun Yu Su (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-14293.txt.
Description
A team of eleven authors builds a guard dataset to keep web agents from taking risky acts online. Web agents that click and type for users can move fast, yet one wrong click can spend money or leak data. Their set, called WebGuard, holds near five thousand human-marked acts from 193 sites in 22 fields. Each act is tagged by risk in three tiers, from safe to high, with a focus on acts that change state.
Even top language models scored under 60 percent at guessing how acts end. They also caught under 60 percent of the high-risk acts in the set. That miss rate marks the peril of loose agent use today. The team then tuned small guard models on the set, which did far better. Train and test splits let labs grade guards in fresh fields.
Catalog record
| CREATOR | Boyuan Zheng Zeyi Liao Scott Salisbury Zeyuan Liu Michael Lin Qinyuan Zheng, Zifan Wang Xiang Deng Dawn Song Huan Sun Yu Su |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-14293