PolicyPad : Collaborative Prototyping of LLM Policies DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Interactive systems and tools CCS: Hu
K. J. Kevin Feng, Tzu-Sheng Kuo, Quan Ze Chen, Inyoung Cheong, Kenneth Holstein, Amy X. Zhang · 2025
Read PolicyPad : Collaborative Prototyping of LLM Policies DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Interactive systems and tools CCS: Hu by K. J. Kevin Feng, Tzu-Sheng Kuo, Quan Ze Chen, Inyoung Cheong, Kenneth Holstein, Amy X. Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19680.txt.
Introduction
Rules for how language models should behave in mental health or law cannot be written by engineers alone. K. J. Kevin Feng and five co-authors built PolicyPad, a shared workspace for drafting such policies. Experts can edit a policy together while each tests how a model acts under it on sample scenarios. The design borrows from user-experience practice, such as storyboards and heuristic checks.
The system grew out of watching nineteen workshops with domain experts over fifteen weeks. Trials with twenty-two experts in mental health and law followed. Groups reported tighter feedback loops and better teamwork while drafting. Testing behavior beside the text surfaced gaps that prose alone hid. The authors offer policy prototyping as a practice, much like prototyping an interface before release.
Catalog record
| CREATOR | K. J. Kevin Feng, Tzu-Sheng Kuo, Quan Ze Chen, Inyoung Cheong, Kenneth Holstein, Amy X. Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-19680
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PolicyPad : Collaborative Prototyping of LLM Policies DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing Synchronous editors K. J. Kevin Feng, Tzu-Sheng Kuo, Quan Ze Chen, Inyoung Cheong, Kenneth Holstein, Amy X. Zhang Abstract . As LLMs gain adoption in high-stakes domains like mental health, domain experts are increasingly consulted to provide input into policies governing their behavior. From an observation of 19 policymaking workshops with 9 experts over 15 weeks, we identified opportunities to better support rapid experimentation, feedback, and iteration for collaborative policy design processes. We present PolicyPad , an interactive system that facilitates the emerging practice of LLM policy prototyping by drawing from established UX prototyping practices, including heuristic evaluation and storyboarding. Using PolicyPad , policy designers can collaborate on drafting a policy in real time while independently testing policy-informed model behavior with usage scenarios. We evaluate PolicyPad through workshops with 8 groups of 22 domain experts in mental health and law, finding that PolicyPad enhanced collaborative dynamics during policy design, enabled tight feedback loops, and led to novel policy contributions. Overall, our work paves participatory paths for advancing AI alignment and safety. Figure 1 . PolicyPad is an interactive system that facilitates collaborative prototyping of LLM policies. Policy designers work together in real time (left) to draft policy statements in PolicyPad ’s collaborative editor (middle) , while experimenting with the model’s policy-informed behavior in a private sidebar (right) . Content from the private sidebar can be fluidly brought into the collaborative editor for viewing, editing, and discussion. To facilitate LLM policy prototyping, PolicyPad borrows concepts and practices from UX prototyping, including heuristic evaluation, storyboarding, and rapid iteration. Policy designers work together in real time (left) to draft policy statements in PolicyPad's collaborative editor (middle), while experimenting with the model's policy-informed behavior in a private sidebar (right). Content from the private sidebar can be fluidly brought into the collaborative editor for viewing, editing, and discussion. To facilitate LLM policy prototyping, PolicyPad borrows concepts and practices from UX prototyping, including heuristic evaluation, storyboarding, and rapid iteration. 1. Introduction For decades, researchers and science fiction writers have imagined a world in which AI systems can be governed by natural language rules ( Asimov 1940 ; Turing 1950 ) . Today, governing large language models (LLMs) with LLM policies —sets of rules, guidelines, and desiderata that shape model behavior—is a key component in the broader toolkit of approaches to improve model alignment and safety ( OpenAI 2025 ; OpenAI 2025a ; Anthropic 2023 ; Huang et al. 2024 ; Horwitz 2025 ; Lam et al. 2024 ) . For example, OpenAI’s Model Spec contains a series of general objectives and principles (e.g., “Seek the truth together” ) for researchers and red-teamers to use as a guide when working on reinforcement learning from human feedback (RLHF) ( OpenAI 2025a ) , as well as for the model to learn from directly ( Guan et al. 2024 ) . Similarly, Anthropic uses Constitutional AI—in which reinforcement learning receives reward signals from AI-generated feedback that adheres to a set of principles (a “constitution”)—to align its Claude models ( Bai et al. 2022 ; Anthropic 2023 ) . If effective, LLM policies promise a transparent, familiar, and legible means by which developers and policymakers can govern AI systems. As LLMs are deployed to millions of users globally, LLM policies become increasingly consequential and scrutinized. This is especially true in high-stakes, tightly regulated domains that are seeing rapid increases in LLM use by everyday users, such as mental health and law ( Hill 2025a ; Lohr 2023 ; Rosenbluth 2025 ; Hill and Freedman 2025 ; Hill 2025b ; Cheong et al. 2024 ; Perez 2025 ) . LLM policies are primarily written by model developers, but the lack of external input often leads to insular policies that poorly reflect the attitudes and values of everyday users, while ignoring key safety concerns ( Huang et al. 2024 ; Horwitz 2025 ) . While frontier AI labs regularly partner with external domain experts to conduct pre-release safety testing of their models ( Anthropic 2025b ; Hurst et al. 2024 ; Google 2025 ) , there has been little documentation of similar efforts for LLM policies. Yet, there is mounting recognition that expert input is essential for LLM policy design, especially in safety-critical, domain-specific use cases ( OpenAI 2025b ; Walsh and Gronvall 2025 ) . In this work, we first conduct a 15-week observational study in partnership with a U.S.-based frontier AI lab to better understand how domain experts can contribute to LLM policy design. Through 19 interactive workshops in which mental health experts discussed, annotated, taxonomized, and drafted user queries and LLM responses, we observed experts collaboratively ideating and discussing policy ideas while seeking ways to rapidly test and iterate on them through experimentation with model behavior on realistic scenarios. Much like prototyping in user experience (UX) practice, there is a strong emphasis on collaborative and rapid exploration, feedback collection, and iteration. We thus conceptualize this emerging practice as LLM policy prototyping , borrowing from established UX practices like heuristic evaluation and low-fidelity prototyping. However, few tools exist for policy design ( Lam et al. 2024 ) , let alone tools that support collaborative LLM policy prototyping. We observe notable opportunities for experts to tighten the feedback loop during policy design while leveraging collaborative affordances to build off each other’s expertise. We design and develop PolicyPad , 1 1 1 We plan to open-source PolicyPad at https://github.com/kjfeng/policypad. an interactive system that facilitates LLM policy prototyping. PolicyPad draws upon established methods and concepts within UX prototyping to enable small groups to collaboratively draft policies, test policy-informed model behavior against usage scenarios, evaluate the quality of the policy, and iterate on its contents in real time through tight feedback loops. We evaluate PolicyPad through policy prototyping sessions with 22 domain experts spanning two domains—mental health and law—organized into 8 groups. We found that design decisions in PolicyPad fostered collaborative dynamics between experts via its interactive in-editor widgets and yielded more novel policies compared to a baseline, relative to existing policies 2 2 2 As of September 1, 2025. including OpenAI’s Model Spec ( OpenAI 2025a ) and Claude’s Constitution ( Anthropic 2023 ) . Key areas of novelty include offering more specific guidelines on when the model should defer to a human expert, and eliciting key information required for responsible assistance early in the conversation. We end by discussing the practical implications of our work, including where LLM policy prototyping can be situated in AI alignment pipelines, and approaches for scaling up policy prototyping efforts. Concretely, this work makes the following contributions: • An 15-week observational study with 9 mental health experts that surfaced opportunities for tight, collaborative feedback loops in LLM policy design. • LLM policy prototyping, a conceptualization of an emerging practice for collaboratively prototyping LLM policies in small groups. • PolicyPad , a system that facilitates LLM policy prototyping through interactive and collaborative affordances for policy design, drawing from established UX practices. • An evaluation of PolicyPad with 22