ScriptoriumWS: A Code Generation Assistant for Weak Supervision
Tzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala University of Wisconsin-Madison {thuang273, ccao35, spencer.schoenberg}@wisc.edu , {hvishwakarma, nick11roberts, fredsala}@cs.wisc.edu · 2025
Read ScriptoriumWS: A Code Generation Assistant for Weak Supervision by Tzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala University of Wisconsin-Madison {thuang273, ccao35, spencer.schoenberg}@wisc.edu , {hvishwakarma, nick11roberts, fredsala}@cs.wisc.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12366.txt.
Description
Weak supervision labels training data with many cheap, noisy rules instead of hand labels. Writing those rules still costs expert time. Tzu-Heng Huang and co-authors let code generation models draft them instead. Their system, ScriptoriumWS, acts as a coding assistant for rule writers. A multi-tier prompting strategy feeds the generator several kinds of context. The study also asks how machine-written and hand-written rules mix best.
Against hand-crafted rule sets, the assisted system held accuracy steady. Coverage of the data rose sharply. The authors argue generated rules lower the entry cost of weak supervision. Human experts can then spend their time checking rather than drafting.
Catalog record
| CREATOR | Tzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala University of Wisconsin-Madison {thuang273, ccao35, spencer.schoenberg}@wisc.edu , {hvishwakarma, nick11roberts, fredsala}@cs.wisc.edu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12366