ScriptoriumWS: A Code Generation Assistant for Weak Supervision

Tzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala University of Wisconsin-Madison {thuang273, ccao35, spencer.schoenberg}@wisc.edu , {hvishwakarma, nick11roberts, fredsala}@cs.wisc.edu · 2025

Read ScriptoriumWS: A Code Generation Assistant for Weak Supervision by Tzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala University of Wisconsin-Madison {thuang273, ccao35, spencer.schoenberg}@wisc.edu , {hvishwakarma, nick11roberts, fredsala}@cs.wisc.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12366.txt.

Description

Weak supervision labels training data with many cheap, noisy rules instead of hand labels. Writing those rules still costs expert time. Tzu-Heng Huang and co-authors let code generation models draft them instead. Their system, ScriptoriumWS, acts as a coding assistant for rule writers. A multi-tier prompting strategy feeds the generator several kinds of context. The study also asks how machine-written and hand-written rules mix best.

Against hand-crafted rule sets, the assisted system held accuracy steady. Coverage of the data rose sharply. The authors argue generated rules lower the entry cost of weak supervision. Human experts can then spend their time checking rather than drafting.

Catalog record

CREATORTzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala University of Wisconsin-Madison {thuang273, ccao35, spencer.schoenberg}@wisc.edu , {hvishwakarma, nick11roberts, fredsala}@cs.wisc.edu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12366

Browse the full library · About the Tower of Babel