Backprompting: Leveraging Synthetic Production Data for Health Advice Guardrails
Kellen Tan Cheng, Anna Lisa Gentile, Chad DeLuca, Guang-Jie Ren · 2025
Read Backprompting: Leveraging Synthetic Production Data for Health Advice Guardrails by Kellen Tan Cheng, Anna Lisa Gentile, Chad DeLuca, Guang-Jie Ren (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18384.txt.
Introduction
Kellen Tan Cheng and co-authors manufacture practice data to train a guardrail that spots health advice in chatbot output. Companies filtering language model replies struggle to get real, labeled production text before launch. Their trick, backprompting, runs the process backward to synthesize examples that read like genuine model output, then labels them with light human help through sparse clustering.
Mixed into existing training sets, the synthetic examples harden the detector. On the hard task of flagging health advice, the small detector beat GPT-4o by a few points despite having four hundred times fewer parameters. The authors offer backprompting as a general recipe for cold-start guardrails in other sensitive topics.
Catalog record
| CREATOR | Kellen Tan Cheng, Anna Lisa Gentile, Chad DeLuca, Guang-Jie Ren |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-18384
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Backprompting: Leveraging Synthetic Production Data for Health Advice Guardrails Kellen Tan Cheng, Anna Lisa Gentile, Chad DeLuca, Guang-Jie Ren Abstract The pervasiveness of large language models (LLMs) in enterprise settings has also brought forth a significant amount of risks associated with their usage. Guardrails technologies aim to mitigate this risk by filtering LLMs’ input/output text through various detectors. However, developing and maintaining robust detectors faces many challenges, one of which is the difficulty in acquiring production-quality labeled data on real LLM outputs prior to deployment. In this work, we propose backprompting, a simple yet intuitive solution to generate production-like labeled data for health advice guardrails development. Furthermore, we pair our backprompting method with a sparse human-in-the-loop clustering technique to label the generated data. Our aim is to construct a parallel corpus roughly representative of the original dataset yet resembling real LLM output. We then infuse existing datasets with our synthetic examples to produce robust training data for our detector. We test our technique in one of the most difficult and nuanced guardrails: the identification of health advice in LLM output, and demonstrate improvement versus other solutions. Our detector is able to outperform GPT-4o by up to 3.73%, despite having 400x less parameters. 1 Introduction The advancement of large language models (LLMs) has brought about impressive capabilities in a wide variety of natural language tasks OpenAI et al. 2024 ; Dubey et al. 2024 . However, the fact that these models are pre-trained on massive text corpora inevitably results in the generation of some undesirable outputs that may be misleading and/or factually incorrect. Many prominent LLMs have methods in place to safeguard their interactions with users Rebedea et al. 2023 ; Inan et al. 2023 ; Markov et al. 2023 ; Salem et al. 2023 ; Dong et al. 2024 , but developing guardrails technology that can effectively minimize LLMs’ usage risks remains an open challenge. Additionally, conventional techniques typically involve a nontrivial human component, whether for crafting/curating specific datasets for the task or for red-teaming. One prominent challenge in guardrail development is obtaining high-quality production data. This is because there exists a significant distribution shift between open-source fine-tuning (FT) datasets, which are typically human-curated, and the data that is actually encountered during inference, which is machine-generated Achintalwar et al. 2024 ; Koh et al. 2021 ; Huang et al. 2021 ; Taori et al. 2020 . Additionally, only a select few corporations have access to large-scale production datasets containing LLMs’ prompts and responses, but given their proprietary nature, it is impossible to utilize them for guardrails development. This scarcity is exacerbated in domains such as healthcare or finance, due to privacy concerns and the involvement of critical decision-making within the data Park et al. 2021 ; Liu et al. 2023 ; Du et al. 2024 . While there have been considerable efforts to construct various LLM risk benchmark datasets Ganguli et al. 2022 ; Mazumder et al. 2023 ; Ji et al. 2023 ; Wang et al. 2024 , there is still a nontrivial human cost, and manually constructing benchmarks for each particular risk category is not scalable. Towards addressing this problem, we introduce a simple yet intuitive framework for synthetic generation of real-world production data. Inspired by the concept of backtranslation Sennrich et al. 2016 , backprompting uses an initial set of annotated data and generates a completely new set of data. The process begins by (i) generating a prompt for each given input text, then (ii) feeding the prompts back to an LLM, (iii) using the generated text as the new text, and (iv) performing a sparse human-in-the-loop (sparse-HITL) labeling scheme, making minimal use of human feedback to effectively produce labeled synthetic data. Our framework makes no restrictions on the type of guardrails task, the type of input data, or even the language model which is used for the text generation. The contributions of this work are as follows: (1) a framework to synthetically generate data in the style of an LLM’s outputs (2) a semi-automatic sparse-HITL annotation scheme to label the synthetically generated data (3) a two-stage FT setup to better adapt language models towards the synthetic data, where the first stage incorporates a mix of synthetic and open-source data, and the second stage uses purely synthetic data. 2 Related Work 2.1 Query Generation There have been various approaches to generate queries from input texts Du et al. 2017 . Prior work has focused on validating summary quality with questions Wang et al. 2020 , generating question-answer pairs Krishna and Iyyer 2019 , automatic query generation for event-extraction Liu et al. 2020 , or using templates or knowledge graphs Gaur et al. 2022 ; Kumar et al. 2019 ; Reddy et al. 2017 ; Fabbri et al. 2020 . Unlike prior work, our approach considers both query generation and the corresponding output generation, in a manner akin to backtranslation. Additionally, it is possible to complement our framework with a more optimized query generation scheme, such that it works in tandem with prior work. 2.2 Synthetic Data Generation Synthetic data generation remains a pertinent and useful capability of present-day LLMs Long et al. 2024 ; Kruschwitz and Schmidhuber 2024 . Mainstream techniques for LLMs mainly focus on a variety of prompt-engineering techniques such as creating roleplay Li et al. 2023 , defining task specifications or taxonomies Yoo et al. 2021 ; Sudalairaj et al. 2024 , knowledge graphs Xu et al. 2024 , feedback Ye et al. 2022 , and in-context learning examples Wang et al. 2023 ; Li et al. 2024 . Our approach differs in that we are optimizing to match the LLM outputs’ distribution, rather than data quality itself. This is because we consider data generation for the application of guardrails development, and such erroneous or dirty samples are texts that could realistically be generated by an LLM during inference. As a result, including some imperfect samples allows our detector model to be even more robust. 2.3 Guardrails Development In recent years, guardrails development for LLMs has been a prominent subfield within natural language processing Dong et al. 2024 . There have been a variety of different approaches to implementing guardrails, from using lightweight detector models Achintalwar et al. 2024 ; DeLuca et al. 2025 , taxonomies and/or red-teaming with LLMs Inan et al. 2023 ; Markov et al. 2023 , human programmable guardrails Rebedea et al. 2023 , to query-modification and fusion models Yuan et al. 2024 ; Xiang et al. 2024 . Our approach is also one method for guardrails development, but instead we focus more on the data creation step, namely generating high-quality production-like data that can be used to make robust datasets for creating guardrails models. In this sense, we are less focused on an actual model framework and more on how to provide the tools (i.e. data) necessary to help facilitate guardrails development. 3 Synthetic Data Generation We describe the synthetic data generation framework seen in Figure 1 . Please refer to Appendix C for the comprehensive list of hyperparameters. Figure 1: An overview of the data generation schematic. (Top) For each data point, we first transform it into a query, and then re-prompt an LLM with our formulated query