Detecting Jailbreak Attempts in Clinical Training LLMs Through Automated Linguistic Feature Extraction
Tri Nguyen, Huy Hoang Bao Le, Lohith Srikanth Pentapalli, Laurah Turner, Kelly Cohen · 2026
Read Detecting Jailbreak Attempts in Clinical Training LLMs Through Automated Linguistic Feature Extraction by Tri Nguyen, Huy Hoang Bao Le, Lohith Srikanth Pentapalli, Laurah Turner, Kelly Cohen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-13321.txt.
Description
Clinical training chatbots must spot jailbreak attempts, where users steer the model off task or into unsafe replies. Earlier work on the 2-Sigma platform showed hand-labeled language traits could support detection, but hand labeling does not scale. This study automates the idea: expert labels for professionalism, medical relevance, ethical behavior, and contextual distraction train BERT-based models to score those traits straight from text.
The best scorer for each trait then feeds a second layer of classifiers that judge jailbreak likelihood, tested across tree, linear, probabilistic, and ensemble methods. Cross-validation and held-out tests showed strong performance, and error analysis points to richer labels and finer traits as next steps. Tri Nguyen leads the work with four co-authors.
Catalog record
| CREATOR | Tri Nguyen, Huy Hoang Bao Le, Lohith Srikanth Pentapalli, Laurah Turner, Kelly Cohen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-13321