Detecting Jailbreak Attempts in Clinical Training LLMs Through Automated Linguistic Feature Extraction

Tri Nguyen, Huy Hoang Bao Le, Lohith Srikanth Pentapalli, Laurah Turner, Kelly Cohen · 2026

Read Detecting Jailbreak Attempts in Clinical Training LLMs Through Automated Linguistic Feature Extraction by Tri Nguyen, Huy Hoang Bao Le, Lohith Srikanth Pentapalli, Laurah Turner, Kelly Cohen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-13321.txt.

Description

Clinical training chatbots must spot jailbreak attempts, where users steer the model off task or into unsafe replies. Earlier work on the 2-Sigma platform showed hand-labeled language traits could support detection, but hand labeling does not scale. This study automates the idea: expert labels for professionalism, medical relevance, ethical behavior, and contextual distraction train BERT-based models to score those traits straight from text.

The best scorer for each trait then feeds a second layer of classifiers that judge jailbreak likelihood, tested across tree, linear, probabilistic, and ensemble methods. Cross-validation and held-out tests showed strong performance, and error analysis points to richer labels and finer traits as next steps. Tri Nguyen leads the work with four co-authors.

Catalog record

CREATORTri Nguyen, Huy Hoang Bao Le, Lohith Srikanth Pentapalli, Laurah Turner, Kelly Cohen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-13321

Browse the full library · About the Tower of Babel