M ulti-lingual M ulti-turn A utomated R ed T eaming for LLMs

Abhishek Singhania, Christophe Dupuy, Shivam Mangale, Amani Namboori · 2025

Read M ulti-lingual M ulti-turn A utomated R ed T eaming for LLMs by Abhishek Singhania, Christophe Dupuy, Shivam Mangale, Amani Namboori (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03174.txt.

Introduction

Abhishek Singhania, Christophe Dupuy, Shivam Mangale, and Amani Namboori present an automated safety test for language models in two thousand twenty-five. Red teaming probes a model with crafted prompts to trigger unsafe replies. Human testing is slow and costly, and past automation covered only English or single turns.

Their method, MM-ART, automates red teaming across languages and over multi-turn conversations. Tests showed models grew much more vulnerable as a chat went on, with a large rise by the fifth turn in English. In other languages, weak points rose even more sharply versus the single-turn English baseline. The authors argue safety checks must match the full skills of modern models, language and dialogue included.

Catalog record

CREATORAbhishek Singhania, Christophe Dupuy, Shivam Mangale, Amani Namboori
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03174

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

M ulti-lingual M ulti-turn A utomated R ed T eaming for LLMs Abhishek Singhania, Christophe Dupuy, Shivam Mangale, Amani Namboori Abstract Warning: This paper includes content that may be considered inappropriate or offensive to some readers. Viewer discretion is advised. Language Model Models (LLMs) have improved dramatically in the past few years, increasing their adoption and the scope of their capabilities over time. A significant amount of work is dedicated to “model alignment”, i.e., preventing LLMs to generate unsafe responses when deployed into customer-facing applications. One popular method to evaluate safety risks is red-teaming , where agents attempt to bypass alignment by crafting elaborate prompts that trigger unsafe responses from a model. Standard human-driven red-teaming is costly, time-consuming and rarely covers all the recent features (e.g., multi-lingual, multi-modal aspects), while proposed automation methods only cover a small subset of LLMs capabilities (i.e., English or single-turn). We present Multi-lingual Multi-turn Automated Red Teaming ( MM-ART ), a method to fully automate conversational, multi-lingual red-teaming operations and quickly identify prompts leading to unsafe responses. Through extensive experiments on different languages, we show the studied LLMs are on average 71% more vulnerable after a 5-turn conversation in English than after the initial turn. For conversations in non-English languages, models display up to 195% more safety vulnerabilities than the standard single-turn English approach, confirming the need for automated red-teaming methods matching LLMs capabilities. 1 Introduction In recent years, the landscape of Language Model Models (LLMs) has evolved drastically, with numerous releases showcasing enhanced capabilities over time. These advancements have positioned LLMs as formidable tools capable of a wide range of tasks, from generating creative text to powering virtual assistants and chat-bots. Even smaller open LLMs such as Mistral Jiang et al. (2023) , Llama Meta-AI (2024) or Molmo Deitke et al. (2024) have demonstrated close to state-of-the-art performance across various tasks. Their effectiveness makes them viable options for integration into enterprise applications, particularly due to their lower latency and cost-effectiveness. However, this increase in capabilities means that models are even more susceptible to generating unsafe content which could harm customers (e.g., detailed instructions to build a bomb). Recent models are now capable of holding long conversations in multiple languages, which offer even more possibilities for unsafe content generation. To tackle this challenge, “red-teaming” emerges as a crucial strategy aimed at assessing and mitigating the potential adverse effects of LLM-generated content. Red-teaming entails a systematic approach to adversarial probing and evaluation of an LLM’s responses, with the objective of identifying safety violations. LLMs are then “aligned” by incorporating red-teaming data into their training, making them more robust to attacks and ensuring the generated content adheres to ethical standards set by their builders. Standard red-teaming involves human testers interacting with LLMs in an attempt to trigger unsafe responses, aka “jailbreaking”. This approach relies on the creativity and expertise of humans, who craft scenarios to challenge the LLM across different contexts. However, due to its manual nature, human red-teaming can be time-consuming and resource-intensive. In contrast, automated red-teaming relies on various ML models, allowing for more scalable and efficient evaluation, although human creativity is still needed for exploring new vulnerabilities. Most recent studies focus on capturing jailbreak methods in either multi-turn or multilingual scenarios Deng et al. (2023) ; Russinovich et al. (2024) , but no existing research conduct simultaneous safety evaluation across multiple capability dimensions during red-teaming. We present a novel approach, Multilingual and Multi-turn Automated Red Teaming (MM-ART), and the first safety evaluation on a set of widely popular LLMs for attacks in non-English conversational settings. We believe this line of study is critical for expanding LLMs across the globe, covering different languages and delivering a similar safe experience to different users. Our contributions: 1) We propose a novel approach, MM-ART, to evaluate the safety of models across both languages and the conversational depth. We provide a detailed description of our approach and share the components used to build this method. 2) We conduct a thorough evaluation of popular LLMs using MM-ART and present the first comprehensive study around safety assessment of conversational LLMs across multiple languages and safety categories. 3) Our detailed analysis of MM-ART through ablation studies provides insights into the impact of the different components of our approach on the safety levels of the evaluated LLMs. 2 Related Work A wide variety of single-turn “static jailbreaking” methods have been proposed in the past year, which consist of formatting a static prompt in a way that triggers unsafe response from the LLM by rephrasing, spreading across multiple turns or adding many prompts into LLM context Sun et al. (2024) ; Agarwal et al. (2024) ; Upadhayay and Behzadan (2024) ; Li et al. (2024) ; Cheng et al. (2024) ; Anil et al. (2024) . Other works have looked into multi-turn “static jailbreaking”, where from a static adversarial prompt, a conversation is held with the target LLM aimed at triggering a response to the initial prompt. For instance, Russinovich et al. (2024) propose an automated method to manipulate the target LLM with regeneration and gradual intensification of prompts. Additionally, Yang et al. (2024) include a semantic-driven strategy for generating new turns and show that incorporating more complex, multi-turn contextual scenarios into the safety alignment phase strengthen LLM protection. Both methods are restricted to the provided input task/prompt. We add a conversation starter generation component which makes MM-ART more flexible and suitable to cover broader assessment over a given safety category. Plus, these studies rely on large closed models with very long prompt templates and multiple regenerations per turn while our experiments are exclusively conducted with small open models significantly increasing efficiency and scalability. Studies on multi-lingual LLMs focus on single-turn attacks, showing LLMs are more vulnerable when prompted in low resource languages Yong et al. (2024) ; Etxaniz et al. (2024) or with code-switching Yoo et al. (2024) than in English. Undesirable outputs are significantly reduced by instructing the LLM to think in English Wang et al. (2024) . While there has been major progress in automated red-teaming, existing work on simultaneous multilingual and multi-turn red teaming is limited, even more so when considering conversations on unrestricted topics. MM-ART is designed to bridge that gap by providing an efficient and scalable method to systematically identify safety gaps in LLMs. 3 Multi-lingual Multi-turn Automated Red Teaming (MM-ART) Our proposed Multi-lingual Multi-turn Automated Red Teaming (MM-ART) approach is divided into two sequential steps. We first generate prompts that will be used to start conversations (called “conversation starters”), setting the topic and tone for the conversation. Second, for each conversation starter, we complete the conversation in a given language for a specific depth (i.e., number of turns each containing a prompt and a response) by adapting to the LLM responses to continue the conversation. This two step approach allows for maximum flexibility, where the conversation starters are extracted from a variety of sources (e.g., generated by human or machine), covering different categories, different attack techniques etc. 3.1 Conversation Starters Generation Although human-generated prompts is the gold standard for red-teaming evaluation, it is not feasible to generate a large set of prompts solely with humans. We leverage LLMs to generate conversation starters with three main objectives. 1)

Read the complete text