From IOCs to Regex: Automating CTI Operationalization for SOC with LLMs

Pei-Yu Tseng 1 , Lan Zhang 2 , ZihDwo Yeh 1 , Xiaoyan Sun 3 , Xushu Dai 1 , Peng Liu 1 · 2026

Read From IOCs to Regex: Automating CTI Operationalization for SOC with LLMs by Pei-Yu Tseng 1 , Lan Zhang 2 , ZihDwo Yeh 1 , Xiaoyan Sun 3 , Xushu Dai 1 , Peng Liu 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12228.txt.

Introduction

Tseng and five colleagues automate turning cyber threat indicators into regular expressions for security operations, a task analysts still do by hand. Their IOCRegex-gen system groups indicator segments into capture or non-capture groups and validates candidates through iterative reasoning and multi-stage checks. On over 3,000 real threat reports and 2,400 ground-truth strings it hits 99.1 percent with only 0.8 percent false positives.

Catalog record

CREATORPei-Yu Tseng 1 , Lan Zhang 2 , ZihDwo Yeh 1 , Xiaoyan Sun 3 , Xushu Dai 1 , Peng Liu 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72054
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.12228

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From IOCs to Regex: Automating CTI Operationalization for SOC with LLMs Pei-Yu Tseng 1 , Lan Zhang 2 , ZihDwo Yeh 1 , Xiaoyan Sun 3 , Xushu Dai 1 , Peng Liu 1 Abstract Cyber Threat Intelligence (CTI) reports provide Indicators of Compromise (IOCs) that are essential for security operations. A common way to operationalize IOCs is through regular expressions (regexes) , which enable precise matching of attack traces across heterogeneous log data. Regexes support a wide range of tasks, including digital forensics, log parsing, and the construction of rules in Security Information and Event Management (SIEM) systems. However, regex construction remains largely manual: analysts must extract IOCs from CTI reports and then craft syntactically valid and semantically precise patterns. This process is slow, error-prone, and increasingly unsustainable given the rising volume of CTI reports. While recent approaches have applied Large Language Models (LLMs) to IOC extraction, they primarily focus on producing raw artifacts—leaving IOCs as plain strings that still require manual transformation into regexes before they can be operationalized. This gap limits their practical utility, as plain strings cannot account for variations in system contexts, log formats, or attacker behaviors, all of which regexes are designed to capture. To address these challenges, we propose a fully automated LLM-based regex generation system, IOCRegex-gen, that generates corresponding regexes from IOCs. Our system introduces two key innovations: (i) a group-aware mechanism that automatically distinguishes which IOC segments should be treated as capture groups versus non-capture groups, and (ii) an iterative reasoning and multi-stage validation pipeline that ensures regexes are both syntactically valid and semantically correct. Our experimental validation using over 3,000 real CTI reports and over 2,400 ground truth strings collected from the MITRE ATT&CK Evaluation framework demonstrates that the regexes generated by our system achieve an average hit rate of 99.1% across the datasets, with an average false‑positive rate of only 0.8%, confirming its practical utility for large-scale CTI processing and automated regex generation. I Introduction In modern Security Operations Centers (SOCs), analysts rely on a wide variety of data sources collected on a daily basis, including CTI reports, Windows event logs, endpoint logs, and Linux journals. To utilize these data sources in a scalable way, they must be parsed automatically to find the specific information items that analysts are searching for. To serve the purpose of IOC hunting, CTI reports are a valuable resource, as they describe attacker behaviors and provide IOCs such as file paths, registry keys, and command-line arguments. However, there is a fundamental gap between how attacker behaviors are described in CTI reports and how they are recorded in specific system logs. For example, a CTI report may describe an attacker creating a scheduled task with the command schtasks.exe \create \tn … , but in system logs, the same activity may appear with different path delimiters, execution parameters, or capitalization, making exact string matching infeasible. Without bridging this gap, even if IOCs are successfully extracted from CTI reports, threat intelligence remains difficult to operationalize in practice. The de facto strategy to bridge this gap is the use of regexes . In practice, human analysts manually translate IOCs extracted from CTI reports into regexes, which can then be executed by computers to search massive log data. Regexes thus provide the medium that operationalizes human-readable intelligence into actionable detection, supporting tasks such as digital forensics, log parsing, and the construction of SIEM rules. When constructing regexes for IOCs, security analysts typically employ a multi-step workflow . They first review CTI reports from cybersecurity companies, individual experts, or knowledge bases such as MITRE ATT&CK, extract the relevant IOCs, and then manually translate them into regexes. Although this manual process provides a very important enabler for many advanced SOC operations, it faces critical limitations that have grown more severe as the frequency and scale of global attacks increase. [ 37 ] . In practice, the current multi-step workflows face several critical limitations. First, the end-to-end process of reading CTI reports, authoring regexes, and subsequently testing and tuning them can take hours to days, creating bottlenecks that delay responses to emerging threats. Second, regex authoring expertise is unevenly distributed: novice analysts often resort to senior colleagues for help, straining already limited security team resources. Third, the repetitive and detail-oriented nature of regex construction contributes to analyst fatigue, leading to errors such as syntax mistakes, missing capture groups, or insufficient generalization. These limitations introduce mounting time and labor pressures on SOC operations. Recent research alleviates these limitations by automating part of the multi-step workflow. One line of work focuses on IOC extraction from CTI reports. For instance, [ 31 ] utilized a pre-trained named-entity recognition (NER) model to extract IOCs from text and constructed a graph to represent inter-IOC relationships, while [ 21 ] applied a pre-trained model to identify candidate threat actions for timely cyber defense. More recently, [ 18 ] and [ 33 ] employed LLMs to extract IOCs from CTI texts. While these extraction approaches are valuable, their functionalities stop at producing raw IOCs and do not address the subsequent—and equally critical—step of translating these IOCs into deployable regexes. Consequently, analysts must still manually perform this regex construction, leaving the core operational bottleneck unresolved. Beyond IOC extraction, several recent studies [ 42 , 33 , 39 ] have attempted to take one further step by leveraging LLMs to generate SIEM detection rules from CTI data automatically. However, in these works, the proportion of generated rules that incorporate regexes remains unrealistically small. For instance, [ 42 ] utilized the in-context learning capabilities of LLMs to perform Tactics, Techniques, and Procedures (TTPs) classification and generate detection rules informed by external threat intelligence databases. While their results include 135 automatically generated rules, the vast majority correspond to surface-level indicators such as IP addresses and domain names, with only 7 rules incorporating any form of regex-based pattern matching, and these regex components are very simple in terms of structure and significantly simpler than the regexes in real-world SIEM rules, reflecting very limited exploration of regex synthesis in current approaches. Another line of work has explored regex generation in different contexts, though not specifically for security IOCs. These approaches can be broadly categorized into two groups. Traditional Natural Language Processing (NLP) methods, such as [ 26 ] and [ 6 ] , improved syntactic validity through sequence-to-sequence models but were designed for controlled natural language tasks with well-formed input descriptions. More recently, LLM-based methods such as [ 46 ] and [ 36 ] have extended regex generation capabilities through improved reasoning and multi-step inference. However, these approaches remain centered on general natural language-to-regex translation and lack mechanisms to handle the unique challenges of security contexts: IOC variants exhibit adversarial variations intentionally designed to evade detection; there is a requirement for balancing precision with generalization to catch attack variations; and there is a requirement to maintain operationally meaningful capture groups for downstream SIEM integration. Furthermore, unlike general regex generation tasks, where training examples are abundant, real-world IOCs are scarce, sensitive, and constantly evolving, making it infeasible to collect large sets of positive and negative examples for data-driven learning approaches such as supervised training or model fine-tuning. Consequently, a clear gap exists between the existing regex

Read the complete text