FAME: Failure-Aware Mixture-of-Experts for Message-Level Log Anomaly Detection
Huanchi Wang, Zihang Huang, Yifang Tian, Kristina Dzeparoska, Hans-Arno Jacobsen and Alberto Leon-Garcia · 2026
Read FAME: Failure-Aware Mixture-of-Experts for Message-Level Log Anomaly Detection by Huanchi Wang, Zihang Huang, Yifang Tian, Kristina Dzeparoska, Hans-Arno Jacobsen and Alberto Leon-Garcia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22779.txt.
Introduction
Wang and others move log anomaly detection from session level flags to the message at fault, sparing operators from sifting lines per alert. Their FAME framework uses a language model once offline to label at most K lines per template and propose a partition of templates into failure domains, certified before training. A router plus domain experts then runs on premise, outputting anomaly calls and failure domain labels. On BGL data, FAME reaches an F1 near 98 while cutting annotation effort 76 fold, and on Thunderbird it reaches near 100 with recall.
Catalog record
| CREATOR | Huanchi Wang, Zihang Huang, Yifang Tian, Kristina Dzeparoska, Hans-Arno Jacobsen and Alberto Leon-Garcia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57209 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22779
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FAME: Failure-Aware Mixture-of-Experts for Message-Level Log Anomaly Detection Huanchi Wang, Zihang Huang, Yifang Tian, Kristina Dzeparoska, Hans-Arno Jacobsen and Alberto Leon-Garcia Abstract Production systems generate millions of log lines daily, yet most anomaly detectors operate at the session or window-level, flagging groups of lines rather than identifying the specific message responsible. This coarse granularity forces operators to inspect many routine lines per alert. Message-level detection offers finer granularity, but remains challenging. A single event template may correspond to both normal and anomalous messages, failures arise from heterogeneous subsystems, and line-level labeling at scale is impractical. Although large language models (LLMs) can reason over log semantics, applying them to every line is too costly for continuous monitoring. We present FAME ( F ailure- A ware M ixture-of- E xperts), a label-efficient message-level mixture-of-experts framework that uses an LLM only once offline. We annotate at most K K labeled lines per template to derive binary normal/anomaly indicators and representative examples. The LLM proposes a partition of templates into failure domains, and a certification step validates the proposal before training. FAME trains a lightweight router and domain experts that run on-premise and output anomaly predictions and failure-domain labels. On BGL, FAME achieves F 1 = 98.16 F_{1}=98.16 at K = 100 K=100 reducing annotation effort by 76 × 76{\times} and detects 86.3% of anomalies from unseen EventIDs. On Thunderbird, FAME reaches F 1 = 99.95 F_{1}=99.95 with perfect recall. I Introduction Modern distributed systems generate tens of thousands of log lines per hour across heterogeneous components such as kernels, storage controllers, schedulers, and application services [ 26 ] . These messages record execution events, state transitions, warnings, and errors, forming the primary foundation for runtime observability. Anomalies that signal hardware faults, process crashes, or service degradation are typically rare, often accounting for less than 5\% of generated lines. This severe class imbalance makes fine-grained log anomaly detection a persistent operational challenge [ 34 ] . Most deployed log anomaly detectors operate at the window- or session-level , assigning a single anomaly label to a contiguous group of lines delimited by a session key or a fixed time window [ 13 , 8 , 30 ] . While computationally convenient, this granularity imposes substantial downstream cost. A window-level alert localizes suspicion to a region rather than a specific message , and dismissing a false alarm typically requires reviewing hundreds of routine log lines. In one production setting that motivates our work (hereafter “Company A”), each false-positive window forces a manual review of roughly 300 interleaved lines, consuming on the order of 2.5 engineer-hours before clearance. Under realistic alarm rates, the cumulative review cost of false positives can exceed the investigation budget for genuine incidents. Figure 1 contrasts the two granularities. Fig. 1: Window-level vs message-level in log anomaly detection More broadly, in interleaved production streams where session boundaries are weak or unavailable [ 25 ] , per-message output is often the only actionable granularity. We therefore target message-level (synonymously, line-level) anomaly detection, where each raw log message is individually classified as normal or anomalous. Three properties of production log streams make this task substantially harder than its window-level counterpart. 1. C1: Template ambiguity. A single parser-derived event template can host both benign and anomalous instances depending on parameter values. Template identity alone cannot separate normal from anomalous lines [ 23 ] . 2. C2: Heterogeneous failure modes. Production anomalies span memory errors, filesystem faults, network partitions, and software exceptions. A single global classifier must fit one decision boundary across all these populations, trading recall against precision under severe imbalance. 3. C3: Label scarcity. Labeling a production stream at message granularity requires reviewing millions of lines, an annotation effort that is impractical in most operational settings. Each major family of prior work addresses some of these properties but leaves the combined problem open. Template and feature-based detectors [ 22 , 23 , 10 ] discard parameters and conflate benign and anomalous instances of the same template (C1). Neural sequence detectors [ 8 , 30 , 13 , 20 , 44 ] aggregate evidence over a session or window, producing group-level labels that do not localize the responsible line (C1, C2). LLM-based detectors [ 35 , 3 , 4 ] reason over log semantics effectively but incur prohibitive API cost, latency, and data-egress overhead at per-line production scale (C3). Section VI develops these comparisons in detail. We present FAME ( F ailure- A ware M ixture-of- E xperts), a framework for message-level log anomaly detection built on a failure-aware mixture-of-experts (MoE) architecture. The core insight is that LLM reasoning is needed only once. During an offline setup phase, the LLM partitions parser-derived event templates into semantically coherent failure domains that group templates sharing a subsystem or failure mechanism. After this one-time partitioning, the LLM is never invoked again, and all deployment-time inference runs on lightweight on-premise models. FAME is structured as a sparse MoE with top-1 routing [ 21 , 11 ] , with two departures from the standard paradigm. First, experts are semantically grounded : each corresponds to a named failure domain proposed by the LLM, rather than emerging implicitly from end-to-end training. This decomposition addresses C2 by letting each expert fit a decision boundary over a coherent sub-population instead of the union of all failure types. Second, the architecture is asymmetric . Under K -shot sampling with a rare-anomaly prior, observing all-anomalous labels in a domain is statistically conclusive, while observing all-normal labels is not (Section II-C ). FAME exploits this asymmetry: pure-anomaly domains are resolved by routing alone, while mixed domains employ independently calibrated BERT [ 7 ] classifiers. As a byproduct, the routing label tags every detection with its failure domain, providing a diagnostic signal for downstream triage. To control annotation cost (C3), FAME requires at most K labeled lines per event template. At the best result K\!=\!100 on BGL [ 31 ] , this yields 53{,}287 labeled lines, an 76\times reduction relative to fully labeling the 4.7 M-line offline region. On Thunderbird [ 45 ] , where anomalous templates are largely disjoint from normal ones, FAME reaches F_{1}\!=\!99.95 . We report Thunderbird as a closed-world sanity check, with BGL as the primary evidence for the realistic intra-template-mixed regime. The main contributions are organized as follows: • Message-level detection with failure-domain routing. FAME produces both a binary anomaly decision and a named failure-domain label for every log line, enabling direct fault localization without session reconstruction. • Failure-aware asymmetric MoE. We formalize an asymmetric confidence property of K -shot sampling under the rare-anomaly prior, and use it to design an MoE in which pure-anomaly domains are resolved by routing alone while mixed domains employ per-message classifiers. Expert boundaries are defined by a one-time LLM partitioning and validated deterministically against K -shot labels. • Fully on-premise inference with minimal labeling. After a single offline LLM invocation, all inference runs on local models, eliminating recurring API cost and data egress. At K\!=\!100 , FAME requires 76\times fewer labels than full annotation and reaches F_{1}\!=\!98.16 (BGL) and F_{1}\!=\!99.95 (Thunderbird), processing up to 1.20 M lines/hour on a single 4-GPU node at a one-time cost of $ 10.23 versus $ 6{,}698 –$ 10{,}047 per run for frontier-LLM