Anomaly as Non-Conformity via Training-Free Graph Laplacian Energy Minimization
Jungwook Seo, Minjeong Kim, Younkwan Lee, Seungho Shin, Sungyong Baik · 2026
Read Anomaly as Non-Conformity via Training-Free Graph Laplacian Energy Minimization by Jungwook Seo, Minjeong Kim, Younkwan Lee, Seungho Shin, Sungyong Baik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28428.txt.
Introduction
Jungwook Seo and four colleagues score visual anomalies by how much a query patch must move to fit the normal pattern, not by similarity alone. For each patch they build a bipartite graph to normal patches, weighted by cosine affinity, with no edges within either side. Anomaly scoring becomes a convex Laplacian energy problem with anchored normal nodes, solved in closed form. The score is the size of the required update, and tests show strong detection, stable localization maps, and better robustness, with no learned parameters.
Catalog record
| CREATOR | Jungwook Seo, Minjeong Kim, Younkwan Lee, Seungho Shin, Sungyong Baik |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46565 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28428
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Anomaly as Non-Conformity via Training-Free Graph Laplacian Energy Minimization Jungwook Seo, Minjeong Kim, Younkwan Lee, Seungho Shin, Sungyong Baik Abstract Detecting subtle visual anomalies in images remains challenging, particularly when only normal samples are available à priori. Such unsupervised anomaly detection is typically solved by measuring feature similarity of a query patch to a memory of normal patches. However, similarity alone does not reveal how strongly a query patch violates the structure of the normal feature manifold. We propose a training-free Laplacian graph energy optimization formulation, named ANoCo that scores A nomaly by the cost of No n- Co nformity of a query patch to align with a fixed normal manifold. For each query patch, we construct a bipartite query→normal graph weighted by cosine affinity, explicitly removing query–query and normal–normal edges to prevent evidence dilution. We formulate anomaly scoring as a convex Laplacian energy with anchored normal nodes, and solve in closed form. In particular, we do not use the optimized features themselves—the anomaly score is the magnitude of the update required to satisfy normality constraints, reframing the graph Laplacian as a non-conformity operator rather than a smoothing prior. The proposed method introduces no learnable parameters, message passing, or sampling, and has complexity comparable to a single linear solve. Across standard benchmarks, it delivers strong image-level AUROC, stable localization maps, and improved robustness over prior methods, demonstrating the effectiveness of using optimization-induced feature drift as anomaly measure. 2 2 footnotetext: Corresponding author. Figure 1 : Conceptual illustration of ANoCo. ANoCo adjusts query patch features through an anchored Laplacian energy optimization, producing features that conform to the normal manifold. The magnitude of the optimization-induced feature update serves as the anomaly score, providing a simple and training-free measure of non-conformity. 1 Introduction Industrial anomaly detection aims to identify defective samples (anomalies) using only normal (defect-free) product images, since anomalies are rare, diverse, and prohibitively expensive to annotate for supervision. For fast adaptation of anomaly detection to new products, there has been growing interests in a few-shot normal regime, where only a handful of normal exemplars are available per object or category. Thus, few-shot industrial anomaly detection poses as a challenging task, which requires the capability of modeling the behavior of normality with high fidelity, while remaining sensitive to fine-grained deviations to detect anomalies. Consequently, recent research has shifted toward training-free and retrieval-based paradigms, leveraging frozen feature extractors and exemplar comparison Cohen and Hoshen 2020 ; Defard et al. 2021 ; Roth et al. 2022 ; Jeong et al. 2023 ; Xie et al. 2023 . Recent research has shin representation learning enable highly effective anomaly detectors through nearest-neighbor search in deep feature space, where abnormal patches are identified by poor similarity to the closest features in a normal memory bank Roth et al. 2022 ; Defard et al. 2021 ; Cohen and Hoshen 2020 . However, they score anomaly strictly by independent similarity to neighbors, implicitly assuming that the presence of any similar patch implies normality. This assumption breaks down when a query is individually similar to multiple retrieved normal patches, yet incompatible with the underlying structure they collectively form. In few-shot industrial settings, where normal exemplars capture multiple modes of appearance (e.g., lighting, texture, manufacturing tolerances), k -NN may retrieve a plausible neighbor set that is not mutually coherent, allowing anomalous patches to be mistakenly accepted due to fragmented or conflicting local matches. This reveals a core limitation of independent similarity scoring—it cannot detect when a query is locally plausible but globally inconsistent with the structure of the retrieved normal manifold. Meanwhile, graph-based approaches have recently been explored to model relationships beyond isolated comparisons Xie et al. 2023 ; Tao et al. 2025 . However, most adopt message passing, Laplacian smoothing, or homophily assumptions, implicitly enforcing agreement between connected nodes Li et al. 2018 ; Zhou et al. 2020 ; Zhu et al. 2020 . While effective for representation learning and semi-supervised classification Li et al. 2018 ; Kipf 2017 ; Feng et al. 2020 , these mechanisms are counterproductive for anomaly detection, as they blur deviations via neighborhood consensus and propagate evidence across queries or reference nodes Tang et al. 2022 ; Zhao et al. 2020 ; Kim et al. 2022 . This exposes a core contradiction: methods that encourage smoothness on the graph are likely to suppress exactly the signals required to detect anomalies. In this work, we shift the question from “Is this patch similar to normal?” to “How difficult is it to make this patch conform to normal?”. In other words, we argue that the key signal for anomaly is non-conformity to the retrieved normals as a structured set. We realize A nomaly as No n- Co nformity via a new framework ( ANoCo ), which is a training-free, energy-based framework that defines anomaly as the cost required to conform to a normal manifold. Notably, our proposed method retrieves similar normal patches prior to graph construction, but retrieval is not used to score anomaly—it is used only to build a reference normal manifold against which all query patches are optimized. For each query patch, retrieved normal references are then anchored (frozen) via strong penalties, forming a stable proxy for the normal manifold. We then construct a graph between all query patches and the retrieved normal patches, and solve a single convex anchored graph Laplacian energy minimization over all query patches jointly. The magnitude of change in features after optimization reveals how much each query patch must shift to align with the normal manifold, producing a direct measure of non-conformity that cannot be affected by supporting evidence from other abnormal patches in the same test image. ANoCo repurposes the graph Laplacian from a smoothing operator Belkin et al. 2006 into a non-conformity operator that measures resistance to normality, conceptually aligning anomaly with optimization cost rather than feature distance or density. ANoCo yields multiple practical benefits: (i) anomaly scores have a clear physical meaning—the energy needed to fit the normal manifold; (ii) the solution is closed-form, convex and training-free; and (iii) by avoiding smoothing and message passing, the method preserves anomaly evidence. Experimental results display the strong performance of ANoCo, demonstrating the effectiveness of our repurposed graph Laplacian in measuring non-conformity of query images to normal manifold and detecting anomalies. 2 Related work Memory-based and nearest-neighbor anomaly detection. Deep feature memory banks coupled with nearest-neighbor matching have become a strong baseline for anomaly detection. SPADE Cohen and Hoshen 2020 and PaDiM Defard et al. 2021 demonstrate the effectiveness of patch-level representation matching for localization. PatchCore Roth et al. 2022 further shows that core-set based memory retrieval achieves state-of-the-art performance at scale. Subsequent work expands upon adaptive neighborhood aggregation and improved similarity metrics Bae et al. 2023 ; Nizan and Tal 2024 ; Lee et al. 2024 . However, these approaches score each query independently, without explicitly reasoning about collective compatibility with a normal manifold. By contrast, our method maintains the memory-based paradigm but evaluates the joint conformity of a query to normal manifold through a graph-induced energy, rather than via isolated nearest-neighbor matching. Graph models for anomaly detection. Graph-based anomaly detection has been explored under several settings: (i) Graph Neural Network (GNN)-based representation learning, where message passing is used