A Modular LLM Framework for Explainable Price Outlier Detection
Shadi Sartipi, John Wu, Sina Ghotbi, Nikhita Vedula, Shervin Malmasi · 2026
Read A Modular LLM Framework for Explainable Price Outlier Detection by Shadi Sartipi, John Wu, Sina Ghotbi, Nikhita Vedula, Shervin Malmasi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20636.txt.
Introduction
Sartipi and co-authors use language models to spot wrong prices in retail product lists. Bad prices hurt sales, revenue, and shopper trust. Old tools set simple thresholds and ignore product details. Their system first finds price relevant look alike products. It then scores the target against each match on brand, size, and features. A final step merges these notes into a clear verdict. The system matched human auditors over 75 percent of the time.
Catalog record
| CREATOR | Shadi Sartipi, John Wu, Sina Ghotbi, Nikhita Vedula, Shervin Malmasi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38613 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20636
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Modular LLM Framework for Explainable Price Outlier Detection Shadi Sartipi, John Wu, Sina Ghotbi, Nikhita Vedula, Shervin Malmasi Abstract Detecting product price outliers is important for retail and e‑commerce stores as erroneous or unexpectedly high prices adversely affect competitiveness, revenue, and consumer trust. Classical techniques offer simple thresholds while ignoring the rich semantic relationships among product attributes. We propose an agentic Large Language Model (LLM) framework that treats outlier price flagging as a reasoning task grounded in related product detection and comparison. The system processes the prices of target products in three stages: (i) relevance classification selects price‑relevant similar products using product descriptions and attributes; (ii) relative utility assessment evaluates the target product against each similar product along price influencing dimensions (e.g., brand, size, features); (iii) reasoning‑based decision aggregates these justifications into an explainable price outlier judgment. The framework attains over 75% agreement with human auditors on a test dataset, and outperforms zero‑shot and retrieval based LLM techniques. Ablation studies show the sensitivity of the method to key hyper-parameters and testify on its flexibility to be applied to cases with different accuracy requirement and auditor agreements. 1 Introduction Sharp pricing is essential for fair competition and consumer trust in large-scale e-commerce, and has motivated recent work in accurate price distribution estimation ( 29 ) . Pricing errors can lead to significant financial losses, customer service contacts, and negative publicity ( 17 ) . Anomaly detection methods from the broader literature provide foundational techniques including statistical approaches ( 19 ; 4 ) , density estimation methods ( 5 ) , support vector-based novelty detection ( 23 ) , and tree-based isolation methods ( 12 ) . However, when applied to pricing contexts, these approaches face critical limitations like relying on heuristic thresholds that provide no rationale for why a price is considered an outlier, making them unsuitable for audit-critical retail systems ( 20 ; 15 ) . Existing approaches for identifying comparable products in e-commerce face several challenges. While recent advances in product description generation and question-answering systems have improved customer experience ( 27 ; 30 ) , embedding-based retrieval and product matching systems still struggle to capture price-relevant semantic relationships ( 28 ; 18 ) . These challenges include data heterogeneity, varying levels of data quality, and difficulty in representing products with missing specifications ( 28 ; 18 ) . Products retrieved based on similarity may differ in key price-influencing attributes such as pack size, brand tier, or functionality, introducing noise into pricing decisions. To overcome this, human auditors first identify truly comparable substitutes, then weigh value dimensions like brand, quantity, and feature richness before deciding whether a deviation is justified ( 17 ) . Recent advances in LLMs offer a promising approach to automate this human-like reasoning process. LLMs demonstrate strong contextual understanding, utilizing multiple tools and chain-of-thought reasoning ( 33 ; 24 ; 31 ) . Retrieval-augmented and graph-augmented frameworks further enhance multi-entity grounding ( 11 ; 6 ) , while enterprise-grade models such as Claude Sonnet and OpenAI o3 emphasize cost efficiency and reliability for real-world deployment ( 2 ; 1 ; 16 ) . The capabilities of these approaches motivate treating price anomaly or outlier detection as a structured reasoning task that mirrors human audit logic in selecting semantically relevant products, assessing relative utility across product-value dimensions, and generating an interpretable rationale. To our knowledge, no existing automated system emulates this multi-step reasoning process for price anomaly detection. In this study, we propose an agentic 1 1 1 We use “agentic” to refer to multi-step LLM architectures with specialized reasoning modules that decompose complex objectives into interpretable sub-tasks, consistent with recent literature ( 33 ; 31 ) . Our framework involves sequential coordination between modules rather than dynamic inter-agent communication. LLM framework for explainable price-outlier detection focused on too high prices. Our framework consists of three specialized agents chaining processing in three steps. They explicitly model the factors human auditors would consider. (i) Step one performs Relevance Classification by using product details and structured attributes to identify product candidates similar to or substitutes for the target product, which we refer to henceforth as neighbors . (ii) Step two conducts Relative Utility Assessment , reasoning about key price-influencing attributes such as brand, unit size, and other feature values. (iii) Step three aggregates the above evidence into a Reasoning-Based Decision with a justification for outlier understanding. We evaluate our proposed framework on products spanning several categories which achieves 76.3% agreement with human expert annotations and reduces the false-discovery rate to 7.8%. Moreover, detailed ablation studies on challenging test cases show that the count of neighbor products, price padding thresholds, and product attribute selection process can affect performance. Beyond pricing, this formulation can potentially extend to adjacent applications such as product matching and fraud detection, contributing to the broader adoption of trustworthy AI. Figure 1: Overview of our proposed agentic framework. We investigate four attribute selection configurations with the Utility Agent (Generic, Static, Dynamic, or W-Dynamic), detailed further in Section 3.3 . Application contribution : Price outlier detection directly impacts revenue and consumer trust at scale. Our framework achieves a high agreement with human auditors while providing transparent justifications, a capability absent from existing statistical methods (e.g., IQR, Z-score) and rule-based systems. The explainability enables human auditors to verify and override decisions efficiently. 2 Related Work 2.1 Price Anomaly Detection Classical anomaly detection methods rely on univariate thresholds ( 15 ) and multivariate techniques such as Isolation Forest, Local Outlier Factor, and deep autoencoders ( 21 ) . While effective at capturing statistical irregularities, these approaches remain largely black-box with limited interpretability, unable to explain which neighbors are compared, and why the data density differs. Industrial pricing systems have attempted to address this through retrieving substitute and similar products combined with rule-based scoring ( 17 ; 22 ) , yet these solutions still lack human-readable rationales for detected anomalies and heavily rely on hard-coded rules. In ( 22 ) , the authors developed a high price anomaly detection system for a growing marketplace platform, leveraging three modular components to engineer features, detect feature-level anomalies, and build reliable item price estimates. Recent surveys on out-of-distribution detection and dynamic graph anomalies ( 32 ; 7 ) highlight the growing need for contextual, structure-aware detectors. These challenges are particularly relevant for e-commerce systems with non-stationary product catalogs and evolving catalog dynamics. We applied this motivation by integrating semantic reasoning with natural language explanations directly into our anomaly detection pipeline, enabling accurate detection and interpretable justification of pricing anomalies. 2.2 Agentic LLM Architectures Instruction-tuned LLMs exhibit strong chain-of-thought reasoning and tool-use capabilities ( 33 ; 24 ; 31 ) . These agentic architectures decompose complex objectives into interpretable sub-tasks, enabling multi-step problem solving with intermediate reasoning steps for audit and control. Recent surveys highlight their application across planning, decision-making, and interactive environments ( 31 ) , though adoption in enterprise backend systems like pricing remains limited. Recent work has also explored LLMs for anomaly and outlier detection across various domains ( 25 ) . 2.3 RAG for Structured Data Retrieval-augmented Generation (RAG) improves LLMs’ factual grounding by incorporating external knowledge ( 3 ) . Graph-augmented retrieval extends this to entity-aware summarization over