Argo: Efficient Importance Labeling for Enterprise Email Systems
Siddhant Ray, Ganesh Ananthanarayanan, Kevin Chian, Yan Guo, Cristina St Hill, Jack W. Stokes, Victor Wang, Junchen Jiang · 2026
Read Argo: Efficient Importance Labeling for Enterprise Email Systems by Siddhant Ray, Ganesh Ananthanarayanan, Kevin Chian, Yan Guo, Cristina St Hill, Jack W. Stokes, Victor Wang, Junchen Jiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21604.txt.
Introduction
Siddhant Ray and co-authors present Argo, efficient importance labeling for enterprise email systems. Email importance tagging has long been a key yet hard problem. Traditional methods such as keyword matching, user-defined rules, and sender-based rules demand heavy manual feature work and fail to scale or to carry over well. Recent large language models offer deep context grasp and better tagging quality. But using models like GPT-4.1 at enterprise volumes incurs high compute costs, driving other tagging schemes near GPT-4.1 quality.
Catalog record
| CREATOR | Siddhant Ray, Ganesh Ananthanarayanan, Kevin Chian, Yan Guo, Cristina St Hill, Jack W. Stokes, Victor Wang, Junchen Jiang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58506 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.21604
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Argo: Efficient Importance Labeling for Enterprise Email Systems Siddhant Ray, Ganesh Ananthanarayanan, Kevin Chian, Yan Guo, Cristina St Hill, Jack W. Stokes, Victor Wang, Junchen Jiang Abstract . Email importance labeling has long been a critical yet challenging problem for businesses and individuals. Traditional approaches—such as keyword matching, user-defined rules, and sender-based heuristics—demand extensive manual feature engineering and fail to scale effectively or generalize. Recent advances in large language models (LLMs) demonstrate strong potential and a natural fit for this task, offering deep contextual understanding and superior labeling quality. However, using LLM models like GPT-4.1 at enterprise email volumes incurs prohibitive computational costs and hinders real-world deployment. We explore the trade-off space of using alternative labeling schemes as opposed to GPT4.1 scale LLMs, with the goal of achieving near-GPT-level labeling quality with significantly lower cost. We develop Argo, an enterprise-email labeling framework, where we construct a profiler to efficiently search the cost-quality tradeoff-space of labeling and identify cost-efficient alternatives to labeling emails. Additionally, we design an on-demand provisioning scheme to intelligently scale Argo with real-time load, to minimize cost-increases during peak-load inference. Over 3 open-source email datasets, Argo achieves 148-167 × \times inference cost reduction with negligible quality degradation and 20-640000 × \times lower profiling costs, making large-scale,context-aware email labeling practical for enterprises. 1. Introduction Email importance labeling streamlines both personal and organizational email workflows by directing user attention toward urgent tasks and time-sensitive messages while pushing low-value correspondence out of the critical path ( 27 ; 6 ) . It improves continuity by making important messages and threads easier to track and revisit, and enables cleaner task management by organizing action items and related data into appropriate folders ( 12 ) . Reliable and accurate email importance labeling on user inboxes boosts employee productivity, improves workflows and enables efficient time management for the employees and the businesses. Email labeling is a long-standing, well-studied problem, with early systems relying heavily on manually engineered features to approximate message importance ( 27 ; 6 ) . Classical schemes are fundamentally limited: simple keyword-matching approaches ( e.g., detecting “urgent”) lack contextual understanding and produce low-quality labels ( 63 ) . Systems using sender-side engineered features ( e.g., sender importance) or email properties ( e.g., CC-list structure or message length) ( 12 ; 52 ) , provide stronger but incomplete signals. These heterogeneous signals demand extensive manual feature selection, which does not scale across large, combinatorial feature subsets. This makes learning email importance labeling inherently limited by the underlying feature engineering complexities ( 62 ; 66 ; 2 ) . Earlier works also heavily focused on spam filtering, which removed irrelevant emails and reduced inbox clutter ( 41 ; 63 ) , importance labeling for emails is complementary, focusing on boosting productivity. We revisit enterprise-level email-importance labeling in the era of highly expressive large language models (LLMs). LLMs are a natural fit for this task: state-of-the-art language modeling provides deep contextual understanding, enabling substantially higher-quality labeling than classical feature-engineered systems. Modern LLMs are trained extensively on large text corpora for text generation and reasoning tasks, making them particularly well-suited for enterprise-level email labeling. As email content is almost entirely natural language ( e.g., limited metadata such as timestamps are not), LLMs can operate directly on the raw input without requiring manual featurization or combinatorial feature selection. This eliminates the need to engineer sender-signals, structural properties, or keyword heuristics, and allows the model to infer relevance and intent from the semantic context. A reliable and well-integrated labeling feature strengthens an enterprise-email client’s competitiveness, increases user adoption and retention and ultimately supports revenue growth ( 33 ) . Given this, leading email clients are looking to adopt such labeling solutions and the industry trends already showcase labeling methods for similar applications ( e.g., Apple’s iMessage ( 3 ) ). We carry out this work with a leading email service deploying such solutions in production, who we will refer to as anon_mail for the remaining paper. Figure 1 . At real-scale and increasing email exchange volumes, cost of labeling with LLMs becomes prohibitive However, enterprise-level email workloads have extremely high volumes. Figure 1 (a) shows the number of emails being exchanged per day across the world and Figure 1 (b) shows the increasing number of email users over the last decade. While LLMs like GPT4.1 ( 13 ) offer superior labeling quality compared to classical methods, running labeling with an LLM at this scale leads to prohibitive running costs and resource utilization, making it infeasible to naively use it for generating every email label. Leading email providers like anon_mail , while desiring such labeling quality, are balking at the cost of labeling at this scale ( e.g., GPT4.1 labeling leads to labeling costs of 5-10 billion USD per month at current email volumes). Given this, we ask the question, how do we build an efficient system which achieves the best quality-cost tradeoffs for email labeling by intelligently balancing quality and cost? Further, as real-time email arrival loads vary significantly over time, we need efficient resource provisioning to allow deployed enterprise-level email to label efficiently at peak load, without incurring significantly increased costs. We have adapted lower-cost alternative systems to LLMs to use for email labeling, using either cascades of Small Language Models (SLMs) ( 54 ; 18 ; 32 ) or trained classifiers based text embeddings ( 7 ; 50 ; 61 ) (more in § 3.2 and 3.3 ). However, these systems have multiple knobs ( e.g., which SLMs to use, different labeling requirements etc.) which leads to an extremely large search space (> 100M configurations, more in § 3.4 ) over heterogeneous email sets. To utilize such systems for achieving best cost-quality tradeoffs for labeling, we need to design an efficient profiler to navigate the search space and manage inference cost. We introduce Argo, which has (a) an efficient profiler to select labeling methods achieving best quality-cost tradeoffs and identify a Balanced point for optimal tradeoff and (b) a resource-provisioning scheme to minimize cost increases under peak email load. Unlike several traditional profiler-based systems, messaging workloads like emails, do not have clear spatial or temporal insights to be utilized for profiling ( e.g., in contrast, several video analytics profiling systems ( 21 ; 24 ; 68 ; 65 ) relied on such properties). Argo identifies a novel insight, the characteristics and needs of the email labels can be used as a signal to profile and choose the labeling method. These characteristics provide clear input groupings and allow us to make offline-profiled static choices for parameters at runtime. For example, the complexity of labels ( e.g., binary vs non-binary) allows Argo to decide the choice of the labeling method for assigning its final value (more in § 3 and 4 ). Argo allows a dynamic choice between both a cascade built of Small Language Models (SLMs) with increasing expressiveness and a lightweight embedding-trained classifier, to assign labels to the emails based on the characteristics of the label. Offline profiling on a calibration set of emails allows Argo to decide the appropriate label-method match. Additionally, Argo’s profiler provides all necessary details on the choice of SLMs in the cascade, the confidence thresholds used to determine the correct