AESOP: Adversarial Execution-path Selection to Overload Deep Learning Pipelines
Tingxi Li 1 , Mingfang Ji 2 , Ravishka Shemal Rathnasuriya 1 , Simin Chen 1 , Yitao Hu 2 , Wei Yang 1 · 2026
Read AESOP: Adversarial Execution-path Selection to Overload Deep Learning Pipelines by Tingxi Li 1 , Mingfang Ji 2 , Ravishka Shemal Rathnasuriya 1 , Simin Chen 1 , Yitao Hu 2 , Wei Yang 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10987.txt.
Introduction
Tingxi Li and five colleagues expose an efficiency attack on dynamic deep-learning pipelines, where upstream predictions decide downstream workload. Because cost depends on both per-model price and how much work each component triggers, path choice becomes an attack surface that single-model attacks cannot reach.
Their AESOP framework ranks execution paths by vulnerability and weights losses adaptively to steer inputs down the costliest routes. Given the same inputs and budgets, path-aware targeting pushes compute up by more than two thousand times, versus roughly a hundredfold for the best single-model baseline. Tests across five pipelines plus a production-like variant with batching, buffering, and threshold defenses confirm the gap. Pipeline operators get a warning and a method to hunt their own costliest paths.
Catalog record
| CREATOR | Tingxi Li 1 , Mingfang Ji 2 , Ravishka Shemal Rathnasuriya 1 , Simin Chen 1 , Yitao Hu 2 , Wei Yang 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70064 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10987
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AESOP: Adversarial Execution-path Selection to Overload Deep Learning Pipelines Tingxi Li 1 , Mingfang Ji 2 , Ravishka Shemal Rathnasuriya 1 , Simin Chen 1 , Yitao Hu 2 , Wei Yang 1 Abstract Modern machine learning deployments increasingly compose specialized models into dynamic inference pipelines, where upstream components produce intermediate predictions that determine the workload and inputs of downstream components. The cost of processing an input is therefore not determined by any single model, but by two coupled factors: the per-inference cost of each invoked component and its workload volume. Because these pipelines run under hard real-time constraints, efficiency is a fundamental requirement for system availability. We show that this structure creates an efficiency-attack surface that existing methods targeting single models cannot exploit: on identical inputs and budgets, path-aware targeting inflates FLOPs by 2,407 × 2,407\times while the strongest single-model baseline achieves 117 × 117\times — a 20 × 20\times gap attributable entirely to where the attack is directed. We formalize this as the adversarial path-selection problem and present AESOP , a framework combining vulnerability-guided path ranking with adaptive loss weighting. We evaluate AESOP on five pipelines plus a production-realistic deployment variant with batching, bounded buffering, and confidence-threshold defenses. AESOP achieves up to 2,407 × 2,407\times FLOPs and 419 × 419\times latency inflation in white-box setting and 58 × \times FLOPs / 17 × \times latency in gray-box settings. Under system-level defenses, the attack is not neutralized but redirected: pipelines are forced to choose between throughput collapse ( 0.578 → 0.006 0.578\to 0.006 input/s) and 96.7 % 96.7\% data loss to sustain throughput. I Introduction While large language models (LLMs) represent a notable shift toward end-to-end architectures, most production machine learning systems — such as video analytics, autonomous driving, content moderation, and surveillance — are still built as multi-model pipelines. Within these pipelines, specialized models are connected by producer-consumer dataflow, where each handles a distinct subtask and forwards its output downstream [ 34 , 18 , 13 , 20 , 44 ] . This architecture offers modular reuse of pre-trained components, flexible composition of heterogeneous pipeline topologies, and independent scaling of individual stages [ 9 ] . Major inference platforms now provide first-class support for pipeline orchestration [ 27 ] , and recent surveys have documented the prevalence and growing importance of multi-model pipeline deployments across edge devices, cloud serving systems, and safety-critical applications [ 40 , 1 , 3 ] . Because these pipelines run under hard real-time constraints, latency is not merely a performance metric but a determinant of availability. In a traffic monitoring pipeline of the kind proposed in recent multi-model designs [ 2 , 22 ] , which chain specialized models for vehicle detection, license-plate recognition, and downstream identification on edge hardware, an adversarial input can stretch end-to-end inference from 45 ms to 13.6 s per frame, at which point frame dropping becomes systemic and detection coverage degrades to operational failure [ 32 ] . In a wildlife conservation pipeline following the two-stage detection-then-classification architecture established for camera-trap monitoring [ 26 , 12 ] , the same class of input drives latency from 21 ms to 8.8 s and inflates per-image energy from 0.04 J to 1720 J, compressing operational autonomy by orders of magnitude [ 42 , 8 ] . In an Amber Alert pipeline modeled on the missing-child face-recognition and age-estimation systems studied by Deb et al. [ 10 ] and Dehghan et al. [ 11 ] , alert-generation latency stretches from 5 s to 25 s, eroding responsiveness in exactly the window the system is designed to operate, where speed of dissemination is the primary determinant of recovery outcomes [ 14 ] . In each case, an adversary who inflates pipeline cost defeats the system’s availability guarantee — the timely production of correct outputs — placing efficiency squarely alongside integrity and confidentiality. Fig. 1 : Execution paths in a dynamic deep learning pipeline. A gating decision g(y_{1}) on the output of M_{1} partitions inputs across three branches with distinct downstream costs. A growing body of work studies adversarial efficiency attacks on dynamic deep learning models, whose per-inference cost and output cardinality are input-dependent — for example, early-exit networks, object detectors, and text-generation models [ 35 , 33 , 4 , 24 , 23 , 6 , 16 , 15 , 28 , 29 ] . Across this literature, however, the attack surface is consistently a standalone model: the adversary crafts a perturbation that maximizes cost within one neural network’s computation graph, whether by inflating non maximum suppression (NMS) survivors, delaying EOS tokens, or suppressing early-exit triggers. This single-model assumption matters in pipelines: the cost of processing an input is not determined by how expensive any one model becomes; it is determined by which execution path the input activates. Figure 1 illustrates this: a gating decision after model M_{1} partitions output set y_{1} into three subsets \{y^{a}_{1},y^{b}_{1},y^{c}_{1}\} , each propagate through a distinct branch — y^{c}_{1} exits the pipeline early while y^{a}_{1} and y^{b}_{1} are processed by M_{2} and M_{3} respectively. Each branch therefore incurs a different cost, and both the per-inference cost of M_{2} and M_{3} and the size of each subset are themselves input-dependent and exploitable [ 4 , 6 , 28 ] . The pipeline’s worst-case cost is bounded by its most computationally intensive path, and an adversary who can steer inputs into that path realizes the worst case at will. Existing attacks have no mechanism to reason about routing: they fix a target model in advance, which succeeds locally when that model is the only dynamic stage, and fails globally when multiple dynamic stages and execution paths coexist. We confirm this empirically: on identical inputs and identical perturbation budgets, the strongest single-model baseline achieves 117 \times FLOPs amplification while a path-aware attack achieves 2,407 \times , a 20 \times gap caused by the missing algorithmic primitive: the ability to choose which path to attack. We formalize this primitive as the adversarial path-selection problem and present AESOP , the first efficiency-attack framework that solves it. AESOP decomposes the attack into two coordinated decisions that prior work treats as one. First, vulnerability-guided path ranking profiles per-module cost, output cardinality, and gating behavior, then enumerates execution paths and ranks them by a vulnerability score that quantifies the cost amplification each path would incur under adversarial inputs. Second, adaptive loss weighting generates the perturbation against the selected path with loss terms whose weights are set by each module’s contribution to the path’s vulnerability score. The framework is separable from the perturbation backend: any current or future single-model efficiency attack can serve as the per-module perturbation step, with AESOP supplying the system-level decisions that single-model attacks structurally cannot make. We evaluate AESOP on five pipelines spanning traffic monitoring, wildlife conservation, smart-home alerting, expressway surveillance, and Amber Alert generation, plus a production-realistic deployment variant of the traffic pipeline with batched inference, bounded inter-module buffering, and confidence-threshold filtering. AESOP achieves up to 2,407 \times FLOPs and 419× latency inflation in the white-box setting and 58 \times × FLOPs and 17 \times latency in a gray box transfer setting. Under deployed system-level defenses, the attack is not neutralized but redirected: confidence thresholding fails because AESOP produces high-confidence