Characterizing the Impact of Active Queue Management on Speed Test Measurements

Siddhant Ray, Taveesh Sharma, Jonatas Marques, Paul Schmitt, Francesco Bronzino, Nick Feamster · 2025

Read Characterizing the Impact of Active Queue Management on Speed Test Measurements by Siddhant Ray, Taveesh Sharma, Jonatas Marques, Paul Schmitt, Francesco Bronzino, Nick Feamster (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19213.txt.

Introduction

Siddhant Ray and five co-authors test how internet speed tools behave when a network manages its queues actively. Modern tools from NDT, Ookla, and Cloudflare now report latency under load, not just peak speed. Active queue management, or AQM, controls waiting lines inside routers, yet its effect on those new scores was poorly understood.

Controlled lab experiments compare three AQM schemes, CoDel, FQ-CoDel, and Stochastic Fair Queuing, against a plain drop-tail baseline. Throughput and latency scores vary widely across schemes and load levels. The authors warn that speed test platforms need careful calibration before their latency scores guide policy or regulation.

Catalog record

CREATORSiddhant Ray, Taveesh Sharma, Jonatas Marques, Paul Schmitt, Francesco Bronzino, Nick Feamster
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-19213

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Characterizing the Impact of Active Queue Management on Speed Test Measurements Siddhant Ray, Taveesh Sharma, Jonatas Marques, Paul Schmitt, Francesco Bronzino, Nick Feamster Abstract . Present day speed test tools measure peak throughput, but often fail to capture the user-perceived responsiveness of a network connection under load. Recently, platforms such as NDT, Ookla Speedtest and Cloudflare Speed Test have introduced metrics such as “latency under load” or “working latency” to fill this gap. Yet, the sensitivity of these metrics to basic network configurations such as Active Queue Management (AQM) remains poorly understood. In this work, we conduct an empirical study of the impact of AQM on speed test measurements in a laboratory setting. Using controlled experiments, we compare the distribution of throughput and latency under different load measurements across different AQM schemes, including CoDel, FQ-CoDel and Stochastic Fair Queuing (SFQ). On comparing with a standard drop-tail baseline, we find that measurements have high variance across AQM schemes and load conditions. These results highlight the critical role of AQM in shaping how emerging latency metrics should be interpreted, and underscore the need for careful calibration of speed test platforms before their results are used to guide policy or regulatory outcomes. 1. Introduction Internet performance has historically been summarized using a single number: “speed” ( 4 ; 26 ; 11 ) . Despite their widespread utility, traditional measurements that focus on peak bandwidth ( i.e., link capacity) fail to capture user-perceived Quality of Experience (QoE). For many interactive applications (e.g., remote collaboration, gaming, video conferencing), QoE is determined not by the maximum attainable rate but by the available bandwidth and latency under load, which conventional full-capacity speed tests do not accurately reflect. However, the interpretation and use of these metrics has not been standardized. For instance, NDT ( 25 ) , reports average throughput and some aggregated measurements of total bytes transferred during the test. Ookla defines “working latency” as the increase in round-trip time (RTT) under load compared to the unloaded RTT, measured during a speed test ( 10 ) . Apple uses a different metric, called round trips per minute (RPM) under load, which counts the number of round trips completed during a fixed time interval while the connection is saturated ( 31 ) . Further, these tests have been known to discard outliers that often correspond to glitches that users typically notice during real-time applications such as video conferencing and streaming ( 10 ) . As a result, users and regulators are left with incomplete pictures of what causes an Internet connection to be unresponsive, and how it can be mitigated. A central, unanswered question is how traditional metrics such as throughput and latency, and new metrics such as LUL, behave in the presence or absence of active queue management (AQM) algorithms such as FQ-CoDel, which were explicitly designed to maintain low latency under load ( 18 ) . While AQM has been widely studied in the context of TCP performance, its impact on speed test measurements remains underexplored. Given that AQM deployment is steadily increasing 1 1 1 Based on conversations with leading ISP vendors in the United States. , understanding this relationship is crucial for both network operators and end-users to accurately assess and improve their internet experience. In this paper, we investigate how the empirical distribution of modern speed test measurement results shifts when an AQM is deployed. Rather than reporting only typical throughput (e.g., mean) and latency values (e.g., 90^{th} percentile, median), we analyze full distributions: the tails, the spikes, and metrics similar to “glitches per minute” ( 10 ) that are most relevant to real-time applications. Our goal is to empirically characterize the difference between unmanaged queues and AQM-enabled network paths, and to highlight how this difference is (or is not) reflected in widely deployed measurement platforms. By doing so, we aim to inform both test designers and network operators of the gaps between the status quo of Internet measurement and the actual experience of end-users. In summary, our contributions are as follows: \bullet We conduct a measurement study with a popular speed test tool (NDT) ( 25 ) across varying AQM algorithms and network conditions to analyze impact of such policies and link load on speed test measurements. \bullet We show that traditional speed test metrics such as averaged throughput and latency can mask significant variations in user-perceived speed and responsiveness and believe that our findings should help inform the design of future speed test tools should consider network conditions and AQM policies to report more interpretable metrics. 2. Background 2.1. Active Queue Management (AQM) AQM techniques have been an active area of research and deployment for the past few decades to reduce latency and bufferbloat ( 14 ) and to ensure fairness and coexistence among TCP flows on the shared network links. Traditional AQM algorithms have been built to run in conjunction with TCP congestion control algorithms, which rely only on packet loss as a signal for congestion. To handle the bursty nature of TCP, these AQM techniques are equipped with large data buffers to prevent excessive packet drops due to these bursts. However, bufferbloat arises when queue length grows unbounded, specifically if the buffers are increasingly large, the packets end up being queued in much deeper queues, leading to excessive queuing latency. latency can often build up as a result of individual bufferbloats at multiple routers on the network path. AQM techniques such as Random Early Detection ( 12 ) , CoDel ( 29 ) and FQ-CoDel ( 16 ) have been designed to reduce latency and bufferbloat, by actively managing the queue lengths by dropping packets before the queue becomes full. Other techniques such as Stochastic Fair Queuing (SFQ) ( 23 ) and Deficit Round Robin (DRR) ( 42 ) aim to provide fairness among competing flows by ensuring equal bandwidth allocation. AQM techniques such as Proportional Integral controller Enhanced (PIE) ( 32 ) , CAKE ( 17 ) and Low Latency, Low Loss, Scalable Throughput (L4S) ( 40 ) have been proposed to provide low latency and high throughput for modern applications such as video streaming and online gaming. These recent advances in AQM suggest that integrating design principles bufferbloat and fairness (e.g., CAKE and L4S), which can yield significant performance improvements over other traditional AQM techniques. CAKE emphasizes deployability in heterogeneous consumer environments by incorporating bandwidth shaping, per-flow and per-host fairness, DiffServ awareness, and optional TCP ACK filtering to mitigate asymmetry and NAT-induced complexity. L4S introduces a congestion control framework based on Explicit Congestion Notification (ECN) signaling and shallow queuing, enabling sub-millisecond latency and high throughput when paired with responsive transport protocols. These AQM techniques are being widely adopted in various network devices ( 38 ; 47 ) , including home routers, enterprise networks, and data centers, to improve network performance and user experience. However, measuring the impact of AQM techniques by speed test measurement tools remains underexplored due to the lack of standardized methodologies and metrics to evaluate their overall performance. 2.2. Speed Test Measurement Tools A variety of speed test measurement tools are commonly employed to assess end-to-end network performance. The Measurement Lab’s Network Diagnostic Tool (NDT) ( 25 ; 24 ) is a widely deployed

Read the complete text