MM-INT : Telemetry in Programmable Switches with Multiple Queues using Source-based Multipath Routing

Mateus N. Bragatto 1, João Paulo M. Clevelares 2, Cristina K. Dominicini 3 · 2025

Read MM-INT : Telemetry in Programmable Switches with Multiple Queues using Source-based Multipath Routing by Mateus N. Bragatto 1, João Paulo M. Clevelares 2, Cristina K. Dominicini 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11231.txt.

Introduction

Mateus Bragatto and co-authors presented this 2025 system for watching queues inside network switches. Modern switches can report their own state through in-band telemetry, tiny probes riding with data. Older designs assume one queue per port, which real switches outgrew. Their system, MM-INT, stores data from every queue and port in registers for efficient collection.

To avoid flooding the network with probes, the system routes them from their source along multicast trees. Tests showed big cuts in the number of probes sent versus standard methods. Queue state matters because backups inside switches are where delays and drops are born. The work gives network operators a lighter way to keep eyes on congestion.

Catalog record

CREATORMateus N. Bragatto 1, João Paulo M. Clevelares 2, Cristina K. Dominicini 3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-11231

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MM-INT : Telemetry in Programmable Switches with Multiple Queues using Source-based Multipath Routing Mateus N. Bragatto 1, João Paulo M. Clevelares 2, Cristina K. Dominicini 3 Abstract This article emphasizes the importance of queues associated with the ports of switches in network monitoring. Traditionally, data collection about these queues is done using programmable data planes and telemetry based on INT (In-band Network Telemetry) probes, assuming there is only a single queue per output port. The MM-INT (Multiqueue Multicast - INT) is a solution that utilizes registers to store data from all queues and ports, enabling the efficient collection of monitoring information. The MM-INT avoids probe overload and employs the origin-based routing mechanism and multicast trees for the probes. The results demonstrate significant reductions in the number of probes sent compared to other traditional solutions found in the literature. 1 Introdução In network switches, queues are associated with the device’s ports and represent an important source of monitoring information, as they can indicate the level of network congestion [ Kim et al. 2018 ] . Moreover, their occupancy level can affect other metrics, such as response time, transmission delay, and jitter. However, collecting data about the queues in real time has always been a high-cost task due to the overhead generated in the network and the devices [ Arslan and McKeown 2019 ] . Nevertheless, this scenario has changed in recent years thanks to the popularization of programmable data planes, with the P4 language, and monitoring with in-band telemetry based on INT (In-band Network Telemetry) probes. In this context, INT telemetry instructions direct the collection of fine-grained metrics on network devices, with low granularity and high frequency, allowing network operators to obtain a clearer picture of the network state from their devices. However, the existing works in the literature currently focus on collecting performance metrics from network interfaces, assuming that there is only a single queue per output port. However, in more recent programmable devices, there are at least 8 queues associated with each port, and in some more modern equipment, this number can reach up to 128 queues. This number of queues is extremely useful, as different classes of network flows can be used, each queue with a different quality of service. The main challenge when multiple queues are present is related to the fact that, traditionally, a single probe is capable of collecting telemetry only from the queue it traverses, which is associated with the forwarding output port of the probe. Therefore, if a port has two queues, two probes would need to be sent in order to monitor all those queues. To monitor all the queues of all ports of each switch in the network, a prohibitive increase in probes would be required, raising the monitoring overhead. In this context, this paper presents MM-INT (Multiqueue Multicast - INT), a solution capable of collecting information from all queues of each physical port of a programmable switch using the P4 language. In summary, the solution developed in this work uses registers to store the metadata of each queue. These registers are updated whenever a data packet passes through a queue in the device. An INT probe, in the MM-INT solution, is capable of collecting the INT metadata from all queues and all ports by reading these registers. The solution proposed in MM-INT contrasts with the traditional INT telemetry-based monitoring mechanism, because instead of obtaining the INT metadata directly from the queue associated with the probe’s output port, it collects the data stored in the device’s internal registers. In summary, such registers accumulate monitoring data from all queues associated with all ports of the monitored switch. Furthermore, the solution presented here makes use of source routing and multipath (multicast) trees to reduce the number of probes required to cover all switches in the network, avoiding overlaps of these probes as they traverse the topology. For this, we adopt the MPolKA-INT mechanism [ de O. Pereira et al. 2023 ] , which uses source-based routing, replacing traditional routing tables with a label used for forwarding packets in the network. The solution was implemented using the P4 language and evaluated in a Mininet environment with BMv2 (Behavioral Model version 2) switches. The evaluation of MM-INT showed that the solution reduced the number of probes sent by 4x and the amount of data transferred for network telemetry collection by approximately 2.8x when compared to traditional solutions found in the literature. 2 Theoretical Background and Research Problem Positioning This section is divided into two parts: i) a description of how metric collection works in programmable networks using INT, and how multiple queues affect this collection; and ii) how MPolka-INT works. 2.1 Telemetry using INT Thanks to recent technological advances, the popularization of programmable network devices, and the P4 language, it is now possible for these devices to report the state of the network without control plane intervention [ Arslan and McKeown 2019 ] . In this case, data packets can contain headers that are telemetry instructions, which can be used to collect performance data. The telemetry instructions are described in the INT data plane specification, which defines three modes of operation: INT-XD (eXport Data), INT-MX (eMbed Instructions), and INT-MD (eMbed Data). In INT-XD mode, each device exports the metadata using INT instructions pre-configured in the flow tables, acting directly from the data plane to the monitoring system. In this mode, no modifications are made to the client traffic packets. In INT-MX mode, the source node creates INT instructions in the packet header, so that at each transit node, the INT instructions are read, the respective metadata is collected, and transmitted directly to the monitoring system. In this mode, small modifications are made to the data packets originated by clients, since telemetry instructions need to be inserted into the packet headers. In INT-MD mode, INT instructions and metadata are inserted into the packets at each hop in the network. This is the default operating mode defined by the INT specification and the one chosen for this work. To avoid confusion, INT-MD mode will be referred to as INT throughout this paper. Figure 1: Example of a network with In-band Network Telemetry. Fig. 1 illustrates the operation of INT in a network. The network consists of four end systems ( H1, H2, H3 , and H4 ) and four programmable switches with support for INT telemetry ( S1, S2, S3 , and S4 ). Each switch has a set of metadata of interest to the monitoring system, represented by rectangles in orange ( S1 ), magenta ( S2 ), green ( S3 ), and blue ( S4 ). In the network, there are two data flows: one represented by red packets and the other by black packets. The red flow follows the path f1 = { H1, S1, S3, S4, H4 } in the network. The black flow follows the path f2 = { H1, S1, S2, H2 }. At each network hop, telemetry instructions in the data plane of the devices guide the collection and addition of metadata to the packets traversing each switch . This process is repeated along the entire path, from the first switch after the source to the last switch before the

Read the complete text