Efficient Cloud-Edge-Device Query Execution Based on Collaborative Scan Operator 1 Corresponding author.

1 st Chunyu Zhao, 2 nd Hongzhi Wang 1 , 3 rd Kaixin Zhang, 4 th Hongliang Li, 5 th Yihan Zhang, 6 th Jiawei Zhang, 7 th Kunkai Gu, 8 th Yuan Tian, 9 th Xiangdong Huang, 10 th Jingyi Xu · 2025

Read Efficient Cloud-Edge-Device Query Execution Based on Collaborative Scan Operator 1 Corresponding author. by 1 st Chunyu Zhao, 2 nd Hongzhi Wang 1 , 3 rd Kaixin Zhang, 4 th Hongliang Li, 5 th Yihan Zhang, 6 th Jiawei Zhang, 7 th Kunkai Gu, 8 th Yuan Tian, 9 th Xiangdong Huang, 10 th Jingyi Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15285.txt.

Introduction

Chunyu Zhao and co-authors tackle slow database queries at the edge of a network, in a paper published in 2025. In cloud-edge-device systems, small edge servers near users run queries fast until their disks and chips saturate. Moving work to the cloud mid-query is hard, because most query steps cannot switch places cleanly.

The team built a scan step, the part that reads table rows, that can hand its work to the cloud at any moment. Their framework balances load between edge and cloud as pressure shifts. In tests with enough network speed, the shared scan eased slowdowns from heavy input and chip waiting at the edge. The approach suits data systems spread across phones, local servers, and data centers.

Catalog record

CREATOR1 st Chunyu Zhao, 2 nd Hongzhi Wang 1 , 3 rd Kaixin Zhang, 4 th Hongliang Li, 5 th Yihan Zhang, 6 th Jiawei Zhang, 7 th Kunkai Gu, 8 th Yuan Tian, 9 th Xiangdong Huang, 10 th Jingyi Xu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15285

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient Cloud-Edge-Device Query Execution Based on Collaborative Scan Operator 1 Corresponding author. 1 st Chunyu Zhao, 2 nd Hongzhi Wang 1 , 3 rd Kaixin Zhang, 4 th Hongliang Li, 5 th Yihan Zhang, 6 th Jiawei Zhang, 7 th Kunkai Gu, 8 th Yuan Tian, 9 th Xiangdong Huang, 10 th Jingyi Xu Abstract In cloud-edge-device (CED) collaborative query (CQ) processing, by leveraging CED collaboration, the advantages of both cloud computing and edge resources can be fully integrated. However, it is difficult to implement collaborative operators that can flexibly switch between the cloud and the edge during query execution. Thus, in this paper, we aim to improve the query performance when the edge resources reach a bottleneck. To achieve seamless switching of query execution between the cloud and edge, we propose a CQ processing method by establishing a CED collaborative framework based on the collaborative scan operator, so that query execution can be transferred to the cloud at any time when the edge resources are saturated. Extensive experiments show that, under sufficient network download bandwidth, the CED collaborative scan operator can effectively alleviate the performance degradation of scan operators caused by high I/O load and CPU wait time at the edge. It also achieves balanced resource scheduling between the cloud and edge. I Introduction CED-CQ distributes query tasks originally handled by a single cloud server with the edge and device sides in a coordinated manner, enabling cloud servers and edge computers to work together to process query tasks efficiently, as shown in Figure 1 . The design of basic CQ operators for CED databases not only facilitates CQs between cloud servers and edge computers but also alleviates the disadvantages of transmission pressure and insufficient computing power in traditional cloud-edge cooperation [ 1 ] . This complementary approach leverages the advantages of both, offering the convenience of data access with minimal network load while providing ample computing resources and effective coordination [ 2 , 3 ] . In the field of Internet of Things (IoT) [ 4 ] , due to the large number of devices, high frequency of data generation, and the predominance of time as the primary dimension, time-series databases [ 5 ] have gradually become the mainstream choice for CED Databases [ 6 ] . Fig. 1 : Architecture of CED collaboration In the CED database, data collected by terminal devices is initially stored at the edge computer. Meanwhile, a cache is configured on the cloud server to store a portion of key or frequently accessed data. When executing queries, the edge side typically retrieve data directly from local storage. To enhance data availability, the edge side periodically synchronize the most recently queried relevant data to the cloud cache during network idle periods. However, when edge sides experience degraded performance due to high volumes of concurrent queries, they offload part of the query workload to the cloud server. This mechanism not only effectively reduces the load on edge sides, but also leverages the abundant computational resources available in the cloud. However, enabling efficient CED-CQ processing presents several key challenges: • Coordinated Data Management: The cloud and edge must efficiently manage distributed datasets in a coordinated manner. This requires maintaining data consistency while supporting flexible query execution across both cloud and edge. • Cross-Tier Operator Collaboration and Switching: Query operators need to be dynamically deployable and executable across cloud and edge tiers. They must also support seamless transitions between execution tiers based on runtime conditions. • Execution State Synchronization and Migration: To support seamless operator transitions, the execution state and progress information must be synchronized or rapidly migrated between the cloud and edge. • Cost-Efficient Resource and Data Transfer Optimization: It is essential to minimize cross-tier data transfer costs while jointly optimizing compute and storage resource scheduling across the cloud and edge to balance overall performance and cost-efficiency. Even though some techniques have been proposed for CED-CQ processing, they fail to address these issues. For instance, the time-series database InfluxDB [ 7 , 8 ] has been applied to assist in data query needs between the cloud and edge. Similarly, one of the key factors contributing to the widespread adoption of Apache IoTDB [ 9 ] [ 10 ] [ 11 ] in domains such as connected vehicles, intelligent operations and maintenance, and smart factories is its efficient collaborative data management mechanism [ 12 ] , which enables seamless synchronization of data across cloud, edge, and devices through the pipe [ 13 ] . However, in existing systems, query execution across the cloud and edge remains largely disjoint. The core limitation lies in the absence of a unified query optimization framework capable of integrating and managing data across cloud–edge environments. Representative systems such as InfluxDB and Apache IoTDB treat the cloud and edge as isolated entities, executing queries independently within their respective domains. This fragmented architecture leads to significant inefficiencies, including redundant data transfers and excessive load on edge nodes. More critically, the lack of synchronization in query execution progress between cloud and edge becomes a major bottleneck, severely hindering coordination. As a result, it becomes extremely difficult to build a truly seamless and efficient collaborative query processing mechanism. These limitations significantly restrict the potential of existing systems to support practical and performant CED-CQ processing. The development of an efficient CED-CQ operators is pivotal for enabling true coordination between cloud and edge in query execution, overcoming the independent processing paradigm that currently limits systems. Unlike traditional approaches where the cloud and edge operate in silos, a well-designed CED-CQ operator can act as a unifying layer that integrates their capabilities into a cohesive query execution framework. Among all data operators in time series databases, we observe that the scan operator [ b15 ] plays the crucial role. First, a query plan consists of multiple operators, and the scan operator is typically the starting point of these operators, which determines the initial state of the entire query execution process and is often the most time-consuming part of the query. Second, the scan operator serves as the foundation for many other database operations by providing the initial data required for processing. For instance, during join operations, the efficiency of the join largely depends on the scan operator’s ability to retrieve relevant data from two tables effectively. Similarly, in aggregation operations, such as calculating averages or sums over time series, the scan operator filters and reads the relevant data subsets, reducing computational overhead. Additionally, in sorting and group-by operations, the scan operator ensures that only the necessary data is accessed and passed on, which helps streamline the organization or categorization of results. In summary, the scan operator forms the foundation of query processing, which enables the implementation of core operations such as aggregation, selection, projection, and join. The last but not least, when I/O overload occurs, the scan operator can impact the efficiency of all other operators. Due to time-series database’s use of the Volcano model [ 14 ] , each operator returns query results in the next() method, forming a pipeline. When the read rate of the scan operator, which acts as a leaf node, decreases, its parent node will continuously wait for the scan operator’s return results. Consequently, this bottom-up

Read the complete text