FlyMeThrough: Human-AI Collaborative 3D Indoor Mapping with Commodity Drones Conference: The 38th Annual ACM Symposium on User Interface Software and Technology; September 28-October 1, 2025; Busan, Republic of Korea The 38th Annual ACM Symposium on User Interface Software and Technology (UIST ’25),

Xia Su, Ruiqi Chen, Jingwei Ma, Chu Li, Jon E. Froehlich · 2025

Read FlyMeThrough: Human-AI Collaborative 3D Indoor Mapping with Commodity Drones Conference: The 38th Annual ACM Symposium on User Interface Software and Technology; September 28-October 1, 2025; Busan, Republic of Korea The 38th Annual ACM Symposium on User Interface Software and Technology (UIST ’25), by Xia Su, Ruiqi Chen, Jingwei Ma, Chu Li, Jon E. Froehlich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20034.txt.

Introduction

Su and co-authors present a 2025 conference paper on mapping indoor spaces with cheap drones. Indoor maps help with routing and building care, but they are scarce because surveys cost time and money. Their system, FlyMeThrough, flies a standard drone indoors and rebuilds the space in 3D. People and AI together mark key spots such as doors, stairs, restrooms, and elevators.

The team tested the system in twelve indoor spaces of varied size and use. They also ran a feedback study with five building managers and five occupants. Users found the maps fast and accurate enough for planning and navigation. The work shows a low-cost path to indoor maps for large buildings.

Catalog record

CREATORXia Su, Ruiqi Chen, Jingwei Ma, Chu Li, Jon E. Froehlich
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-20034

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FlyMeThrough: Human-AI Collaborative 3D Indoor Mapping with Commodity Drones Conference: The 38th Annual ACM Symposium on User Interface Software and Technology; September 28-October 1, 2025; Busan, Republic of Korea The 38th Annual ACM Symposium on User Interface Software and Technology (UIST ’25), September 28-October 1, 2025, Busan, Republic of Korea CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing Interaction design CCS: Human-centered computing Visualization systems and tools Xia Su, Ruiqi Chen, Jingwei Ma, Chu Li, Jon E. Froehlich Abstract . Indoor mapping data is crucial for routing, navigation, and building management, yet such data are widely lacking due to the manual labor and expense of data collection, especially for larger indoor spaces. Leveraging recent advancements in commodity drones and photogrammetry, we introduce FlyMeThrough —a drone-based indoor scanning system that efficiently produces 3D reconstructions of indoor spaces with human-AI collaborative annotations for key indoor points-of-interest (POI) such as entrances, restrooms, stairs, and elevators. We evaluated FlyMeThrough in 12 indoor spaces with varying sizes and functionality. To investigate use cases and solicit feedback from target stakeholders, we also conducted a qualitative user study with five building managers and five occupants. Our findings indicate that FlyMeThrough can efficiently and precisely create indoor 3D maps for strategic space planning, resource management, and navigation. Figure 1 . We introduce FlyMeThrough , a drone-based indoor mapping system that semi-automatically maps indoor spaces and locates key facilities such as entrances, stairs, elevators, and doors. (A) We use a DJI Avata drone to scan indoor spaces, and generate reconstructed 3D maps with structure-from-motion (SfM) ( Özyeşil et al. 2017 ) ; (B) We employ SAM2 ( AI 2024 ) to enable intuitive and efficient user annotation of key indoor facilities. (C) FlyMeThrough auto-segments objects, generates annotations across subsequent frames, and localizes them in the 3D map, which (D) users can interactively review and update. A drone flying and scanning an indoor space. The image also shows the indoor space, which is a 2-floor-high hall space, as a 3D reconstruction, since some missing geometry can be seen. The drone has a blue dotted flying trajectory, where several image frames are located on. One frame is expanded on the left bottom corner, showing a user annotation action that clicks the screen and gets a ramp highlighted with orange. Two more subsequent frames in the frame list also highlight this orange block. All these frames are linked to an orange bounding box with orange dotted lines, indicating that these masks on images cast to a 3D bounding box in the scene, which is linked to a "ramp" item in a list of detected facilities. † † cc-license: by 1. Introduction Indoor mapping data for public indoor spaces ( e.g. , office buildings, train stations, airports, and stadiums, etc. ) is crucial for navigation, route planning, space evaluation, and tracking spatial changes over time. However, such data is often scarce and outdated ( Pipelidis et al. 2019 ) . Mainstream indoor mapping procedures involve two methods: transforming CAD building plans into digital indoor mapping, or deploying specific scanning hardware and services. However, these methods require high data acquisition costs and long timelines ( Yue and Wu 2018 ) and thus are hard to mass deploy and regularly maintain. In contrast, drone-based indoor mapping, where drones fly through large indoor spaces to capture key spatial information, offers advantages in terms of cost and maintenance efforts. Demonstrated feasible through both academic research ( Karam et al. 2022a ; Zhou et al. 2014 ) and commercial products like Skydio ( Skydio 2025 ) and Elios ( Flyability 2025 ) , drone-based mapping can efficiently cover large and complex indoor spaces and has the potential for higher levels of automation. However, existing solutions often rely on LiDAR-equipped drones, which are prohibitively expensive for large-scale deployment ( e.g. , an Elios 3 LiDAR drone costs $50,000). Additionally, the generated indoor maps lack points of interest (POI) that building management and visitors care about. To address these challenges, we aim to develop a more affordable and scalable drone-based indoor mapping pipeline that only uses RGB video data, thus can potentially be captured by any commodity drone. In addition, we introduce a human-AI collaborative annotation and location process that allows building management staff to efficiently identify and mark key indoor POIs ( e.g. entrances, stairs, elevators), making the output 3D maps more useful for navigation, routing, and space evaluation. We present FlyMeThrough , a human-AI collaborative indoor mapping system that provides an end-to-end pipeline for transforming RGB footage of indoor drone flights to POI-infused 3D reconstructed maps of the scanned indoor spaces. FlyMeThrough is comprised of three major technical components: first, a SfM (Structure from Motion)-based 3D reconstruction ( Özyeşil et al. 2017 ) that transforms input RGB videos to estimated camera positions of video frames as well as 3D mesh models of the indoor spaces. Second, a human-AI collaborative annotation pipeline that enables users to efficiently annotate and locate key indoor POIs. Third, a web interface that reviews the final results, which are 3D models with bounding boxes indicating the locations and dimensions of key indoor POIs. All components of the system are released and open-sourced. 1 1 1 https://github.com/makeabilitylab/FlyMeThrough To evaluate FlyMeThrough, we collected drone footage from 12 indoor spaces of varying sizes and functionalities under the approval and guidance of building managers, who are responsible for maintaining these scanned indoor spaces. We also conducted a user study with these five building managers along with five active building occupants of these scanned spaces, to assess the performance and usefulness of the annotation interface. We presented our drone-based indoor mapping process, invited participants to annotate the collected data for key indoor POIs, then interviewed them to assess the usability and performance of our custom pipeline. The study results show high technical performance and usability of our mapping system, while revealing application scenarios and aspects of future improvements. In sum, our contributions are threefold: first, we designed and implemented the first drone-based indoor mapping system that leverages only RGB data—enabling the use of affordable, off-the-shelf consumer drones for large-scale indoor reconstruction. Second, we introduce a custom human-AI collaborative annotation pipeline that allows users to flexibly define and create POIs in reconstructed indoor 3D maps. Finally, our user study with building managers and occupants contributes key insights into practical needs, usability, and potential applications of drone-based indoor 3D mapping systems for future work. 2. Related Work We situate our work in research on large-scale indoor mapping, drone-based 3D reconstructions, and techniques to automatically detect and localize objects in scenes. 2.1. Large Space Indoor Mapping Large indoor spaces, such as train stations, airports, malls, and office buildings, require high-quality spatial maps to support applications like navigation, space management, and digital twin construction. Mainstream commercial indoor mapping services like Pointr ( Pointr 2025 ) , ESRI ( Esri 2025 ) , Mappedin ( Mappedin Inc. 2025 ) , and Mapsted ( Mapsted Inc. 2025 ) typically rely on existing or user-drawn architectural data as input to generate interactive indoor navigation and management systems. Meanwhile, 3D indoor scanning services like Matterport ( noa [n. d.] ) , Cupix ( Cupix Inc. 2025 ) , and NavVis ( NavVis GmbH 2025 )

Read the complete text