Vision-based indoor localization of nano drones in controlled environment with its applications
Simranjeet Singh, Amit Kumar, Fayyaz Pocker Chemban, Vikrant Fernandes, Lohit Penubaku, Kavi Arya · 2024
Read Vision-based indoor localization of nano drones in controlled environment with its applications by Simranjeet Singh, Amit Kumar, Fayyaz Pocker Chemban, Vikrant Fernandes, Lohit Penubaku, Kavi Arya (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08757.txt.
Introduction
Simranjeet Singh and co-authors (2024) built a cheap vision system that tells nano drones where they are indoors. GPS does not work inside, and tiny drones cannot carry heavy sensors or computers. Their setup moves the thinking off the drone. A single room camera watches the drone, and a separate computer finds its position with adapted open code. Three controllers then radio speed corrections to hold the drone steady.
The system located the drone within about three centimeters. The whole rig cost about fifty dollars. The team proved the method with several tasks. The drone landed on a moving ground vehicle, followed planned paths in three dimensions, and flew alongside other nano drones that were tracked the same way. The authors released their package openly. They aim it at teaching labs and other settings where cost matters more than perfect precision.
Catalog record
| CREATOR | Simranjeet Singh, Amit Kumar, Fayyaz Pocker Chemban, Vikrant Fernandes, Lohit Penubaku, Kavi Arya |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-08757
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Vision-based indoor localization of nano drones in controlled environment with its applications Simranjeet Singh, Amit Kumar, Fayyaz Pocker Chemban, Vikrant Fernandes, Lohit Penubaku, Kavi Arya Abstract Navigating unmanned aerial vehicles in environments where GPS signals are unavailable poses a compelling and intricate challenge. This challenge is further heightened when dealing with Nano Aerial Vehicles (NAVs) due to their compact size, payload restrictions, and computational capabilities. This paper proposes an approach for localization using off-board computing, an off-board monocular camera, and modified open-source algorithms. The proposed method uses three parallel proportional-integral-derivative controllers on the off-board computer to provide velocity corrections via wireless communication, stabilizing the NAV in a custom-controlled environment. Featuring a 3.1cm localization error and a modest setup cost of 50 USD, this approach proves optimal for environments where cost considerations are paramount. It is especially well-suited for applications like teaching drone control in academic institutions, where the specified error margin is deemed acceptable. Various applications are designed to validate the proposed technique, such as landing the NAV on a moving ground vehicle, path planning in a 3D space, and localizing multi-NAVs. The created package is openly available at https://github.com/simmubhangu/eyantra_drone to foster research in this field. keywords Indoor Localization; Multi-drone; Nano drone; Path Planning; PID; ROS; CoppeliaSim; WhyCon † † articletype: Research Article 1 Introduction For thousands of years, humans have used land and water to navigate terrain, but air travel has revolutionized many aspects of our lives. Recent advances in materials and electronics have led to the development of portable aerial robots, which can be either user-operated or autonomous. Research is underway to enhance the autonomous capabilities of these unmanned aerial vehicles (UAVs), classified as fixed-wing, rotating & flapping wing, hybrid wing, and gas envelope [ 1 ] . Among these, quadcopters, a type of rotating & flapping wing aircraft, are widely used and have numerous applications in disaster management, defense, cinematography, agriculture, and beyond. UAVs can also be categorized by size, ranging from nano to large, depending on their dimensions [ 2 ] . As we transition from the nano to larger drones, both computing power and costs begin to rise. However, nano aerial vehicles (NAVs) have garnered significant interest in educational research and initial testing of aerial algorithms due to their potential for autonomous maneuvering in indoor and outdoor environments. Since global positioning systems (GPS) are not available indoors, localization of NAV in the environment becomes a crucial challenge. To navigate the surroundings, NAV must localize themselves in the environment by obtaining their 3D pose with respect to the environment and heading angle. Localization using internal sensors, such as an inertial measurement unit, can be robust for a short duration but is prone to drifting in 3D space when used for longer periods [ 3 ] . Additionally, NAVs are small and have limited payload capacity, making it challenging to accommodate various sensors. As a result, researchers have explored alternative localization methods for indoor drone applications. Figure 1 : Comparison between flight time, drone weight, and cost for localization of nano aerial vehicle (NAV), miniature aerial vehicle (MAV) and tactical unmanned aerial vehicle (TUAV). Using NAV along with WhyCon marker for localization, substantially reduces the setup cost. To tackle the localization problem in an indoor environment, various techniques have been proposed to develop indoor positioning systems by adding artificial landmarks or beacons at known locations such as ViCon [ 4 ] , radio frequency-based (RF) localization system [ 5 ] , and distributed sensor systems [ 6 ] . Even though these localization techniques achieve excellent accuracy and performance, they are costly and only affordable for some research fields. Figure 1 compares the cost of different localization techniques with different types of drones. Researchers have also developed techniques for indoor localization using vision-based approaches. These approaches employ fiducial markers such as AprilTags [ 7 ] , ArUco markers [ 8 ] or circular markers [ 9 ] and an onboard camera. They are capable of position estimation of the marker in the camera video stream. However, these approaches demand an onboard computational sensor processing unit for such localization algorithms. This is elevated by sending the sensor data to the ground station to run a computation-heavy localization algorithm [ 10 ] . However, the ground station approach suffers from the latency and communication gap between NAV and the ground station. A viable solution is to localize the NAV using a vision-based system. Recently, WhyCon, an efficient, fast, and low-cost open-source localization system, has been presented [ 9 ] . It uses off-the-shelf components and circular markers for localization. This system requires no special equipment to set up the controlled environment. A lightweight and low-cost robotics swarm implementation using the WhyCon system is presented in [ 11 ] . It has been shown that the WhyCon localization system outperforms ArUco and OpenCV by a hundred times in terms of processing time [ 12 ] . However, the foundational WhyCon system does not provide a unique ID of the target pose, making it difficult for fast control loop applications such as swarm NAVs [ 13 ] . The major contributions of this paper are as follows: • Design of a localization-controlled environment for NAV using a WhyCon system (open-source) that is low-cost, easy to set up, and accurate, as illustrated in Figure 4 . • Design of complete architecture of localization system, control commands, and communication protocol around NAVs. • Validation of the proposed localization system by implementing applications such as landing on the objects in motion, autonomous path-planning, and multi-NAV control. • Public release of the package developed to maneuver the NAV in the controlled environment at https://github.com/simmubhangu/eyantra_drone While all the individual components of our system may not be novel, to our knowledge, our novelty lies in the integration of a complete system that has been tested on various applications suitable for a low-cost academic environment. The rest of the paper is organized as follows: Section 2 reviews the existing and related work on vision-based localization systems for NAVs, Section 3 provides the details of the localization setup and experiments, Section 4 presents the control architecture for NAV, and Section 5 lists the various applications designed on the proposed technique. Figure 2 : Coordinate frames of the NAV and overhead camera. WhyCon marker, shown with an inner white circle and black boundary, is mounted on top of the NAV. Changes in roll ( \phi ), pitch ( \theta ), and throttle result in movement along the y, x, and z axes respectively. 2 Background and Related Work In this section, we delve into the related work and background of the components employed in the proposed architecture, including the NAV, state-of-the-art vision-based techniques, and the control algorithm designed for NAV. 2.1 Related Work There have been several implementations of indoor localization systems in the literature. Some of the early work focused on placing artificial landmarks [ 14 , 15 ] in an unknown environment for object tracking. Even though Vicon-460 [ 14 ] system provides an overall accuracy of 65\pm 5\mu m , these approaches remain costly and are not viable for every research field. This issue has motivated researchers to look into low-cost localization systems. As an alternative, various