From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAV

Yousef Emami, Hao Zhou, Miguel Gutierrez Gaitan, Kai Li, Luis Almeida, and Zhu Han · 2025

Read From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAV by Yousef Emami, Hao Zhou, Miguel Gutierrez Gaitan, Kai Li, Luis Almeida, and Zhu Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02649.txt.

Introduction

Yousef Emami and five co-authors propose steering public safety drones with large language models instead of trained control policies. Their 2025 paper notes that deep reinforcement learning, the usual autopilot brain, trains slowly, wastes samples, and transfers poorly from simulation to real flight. Language models adapt through examples placed in the prompt, with no retraining at all.

Running the model at the network edge, not the cloud, trims delay and keeps data local, both vital in emergencies. The paper maps the approach onto path planning and speed control for rescue drones. A case study on data collection scheduling shows far less packet loss than standard methods, plus some resistance to prompt attacks. The authors close with optimizer ideas and open problems. The pitch is a light, fast-adapting brain for drones that guide rescue work.

Catalog record

CREATORYousef Emami, Hao Zhou, Miguel Gutierrez Gaitan, Kai Li, Luis Almeida, and Zhu Han
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-02649

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAV Yousef Emami, Hao Zhou, Miguel Gutierrez Gaitan, Kai Li, Luis Almeida, and Zhu Han Abstract A public safety Unmanned Aerial Vehicle (UAV) enhances situational awareness in emergency response. Its agility and ability to optimize mobility and establish Line-of-Sight (LoS) communication make it increasingly vital for managing emergencies such as disaster response, search and rescue, and wildfire monitoring. While Deep Reinforcement Learning (DRL) has been applied to optimize UAV navigation and control, its high training complexity, low sample efficiency, and simulation-to-reality gap limit its practicality in public safety. Recent advances in Large Language Models (LLMs) offer a compelling alternative. With strong reasoning and generalization capabilities, LLMs can adapt to new tasks through In-Context Learning (ICL), which enables task adaptation via natural language prompts and example-based guidance, without retraining. Deploying LLMs at the network edge, rather than in the cloud, further reduces latency and preserves data privacy, thereby making them suitable for real-time, mission-critical public safety UAVs. This paper proposes the integration of LLM-enabled ICL with public safety UAV to address the key functions, such as path planning and velocity control, in the context of emergency response. We present a case study on data collection scheduling where the LLM-enabled ICL framework can significantly reduce packet loss compared to conventional approaches, while also mitigating potential jailbreaking vulnerabilities. Finally, we discuss LLM optimizers and specify future research directions. The ICL framework enables adaptive, context-aware decision-making for public safety UAV, thus offering a lightweight and efficient solution for enhancing UAV autonomy and responsiveness in emergencies. I Introduction Unmanned Aerial Vehicles (UAVs) play a crucial role in various sectors, including energy, environmental monitoring, parcel delivery, and public safety. In particular, they are transformative in public safety applications, including post-disaster assessment, search and rescue missions, wildfire monitoring, border surveillance, and crime scene reconstruction, due to their agility, optimized mobility, and ability to establish reliable Line-of-Sight (LoS) communications. A public safety UAV enhances situational awareness for police, firefighters, and other first responders, thereby improving incident management and overall operational efficiency [ 1 ] , [ 2 ] . UAVs can leverage Machine Learning (ML) techniques for optimizing navigation and control, particularly in emergencies. For example, they employ Deep Reinforcement Learning (DRL) to optimize flight trajectories based on victims’ needs or to identify casualties and collect environmental data efficiently [ 3 ] . However, DRL solutions involve complex training processes and face challenges such as the simulation-to-reality gap and low sample efficiency, which are ill-suited to the urgent demands of emergency scenarios. Therefore, lightweight and adaptive solutions are required to quickly adapt to the emergency and enhance the success rate of rescue operations. Recent advancements in artificial intelligence, particularly in Large Language Models (LLMs), are driving significant transformations across UAV communications [ 4 ] . With strong reasoning and generalization capabilities, LLMs enable advanced understanding, flexible adaptation, and real-time responsiveness in diverse UAV scenarios. Integrating LLMs into UAV communications offers a promising path toward greater autonomy, equipping UAVs with enhanced decision-making abilities and enabling more effective responses during emergencies. The conventional approach to deploying LLMs relies on cloud-based infrastructures, which often introduces communication delays and raises privacy concerns, particularly problematic for time-sensitive and mission-critical UAV operations [ 5 ] . A recent trend is to shift LLM deployment to the network edge through edge server integration. This approach allows LLMs to directly serve the computational and operational needs of edge devices such as UAVs. Notably, LLMs can be taught new tasks using In-Context Learning (ICL) by the UAV, enabling rapid adaptation without retraining. For instance, ICL can facilitate key UAV functions, including path planning and velocity control, data collection scheduling, and power management, enhancing real-time decision-making in emergencies. Figure 1 : Illustration of LLM-enabled ICL for a public safety UAV. The public safety UAV collects sensory data and submits it to the edge LLM, where a task description, which is a basis for ICL, is formulated with the following components: task goal, input data, rules, output, and feedback. The system prompt defines the rule of LLM, e.g., data collector. This paper proposes the use of LLM-enabled ICL to facilitate the key functions in public safety UAV. We systematically categorize these functions and present detailed task descriptions for each, demonstrating how ICL can enable the public safety UAV to adapt rapidly to emergency scenarios, improve decision-making, and enhance operational efficiency without requiring model retraining. As depicted in Fig. 1 , ICL leverages structured natural language prompts, i.e., task descriptions, to encapsulate task objectives, while curated demonstration sets convey relevant system states and environmental conditions such as sensory data. This approach enables LLMs to infer an effective output for the task, without requiring explicit model retraining. By using contextually rich examples, ICL supports adaptive, on-the-fly decision-making across a broad range of UAV-Assisted Sensor Network (UASNETs) tasks, making it particularly valuable for time-sensitive applications such as emergency response. The contributions of the paper are listed as follows: • A classification of key functions in public safety UAVs, such as path planning and velocity control. These functions can be effectively addressed using LLM-enabled ICL, providing a structured foundation for its application in emergencies. This classification serves as a foundational reference to guide future research and development in integrating LLM-enabled ICL into public safety UAVs, especially where DRL optimizers fall short. • A case study on data collection schedule, showcasing how an LLM-enabled ICL framework significantly reduces packet loss compared to conventional strategies, while also addressing potential jailbreaking vulnerabilities. • A discussion on LLM optimizers along with future research directions. One such direction involves the use of Diffusion Models (DMs) to generate diverse, high-quality synthetic examples that can be used for enriching task descriptions. The remainder of this paper is organized as follows: Section II discusses the deployment of LLMs. Section III provides background on LLM-enabled ICL and its effectiveness. Section IV explores the application of LLM-enabled ICL for public safety UAV and its various functions. Section V presents a case study on data collection schedule, along with investigating jailbreaking attacks. Section VI discusses LLM optimizers and their merits for public safety UAV. Section VII outlines future directions, including the use of DMs to enrich task descriptions. Finally, Section VIII concludes the paper. Table I : Overview of In-Context Learning for LLMs in Public Safety UAV Applications. Aspect Description Definition ICL enables LLMs to learn from contextual information embedded in prompts containing task-specific instructions and demonstrations written in natural language. Capabilities Allows LLMs to generalize across tasks by leveraging pre-trained knowledge and adapting to new tasks through example-based prompts. Considered a core feature of modern LLMs. Key Considerations The design of demonstrations, including example selection, formatting, and ordering, strongly influences performance and should be carefully crafted. Application in Public Safety ICL offers a lightweight method to facilitate key functions such as path planning by reusing prior solutions as input prompts, supporting fast adaptation in emergencies. II Deployment of LLMs This section highlights the importance of LLM deployment and discusses limitations of cloud-based deployment and the feasibility of edge-based LLM deployment. LLMs impose substantial demands on computational and storage resources. For example, GPT-4 contains approximately 1.76 trillion parameters and has a

Read the complete text