GSCE: A Prompt Framework with Enhanced Reasoning for Reliable LLM-driven Drone Control

Wenhao Wang, Yanyan Li, Long Jiao and Jiawei Yuan · 2025

Read GSCE: A Prompt Framework with Enhanced Reasoning for Reliable LLM-driven Drone Control by Wenhao Wang, Yanyan Li, Long Jiao and Jiawei Yuan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12531.txt.

Introduction

Wenhao Wang, Yanyan Li, Long Jiao, and Jiawei Yuan present in 2025 a prompting framework that lets large language models steer drones with more care. Language models can plan drone actions in plain words, which could open robot control to non-programmers, but their reasoning can wobble on hard tasks.

The framework, GSCE, packs four kinds of support into each prompt: guidelines, skill commands the drone can run, hard constraints, and worked examples. Together they aim to make the model's choices steadier and safer. The authors test the approach on drone control tasks where a careless step has real costs in the air.

Catalog record

CREATORWenhao Wang, Yanyan Li, Long Jiao and Jiawei Yuan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12531

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GSCE: A Prompt Framework with Enhanced Reasoning for Reliable LLM-driven Drone Control Wenhao Wang, Yanyan Li, Long Jiao and Jiawei Yuan Abstract The integration of Large Language Models (LLMs) into robotic control, including drones, has the potential to revolutionize autonomous systems. Research studies have demonstrated that LLMs can be leveraged to support robotic operations. However, when facing tasks with complex reasoning, concerns and challenges are raised about the reliability of solutions produced by LLMs. In this paper, we propose a prompt framework with enhanced reasoning to enable reliable LLM-driven control for drones. Our framework consists of novel technical components designed using G uidelines, S kill APIs, C onstraints, and E xamples, namely GSCE . GSCE is featured by its reliable and constraint-compliant code generation. We performed thorough experiments using GSCE for the control of drones with a wide level of task complexities. Our experiment results demonstrate that GSCE can significantly improve task success rates and completeness compared to baseline approaches, highlighting its potential for reliable LLM-driven autonomous drone systems. I Introduction The rapid advancement of LLM has led to the revolution of a wide range of embodied agents. Models such as GPT4 [ 1 ] , Llama 3 [ 2 ] , and Gemini [ 3 ] have achieved remarkable results in various robotic tasks, such as planning [ 4 ] , navigation [ 5 , 6 ] , communication [ 7 ] , and automation [ 8 ] . Given the recent advances of LLMs and their remarkable capabilities of natural language (NL) understanding and context generation, how to leverage LLMs for drones has become an emerging topic to bring more intelligence to robotic systems. Recently, research efforts have been made towards the reliable integration of LLMs and drones [ 9 , 10 , 11 , 12 ] , promising to revolutionize LLM-driven autonomous drone control. Although LLMs have demonstrated potential for integration into drone control, they still face challenges in logical reasoning [ 13 ] , which limits their reliability in operations requiring complex decision-making. Unlike many other text generation applications where semantic-level accuracy is sufficient, drone control necessitates the precise execution of a sequence of actions. If the control code generated by LLMs is incorrect or invalid, it may lead to erroneous drone behavior, posing safety and security risks to the public, such as drone crashes. These limitations also hinder their adaptability to dynamic environments, where adherence to human instructions is essential. A prevalent approach to overcome this issue involves prompting LLMs with guidelines and skill APIs, leveraging LLMs’ contextual understanding to interpret and apply these resources effectively. By adhering to the provided guidelines and utilizing the appropriate APIs, LLMs can generate code that controls drones to operate in accordance with human instructions, as shown in Fig. 1 (a). However, this approach is not reliable for complex reasoning tasks and poses risks such as incorporating incorrect APIs or misusing them in the generated code. Moreover, LLMs struggle to reason the correct actions in scenarios where LLMs have limited prior knowledge or must operate within robotic constraints. Fig. 1: Illustration of LLM-driven drone control systems prompt structures. Structure (a) prompts LLMs with guidelines and skill APIs, as demonstrated in [ 9 , 14 ] . Our proposed GSCE structure (b) introduces constraints to regulate LLM behavior and incorporates examples with constraints implementation to illustrate LLM, thereby enhancing the reasoning capabilities of LLMs. To address these challenges, we propose a novel prompt framework designed to enhance the reasoning capabilities of LLM-driven drone control. Our approach incorporates a structured prompt framework consisting of Guidelines, Skill APIs, Constraints, and Examples. As illustrated in Fig. 1 (b), the Guidelines shape the LLM’s characteristics for code generation in drone control, while the Skills APIs are predefined function interfaces that empower LLM with essential drone control capabilities. The Constraints regulate actions in scenarios where the LLM lacks prior knowledge or where the Skill APIs do not document specific requirements. Lastly, the Examples leverage the in-context learning [ 15 ] capability of LLMs to illustrate how task descriptions should be mapped to control code. Additionally, the examples demonstrate the implementation of NL constraints to ensure compliance with predefined constraints while reasoning. Our contribution can be summarized as follows: • We propose a novel prompt framework designed to enhance the reasoning capabilities of LLM-driven drone control. • Beyond using illustrative examples, our approach explicitly incorporates constraints within examples to further enhance LLM reasoning. • The framework is modular, with each component dynamically adaptable, allowing for seamless integration across diverse robotic platforms and task scenarios. II Related Work II-A LLM for Robotics LLMs have demonstrated remarkable potential in semantic understanding and context generation, making them a valuable asset in robotics. ChatGPT for Robotics [ 9 ] and Code as Policies [ 14 ] achieve remarkable progress in using LLM-generated code to control robotic arms. For drone applications, TypeFly [ 10 ] proposes an end-to-end system for piloting a quadcopter with LLM, while REAL [ 16 ] provides a strategy to employ LLM as part of control and planning on drones. Additionally, LLM can act as a cognitive agent in closed-loop vehicle motion planning. [ 17 ] These efforts highlight the diverse and impactful applications of LLMs across different robotic platforms. However, robotic performance remains constrained by the reasoning capabilities of LLMs. LLMs often exhibit unreliability in tasks requiring complex reasoning. Notably, ChatGPT has acknowledged the necessity of human intervention for code generation [ 9 ] . II-B Prompt Engineering Recent research has increasingly focused on leveraging prompt engineering [ 18 ] strategies to enhance the reasoning capabilities of LLMs for robotics. In ChatGPT for Robotics [ 9 ] , LLMs are provided with a description of guidelines, constraints, and accessible APIs, and then LLMs generate code to control robots completing the given task description. Similarly, ViLaIn [ 19 ] provides detailed descriptions of the robot and its environmental states, helping LLMs develop a general understanding of the robot’s condition before generating control code. However, LLMs exhibit sensitivity to input perturbations [ 20 , 21 , 22 ] . To address this, PluginSafety [ 23 ] applies safety chips that infer specification constraints, ensuring that LLM-generated content adheres to predefined NL constraints. AutoTamp [ 24 ] adopts a different approach by prompting the LLM to first generate an intermediate task representation and then translate it into task plans. Additionally, some studies integrate human or automated checker feedback [ 24 , 25 , 26 , 27 ] to re-prompt the LLM, refining its outputs for improved reasoning accuracy. II-C LLM In-context Learning In-context learning is a powerful capability of LLMs that enables them to perform tasks by leveraging examples provided in the input prompt. Instead of retraining model parameters, LLMs recognize patterns from the given context and generalize them to new outputs, allowing users to shape the characteristics of LLMs with few examples [ 15 ] . In robotics, in-context learning enables LLMs to generate code following robot policy by incorporating example demonstrations within the prompt [ 14 ] . This paradigm approach helps LLMs generalize across tasks by analyzing prior examples. Furthermore, LLMs can learn to ground human instructions using the provided APIs from few-shot examples [ 28

Read the complete text