π \pi , But Make It Fly: Physics-Guided Transfer of VLA Models to Aerial Manipulation
Johnathan Tucker 1 Denis Liu 1 Aiden Swann 1 Allen Ren 2 Javier Yu 1 Jiankai Sun 1 Brandon Kim 1 Lachlain McGranahan 1 Quan Vuong 2 Mac Schwager 1 · 2026
Read π \pi , But Make It Fly: Physics-Guided Transfer of VLA Models to Aerial Manipulation by Johnathan Tucker 1 Denis Liu 1 Aiden Swann 1 Allen Ren 2 Javier Yu 1 Jiankai Sun 1 Brandon Kim 1 Lachlain McGranahan 1 Quan Vuong 2 Mac Schwager 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25038.txt.
Introduction
Tucker and co-authors move a robot arm model trained on fixed bases onto a flying platform. Their system, AirVLA, tests whether vision-language-action skills survive the shift to flight. Vision skills transfer well, but flight control does not, since a drone is loose and always tipping. A payload-aware guide fixes this at run time by adding load limits into the action sampling. Fake training views from Gaussian splatting fill the data gap. Across 460 trials, navigation hit 100 percent, and pick-and-place rose from 23 to 50 percent.
Catalog record
| CREATOR | Johnathan Tucker 1 Denis Liu 1 Aiden Swann 1 Allen Ren 2 Javier Yu 1 Jiankai Sun 1 Brandon Kim 1 Lachlain McGranahan 1 Quan Vuong 2 Mac Schwager 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41012 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25038
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
π \pi , But Make It Fly: Physics-Guided Transfer of VLA Models to Aerial Manipulation Johnathan Tucker 1 Denis Liu 1 Aiden Swann 1 Allen Ren 2 Javier Yu 1 Jiankai Sun 1 Brandon Kim 1 Lachlain McGranahan 1 Quan Vuong 2 Mac Schwager 1 Abstract Vision-Language-Action (VLA) models such as π 0 \pi_{0} have demonstrated remarkable generalization across diverse fixed-base manipulators. However, transferring these foundation models to aerial platforms remains an open challenge due to the fundamental mismatch between the quasi-static dynamics of fixed-base arms and the underactuated, highly dynamic nature of flight. In this work, we introduce AirVLA, a system that investigates the transferability of manipulation-pretrained VLAs to aerial pick-and-place tasks. We find that while visual representations transfer effectively, the specific control dynamics required for flight do not. To bridge this ”dynamics gap” without retraining the foundation model, we introduce a Payload-Aware Guidance mechanism that injects payload constraints directly into the policy’s flow-matching sampling process. To overcome data scarcity, we further utilize a Gaussian Splatting pipeline to synthesize navigation training data. We evaluate our method through a cumulative 460 real-world experiments which demonstrate that this synthetic data is a key enabler of performance, unlocking 100% success in navigation tasks where directly fine-tuning on teleoperation data alone attains 81% success. Our inference-time intervention, Payload-Aware Guidance, increases real-world pick-and-place task success from 23% to 50%. Finally, we evaluate the model on a long-horizon compositional task, achieving a 62% overall success rate. These results suggest that pre-trained manipulation VLAs, with appropriate data augmentation and physics-informed guidance, can transfer to aerial manipulation and navigation, as well as the composition of these tasks. I Introduction Vision-Language-Action (VLA) foundation models have demonstrated remarkable cross-embodiment generalization, enabling robots with diverse morphologies to complete manipulation tasks from natural language instructions. Models such as RT-X [ 12 ] , Octo [ 34 ] , and \pi_{0} [ 3 ] leverage large-scale multimodal pretraining across dozens of robot embodiments, learning representations that transfer across manipulators with different kinematics, workspaces, and end-effector designs. However, all such demonstrations share a fundamental constraint: they operate from stable, fixed or mobile bases in quasi-static regimes. This raises a central question: can VLA policies transfer to aerial manipulators , robots that couple perception, language understanding, and contact-rich interaction with underactuated 6-DoF flight control? Such transfer would represent an extreme test of cross-embodiment learning, as aerial platforms differ fundamentally from ground robots in dynamics, control authority, and sensing characteristics. Answering this question has both scientific and practical significance. Scientifically, aerial manipulation provides a stress test for the representations learned by VLA foundation models: if policies pretrained entirely on fixed-base manipulators can partially transfer to flying robots through fine-tuning, it suggests these models capture manipulation primitives that transcend specific embodiment constraints. Practically, language-conditioned aerial manipulation would enable applications previously beyond reach: delivering medical supplies in inaccessible terrain, clearing debris in collapsed structures, or manipulating infrastructure at height. If VLA policies could be adapted for such platforms, non-expert operators could issue high-level language commands while the policy handles low-level perception and control. Several fundamental challenges distinguish aerial manipulation from the ground-robot scenarios that dominate VLA training data. First, quadrotors are underactuated: thrust and attitude are tightly coupled, and small errors in predicted actions can induce large deviations in pose. This failure mode rarely occurs in fixed-base manipulation. Second, onboard cameras experience large ego-motion, rapid viewpoint changes, motion blur, and scale variation that differ significantly from tabletop scenarios in most VLA datasets [ 25 , 12 ] . Finally, contact with objects induces payload changes [ 5 , 21 ] and aerodynamic disturbances [ 37 , 35 ] that violate quasi-static assumptions implicit in most manipulation policies. While recent work has begun exploring language-conditioned aerial systems and cross-embodiment transfer to drones, no prior work has systematically investigated whether manipulation-pretrained VLA foundation models can transfer to aerial platforms. Concurrent efforts take fundamentally different approaches: UMI-on-Air [ 19 ] trains embodiment-agnostic diffusion policies from scratch on handheld demonstrations and introduces inference-time guidance to compensate for aerial dynamics, but does not leverage or evaluate VLA foundation models. SINGER [ 1 ] and GRaD-Nav++ [ 9 ] demonstrate language-conditioned drone navigation using learned visuomotor policies, but focus exclusively on navigation without physical manipulation or contact. More broadly, while cross-embodiment datasets such as Open X-Embodiment [ 12 ] include dozens of manipulators, they contain no aerial platforms or underactuated flight dynamics, leaving the transferability of VLA representations to aerial manipulation unexplored. To address these gaps, we introduce AirVLA , the first systematic investigation of whether manipulation-pretrained VLA foundation models can transfer to aerial manipulators through fine-tuning. Our system consists of a ModalAI Starling 2 Max quadrotor equipped with a lightweight compliant gripper derived from the Universal Manipulation Interface (UMI) [ 11 , 20 , 19 ] , forward- and downward-facing onboard cameras, and a ROS-based control stack that treats the drone as a “flying end-effector.” We construct a diagnostic task suite spanning (i) pick-and-place manipulation collected via human teleoperation, (ii) navigation tasks with human teleoperation data and synthetic training trajectories generated using model predictive control (MPC) in Gaussian Splatting reconstructions, and (iii) compositional tasks that chain both behaviors. This design enables us to isolate which aspects of manipulation skill transfer to aerial platforms and which fail. We directly fine-tune the foundation-scale VLA policy \pi_{0} (pretrained on large manipulation datasets containing no aerial platforms) on our aerial manipulation data. Our experiments reveal partial but significant skill transfer: the fine-tuned policy learns stable hovering and coarse manipulation behaviors, demonstrating that foundation models capture some manipulation primitives that generalize to flight. However, standard fine-tuning fails at task completion due to sensitivity to payload dynamics and explicit obstacle navigation limitations. To address these specific failure modes, we introduce domain-adapted components: (i) a physics-aware low-level controller that wraps VLA outputs to enforce dynamically feasible commands, and (ii) synthetic navigation augmentation that enriches the training distribution. While these adaptations improve performance on navigation and stabilization during manipulation, fundamental limitations remain for long-horizon compositional manipulation and out-of-distribution adaptation, highlighting important open challenges in extending VLA models to underactuated, dynamic embodiments. In summary, this paper makes the following contributions: • We present AirVLA, the first demonstration of a pre-trained VLA fine-tuned for an aerial manipulation platform. • We manually collect a dataset of 270 aerial manipulation and navigation teleop-demos, to be open-sourced. • We synthesize 50 3DGS-based corrective navigation examples to help supervise VLA fine-tuning, showing a 20% increase in navigation task success compared to fine-tuning with teleop only. • We introduce a physics-informed guidance within real-time-chunking to adapt at runtime to the mass of a grasped object, improving task success by 10\%-40\% in pick and place tasks. II Related Work II-A Vision-Language-Action Policies for Manipulation Vision-language-action (VLA) policies leverage large-scale multimodal pretraining to enable general-purpose robot control from natural language instructions. Early approaches such as RT-1 [ 6 ] and RT-2 [ 7 ] demonstrated that vision-language models pretrained on internet-scale data can be fine-tuned for robotic manipulation, mapping visual observations and language to action sequences. Subsequent work has scaled this paradigm through cross-embodiment training: the Open X-Embodiment dataset [ 12 ] aggregates demonstrations from dozens of robot morphologies, enabling models like RT-X [ 12 ] to generalize across