VANGUARD: Vehicle-Anchored Ground Sample Distance Estimation for UAVs in GPS-Denied Environments
Yifei Chen, Xupeng Chen, Jiayin Liu, Feng Wang, and Niangang Jiao · 2026
Read VANGUARD: Vehicle-Anchored Ground Sample Distance Estimation for UAVs in GPS-Denied Environments by Yifei Chen, Xupeng Chen, Jiayin Liu, Feng Wang, and Niangang Jiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04277.txt.
Introduction
Chen and colleagues restore scale for drones that lose GPS and camera metadata. Five leading vision language models misjudge area badly, with median errors above 50 percent. Their tool, VehAnchor, reads ground sample distance from vehicles seen in aerial images. It estimates typical car pixel length from oriented boxes by kernel density estimation, then converts it with a pre calibrated reference. On DOTA the median error is 6.87 percent across 306 images, and with segmentation downstream area error falls sharply.
Catalog record
| CREATOR | Yifei Chen, Xupeng Chen, Jiayin Liu, Feng Wang, and Niangang Jiao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24177 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04277
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VANGUARD: Vehicle-Anchored Ground Sample Distance Estimation for UAVs in GPS-Denied Environments Yifei Chen, Xupeng Chen, Jiayin Liu, Feng Wang, and Niangang Jiao Abstract Autonomous aerial robots operating in GPS-denied or communication-degraded environments frequently lose access to camera metadata and telemetry, leaving onboard perception systems unable to recover the absolute metric scale of the scene. As LLM/VLM-based planners are increasingly adopted as high-level agents for embodied systems, their ability to reason about physical dimensions becomes safety-critical—yet our experiments show that five state-of-the-art VLMs suffer from spatial scale hallucinations , with median area estimation errors exceeding 50%. We propose VANGUARD, a lightweight, deterministic Geometric Perception Skill designed as a callable tool that any LLM-based agent can invoke to recover Ground Sample Distance (GSD) from ubiquitous environmental anchors: small vehicles detected via oriented bounding boxes, whose modal pixel length is robustly estimated through kernel density estimation and converted to GSD using a pre-calibrated reference length. The tool returns both a GSD estimate and a composite confidence score, enabling the calling agent to autonomously decide whether to trust the measurement or fall back to alternative strategies. On the DOTA v1.5 benchmark, VANGUARD achieves 6.87% median GSD error on 306 images. Integrated with SAM-based segmentation for downstream area measurement, the pipeline yields 19.7% median error on a 100-entry benchmark—with 2.6 × \times lower category dependence and 4 × \times fewer catastrophic failures than the best VLM baseline—demonstrating that equipping agents with deterministic geometric tools is essential for safe autonomous spatial reasoning. Fig. 1: Our Geometric Perception Skill in action on a DOTA v1.5 image (P2593, Ground Track Field). (a) A UAV captures an image without metadata; the target object (red box) must be measured from pixels alone. (b) Our skill detects small vehicles via oriented bounding boxes (green) and derives \mathrm{GSD}=0.241 m/px from their modal pixel length. (c) Combined with SAM segmentation, the pipeline predicts the field area within 1.8% of ground truth, whereas GPT-4 o hallucinates a 50% underestimate. I INTRODUCTION Micro aerial vehicles (MAVs) and unmanned aerial vehicles (UAVs) are increasingly deployed for autonomous tasks—disaster assessment, infrastructure inspection, precision agriculture, and search-and-rescue—where onboard perception must deliver metric-scale spatial understanding in real time. In GPS-denied, communication-degraded, or previously unmapped environments, these platforms routinely lose access to camera metadata and absolute telemetry, leaving monocular imagery as the sole input. Without knowing the Ground Sample Distance (GSD)—the physical size of each pixel—pixel-level measurements cannot be converted to real-world dimensions, and any downstream spatial reasoning becomes unreliable. The robotics community has increasingly turned to vision-language models (VLMs) and large language models (LLMs) as high-level planners and agents for embodied systems [ 4 ] . However, our experiments reveal a critical failure mode: when tasked with estimating physical areas from aerial imagery alone, five state-of-the-art VLMs exhibit median errors of 38–52%, with frequent order-of-magnitude deviations. We term this failure Spatial Scale Hallucination —the systematic inability of VLMs to ground visual observations in metric scale without explicit geometric calibration. This poses a direct safety risk for autonomous UAV operations: a planner that misjudges a landing zone’s dimensions by 50% could attempt a catastrophic landing on an insufficiently sized surface. We propose VANGUARD ( V ehicle- AN chored G eometric U nderstanding A nd R esolution D etermination)—a lightweight, deterministic Geometric Perception Skill and callable tool that LLM-based planners can invoke to recover absolute scale from monocular aerial imagery. Our key observation is that small vehicles are among the most ubiquitous objects in urban and suburban scenes, with physical lengths concentrated around 4–5 m worldwide. The pipeline detects vehicles via oriented bounding boxes (OBB), robustly estimates their modal pixel length through kernel density estimation (KDE), and converts it to GSD using a pre-calibrated reference length. Our contributions are: • A metadata-free GSD estimation method using vehicles as geometric anchors, achieving 6.87% median error on DOTA v1.5 (306 images, 67% coverage), with KDE providing 17% improvement over mean aggregation. • Empirical evidence of Spatial Scale Hallucination in VLMs: a 100-entry benchmark showing that even with explicit vehicle-length hints, VLMs exhibit 2.6 \times higher category dependence and 4 \times more catastrophic failures than our deterministic pipeline. • Integration as a Geometric Perception Skill for tool-augmented agents: a stateless API that accepts a monocular image and returns ( \mathrm{GSD}_{\mathrm{pred}} , \mathcal{C} ), enabling LLM/VLM planners to make safety-aware metric decisions without GPS or metadata dependencies. II RELATED WORK GSD and scale estimation. Traditional GSD determination relies on sensor specifications, flight altitude, and camera calibration [ 24 , 20 ] . When metadata is unavailable, alternative approaches attempt to infer spatial scale from image content: shadow-based methods [ 12 ] , monocular depth estimation [ 17 , 3 ] , and regression CNNs [ 9 ] . However, these methods either require supervised training with GSD labels or recover only relative depth. Wang and Wang [ 22 ] proposed a visual agentic system for scale estimation using GPT-4 o -based reference object selection, but their dependence on a proprietary model limits reproducibility. We address these gaps by focusing on a single, well-characterised reference class (small vehicles) with kernel density estimation [ 18 , 16 , 19 ] for robust mode finding. VLM spatial reasoning deficiencies. Despite rapid progress in vision-language models for remote sensing [ 8 , 10 , 13 ] , fundamental limitations in spatial reasoning persist. Liu et al. [ 14 ] demonstrate a large human–model gap on spatial relation tasks; Chen et al. [ 4 ] show VLMs lack 3D spatial reasoning for distance and size estimation; and Liao et al. [ 11 ] find that VLMs struggle with quantitative spatial reasoning even when provided with reference objects. These findings motivate our approach: rather than relying on VLMs for metric-scale reasoning, we provide a deterministic geometric tool that embodied agents can invoke to ground their spatial understanding. III METHOD III-A Overview Given a monocular aerial image I with unknown GSD, our Geometric Perception Skill estimates \mathrm{GSD}_{\mathrm{pred}} (metres per pixel) using only the image content. The skill is designed as a stateless, deterministic API : a calling agent submits an image and receives a structured response (\mathrm{GSD}_{\mathrm{pred}},\mathcal{C}) , where \mathcal{C}\in[0,1] is a composite confidence score that the agent can use to gate downstream decisions. The pipeline consists of five stages (Fig. 2 ): (1) vehicle detection via OBB, (2) outlier filtering, (3) KDE mode estimation, (4) GSD computation, and (5) multi-dimensional confidence evaluation. Deterministic Geometric Skill (API) UAV Camera GPS-Denied YOLO11 l -OBB Outlier Filtering KDE Mode Estimation Resolution Guard & GSD Vehicle Det. \alpha=1.5 L_{\mathrm{ref}}=5.045 m P_{\mathrm{thresh}}\approx 17 px image \{P_{i},C_{i}\} filtered P_{\mathrm{mode}} LLM / VLM Planner \mathrm{GSD}_{\mathrm{pred}} , \mathcal{C} VLM Direct Visual Guess Spatial Scale Hallucination raw pixels only > 50% error × Safe Metric Planning grounded ✓ Fig. 2: System architecture as an Embodied Agent Perception Loop. Left : a UAV operating in a GPS-denied environment captures monocular imagery. Centre (dashed box): our Deterministic Geometric Skill processes the image through YOLO-OBB detection, outlier filtering, KDE mode estimation, and a resolution guard to produce a calibrated GSD with confidence score. Right : the LLM/VLM Planner can either rely on direct visual estimation ( red path ), suffering from Spatial Scale Hallucination ( > 50% error), or invoke our Geometric Skill