Visual Language Models as Operator Agents in the Space Domain

Richard Linares · 2025

Read Visual Language Models as Operator Agents in the Space Domain by Richard Linares (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-07802.txt.

Description

Alejandro Carrasco and five co-authors test vision language models as operator agents for space missions in this 2025 paper. These models read images and text together. The team tried them in two settings. In simulation, the agent watched screenshots of a spaceflight game and flew orbital maneuvers from what it saw. In the lab, the same kind of model drove robots with cameras to inspect and diagnose physical satellite like objects.

The agents produced sensible, context fitting actions from raw views, rivaling traditional methods and text only models in the simulator. Hardware trials showed promise rather than polish. The attraction is generality: one agent that sees can handle tasks no one scripted in advance. Space operations prize that flexibility, since missions meet problems that ground teams never rehearsed. The authors present the work as early evidence.

Catalog record

CREATORRichard Linares
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-07802

Browse the full library · About the Tower of Babel