Direct Post-Training Preference Alignment for Multi-Agent Motion Generation Models Using Implicit Feedback from Pre-training Demonstrations

Ran Tian, Kratarth Goel · 2025

Read Direct Post-Training Preference Alignment for Multi-Agent Motion Generation Models Using Implicit Feedback from Pre-training Demonstrations by Ran Tian, Kratarth Goel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20105.txt.

Description

Ran Tian and Kratarth Goel align motion models with human taste without new human labels in 2025. Motion models trained to predict tokens often produce moves people dislike. Fixing that gap usually needs costly human rankings of model output, above all in scenes with many agents.

Earlier fixes treat every model sample as bad, which wastes the ranking signal hidden in training demos. Tian and Goel instead mine those demos for implied rankings among the model outputs. Tests on large traffic scenes show more realistic behavior at low cost. A small one-million-parameter model matched big imitation models using only this implied feedback.

Catalog record

CREATORRan Tian, Kratarth Goel
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-20105

Browse the full library · About the Tower of Babel