CRED: Counterfactual Reasoning and Environment Design for Active Preference Learning

Yi-Shiuan Tung, Bradley Hayes, Alessandro Roncone, Yi-Shiuan Tung, Bradley Hayes, and Alessandro Roncone · 2025

Read CRED: Counterfactual Reasoning and Environment Design for Active Preference Learning by Yi-Shiuan Tung, Bradley Hayes, Alessandro Roncone, Yi-Shiuan Tung, Bradley Hayes, and Alessandro Roncone (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05458.txt.

Description

Robots that serve people need to learn what each person likes, such as a safe route or a fast one. Yi-Shiuan Tung, Bradley Hayes, and Alessandro Roncone wrote a 2025 paper on a method called CRED, which helps a robot learn human reward from ranked paths. Older methods often miss good paths and ask weak questions, above all in long tasks.

CRED makes up new scenes and asks what the reward would be if a guessed taste were the true one. That mix yields a wide, useful set of paths for a person to rank. Tests in a grid world and on real street maps from OpenStreetMap showed better reward learning. The gains also held when the scene changed.

Catalog record

CREATORYi-Shiuan Tung, Bradley Hayes, Alessandro Roncone, Yi-Shiuan Tung, Bradley Hayes, and Alessandro Roncone
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05458

Browse the full library · About the Tower of Babel