VLM-Guided Experience Replay

Elad Sharony, Tom Jurgenson, Orr Krupnik, Dotan Di Castro, Shie Mannor · 2026

Read VLM-Guided Experience Replay by Elad Sharony, Tom Jurgenson, Orr Krupnik, Dotan Di Castro, Shie Mannor (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01915.txt.

Description

Elad Sharony and colleagues use a frozen pretrained vision language model to prioritize reinforcement learning replay buffer experiences. The buffer stores and reuses agent experiences, yet stayed unexplored for vision language model guidance while other components already used such models. Their method picks promising sub trajectories from agent experiences, acting as an automated evaluator. Across game playing and robotics tasks in discrete and continuous domains, agents trained with the method reach fifteen to fifty seven percent higher success than prior approaches. Sample efficiency improves thirty five to fifty five percent.

Catalog record

CREATORElad Sharony, Tom Jurgenson, Orr Krupnik, Dotan Di Castro, Shie Mannor
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75115
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01915

Browse the full library · About the Tower of Babel