Combining Pre-Trained Models for Enhanced Feature Representation in Reinforcement Learning

Elia Piccoli, Malio Li, Giacomo Carfì, Vincenzo Lomonaco, Davide Bacciu · 2025

Read Combining Pre-Trained Models for Enhanced Feature Representation in Reinforcement Learning by Elia Piccoli, Malio Li, Giacomo Carfì, Vincenzo Lomonaco, Davide Bacciu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07197.txt.

Description

Trained models for vision and language hold rich knowledge, but game-playing agents usually learn from scratch. Elia Piccoli and co-authors ask how an agent in reinforcement learning can borrow from several trained models at once. In that style of learning, an agent acts, earns rewards, and slowly learns which acts pay off. Borrowing ready knowledge could speed that slow start.

The team proposes a design called Weight Sharing Attention, or WSA for short. The design blends the internal codes from different trained models into one shared picture of the world. Earlier work tended to use one large model, which is costly to run. A blend of smaller models could be cheaper and richer at once. The paper tests whether that blend gives agents a better start.

Catalog record

CREATORElia Piccoli, Malio Li, Giacomo Carfì, Vincenzo Lomonaco, Davide Bacciu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-07197

Browse the full library · About the Tower of Babel