Combining Pre-Trained Models for Enhanced Feature Representation in Reinforcement Learning
Elia Piccoli, Malio Li, Giacomo Carfì, Vincenzo Lomonaco, Davide Bacciu · 2025
Read Combining Pre-Trained Models for Enhanced Feature Representation in Reinforcement Learning by Elia Piccoli, Malio Li, Giacomo Carfì, Vincenzo Lomonaco, Davide Bacciu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07197.txt.
Description
Trained models for vision and language hold rich knowledge, but game-playing agents usually learn from scratch. Elia Piccoli and co-authors ask how an agent in reinforcement learning can borrow from several trained models at once. In that style of learning, an agent acts, earns rewards, and slowly learns which acts pay off. Borrowing ready knowledge could speed that slow start.
The team proposes a design called Weight Sharing Attention, or WSA for short. The design blends the internal codes from different trained models into one shared picture of the world. Earlier work tended to use one large model, which is costly to run. A blend of smaller models could be cheaper and richer at once. The paper tests whether that blend gives agents a better start.
Catalog record
| CREATOR | Elia Piccoli, Malio Li, Giacomo Carfì, Vincenzo Lomonaco, Davide Bacciu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-07197