Parameter-Efficient Continual Fine-Tuning: A Survey
Eric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco · 2025
Read Parameter-Efficient Continual Fine-Tuning: A Survey by Eric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13822.txt.
Introduction
Eric Nuertey Coleman and six co-authors survey parameter-efficient continual fine-tuning in a 2025 paper. Big pre-trained models changed the field, but they rest on a fixed-data view of the world. Real work throws new tasks and new data at a model in a stream, which is the ground of continual learning.
To re-train the whole model each time is far too dear. A light path tunes just a small set of weights, or adds small new parts, for each new task. The survey maps those paths, their gains, and their traps, for teams who need a model that keeps up with a shifting world.
Catalog record
| CREATOR | Eric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 140 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13822