Parameter-Efficient Continual Fine-Tuning: A Survey

Eric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco · 2025

Read Parameter-Efficient Continual Fine-Tuning: A Survey by Eric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13822.txt.

Introduction

Eric Nuertey Coleman and six co-authors survey parameter-efficient continual fine-tuning in a 2025 paper. Big pre-trained models changed the field, but they rest on a fixed-data view of the world. Real work throws new tasks and new data at a model in a stream, which is the ground of continual learning.

To re-train the whole model each time is far too dear. A light path tunes just a small set of weights, or adds small new parts, for each new task. The survey maps those paths, their gains, and their traps, for teams who need a model that keeps up with a shifting world.

Catalog record

CREATOREric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE140 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-13822

Browse the full library · About the Tower of Babel