EigenLoRAx: Recycling Adapters to Find Principal Subspaces for Resource-Efficient Adaptation and Inference

Prakhar Kaushik*, Ankit Vaidya*, Shravan Chaudhari, Alan Yuille · 2025

Read EigenLoRAx: Recycling Adapters to Find Principal Subspaces for Resource-Efficient Adaptation and Inference by Prakhar Kaushik*, Ankit Vaidya*, Shravan Chaudhari, Alan Yuille (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04700.txt.

Description

Prakhar Kaushik and co-authors recycle ready made adapters to tune large models with far less cost. Their paper from 2025 is called EigenLoRAx. Small adapters for large models are now shared in large numbers, each fit to its own domain, and the authors ask if that stock can be reused.

The method finds the shared core space across a set of adapters. New tasks then need only light weights on that core, not a full new adapter. Extra directions can be added when data are very thin. The result uses far fewer parameters and less memory in both training and use. Tests across domains and tasks show strong results, with gains for edge use and fair access.

Catalog record

CREATORPrakhar Kaushik*, Ankit Vaidya*, Shravan Chaudhari, Alan Yuille
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04700

Browse the full library · About the Tower of Babel