EigenLoRAx: Recycling Adapters to Find Principal Subspaces for Resource-Efficient Adaptation and Inference
Prakhar Kaushik*, Ankit Vaidya*, Shravan Chaudhari, Alan Yuille · 2025
Read EigenLoRAx: Recycling Adapters to Find Principal Subspaces for Resource-Efficient Adaptation and Inference by Prakhar Kaushik*, Ankit Vaidya*, Shravan Chaudhari, Alan Yuille (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04700.txt.
Description
Prakhar Kaushik and co-authors recycle ready made adapters to tune large models with far less cost. Their paper from 2025 is called EigenLoRAx. Small adapters for large models are now shared in large numbers, each fit to its own domain, and the authors ask if that stock can be reused.
The method finds the shared core space across a set of adapters. New tasks then need only light weights on that core, not a full new adapter. Extra directions can be added when data are very thin. The result uses far fewer parameters and less memory in both training and use. Tests across domains and tasks show strong results, with gains for edge use and fair access.
Catalog record
| CREATOR | Prakhar Kaushik*, Ankit Vaidya*, Shravan Chaudhari, Alan Yuille |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04700