Collaborative and Efficient Fine-tuning: Leveraging Task Similarity
Gagik Magakyan, Amirhossein Reisizadeh, Chanwoo Park, Pablo A. Parrilo, Asuman Ozdaglar · 2026
Read Collaborative and Efficient Fine-tuning: Leveraging Task Similarity by Gagik Magakyan, Amirhossein Reisizadeh, Chanwoo Park, Pablo A. Parrilo, Asuman Ozdaglar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07218.txt.
Description
Fine-tuning a large model for a new task usually needs scarce labeled data, but similar tasks can help each other. Gagik Magakyan and four co-authors propose Collaborative Low-Rank Adaptation, or CoLoRA, which exploits task similarity across users to fine-tune personalized models more efficiently.
CoLoRA trains one shared adapter that captures what tasks have in common, alongside personal adapters tuned to each user's task. The paper studies the method theoretically as well as empirically. The idea is simple and appealing: users with similar jobs pool their effective data without pooling their models. Users short on labels get a collaborative route to adaptation that respects personalization.
Catalog record
| CREATOR | Gagik Magakyan, Amirhossein Reisizadeh, Chanwoo Park, Pablo A. Parrilo, Asuman Ozdaglar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 178 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07218