PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation
Tao Fan, Guoqiang Ma, Yuanfeng Song, Lixin Fan, Kai Chen, Qiang Yang · 2025
Read PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation by Tao Fan, Guoqiang Ma, Yuanfeng Song, Lixin Fan, Kai Chen, Qiang Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15857.txt.
Description
Fan and co-authors present PPC-GPT in 2025, a way to shrink large language models for one task without exposing private data. Compression usually needs the task data, which owners may not share. Their framework works across a server and clients in a federated setup.
The client sends privacy-noised task data to the server's big model. The big model then invents synthetic examples with written rationales. That synthetic set drives both pruning of the big model and retraining of the smaller one. Tests across text generation tasks kept performance close to the full model while protecting privacy. The code was contributed to an open-source federated AI project.
Catalog record
| CREATOR | Tao Fan, Guoqiang Ma, Yuanfeng Song, Lixin Fan, Kai Chen, Qiang Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-15857