PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation

Tao Fan, Guoqiang Ma, Yuanfeng Song, Lixin Fan, Kai Chen, Qiang Yang · 2025

Read PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation by Tao Fan, Guoqiang Ma, Yuanfeng Song, Lixin Fan, Kai Chen, Qiang Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15857.txt.

Description

Fan and co-authors present PPC-GPT in 2025, a way to shrink large language models for one task without exposing private data. Compression usually needs the task data, which owners may not share. Their framework works across a server and clients in a federated setup.

The client sends privacy-noised task data to the server's big model. The big model then invents synthetic examples with written rationales. That synthetic set drives both pruning of the big model and retraining of the smaller one. Tests across text generation tasks kept performance close to the full model while protecting privacy. The code was contributed to an open-source federated AI project.

Catalog record

CREATORTao Fan, Guoqiang Ma, Yuanfeng Song, Lixin Fan, Kai Chen, Qiang Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-15857

Browse the full library · About the Tower of Babel