Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning
Laura Puccioni †, Alireza Farshin, Mariano Scazzariello, Changjie Wang, Marco Chiesa, Dejan Kostić · 2025
Read Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning by Laura Puccioni †, Alireza Farshin, Mariano Scazzariello, Changjie Wang, Marco Chiesa, Dejan Kostić (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05248.txt.
Description
Laura Puccioni and co-authors show how to carve small coding models out of large language models in a 2025 paper. Big models write code well but demand costly hardware. Trimming a model can shrink it, yet past trimming rarely aimed at one coding language at a time.
Using a trimming method fed with language-matched sample data, the team pulled out sub-models for four languages: Python, Java, C++, and JavaScript. The small models kept good accuracy next to the full models. Tests also showed that each language lights up distinct parts of the big model. Readers get a path to fast, local coding help on home-grade machines.
Catalog record
| CREATOR | Laura Puccioni †, Alireza Farshin, Mariano Scazzariello, Changjie Wang, Marco Chiesa, Dejan Kostić |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-05248