Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning

Laura Puccioni †, Alireza Farshin, Mariano Scazzariello, Changjie Wang, Marco Chiesa, Dejan Kostić · 2025

Read Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning by Laura Puccioni †, Alireza Farshin, Mariano Scazzariello, Changjie Wang, Marco Chiesa, Dejan Kostić (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05248.txt.

Description

Laura Puccioni and co-authors show how to carve small coding models out of large language models in a 2025 paper. Big models write code well but demand costly hardware. Trimming a model can shrink it, yet past trimming rarely aimed at one coding language at a time.

Using a trimming method fed with language-matched sample data, the team pulled out sub-models for four languages: Python, Java, C++, and JavaScript. The small models kept good accuracy next to the full models. Tests also showed that each language lights up distinct parts of the big model. Readers get a path to fast, local coding help on home-grade machines.

Catalog record

CREATORLaura Puccioni †, Alireza Farshin, Mariano Scazzariello, Changjie Wang, Marco Chiesa, Dejan Kostić
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-05248

Browse the full library · About the Tower of Babel