Morphing-based Compression for Data-centric ML Pipelines

Sebastian Baunsgaard, Matthias Boehm · 2025

Read Morphing-based Compression for Data-centric ML Pipelines by Sebastian Baunsgaard, Matthias Boehm (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11067.txt.

Description

Sebastian Baunsgaard and Matthias Boehm address slow, bulky data work in machine learning in a 2025 paper. Modern pipelines do more than train a model. They clean data, add new cases, and build new features in loops, then train again. Keeping numeric tables compressed saves memory and speeds work, but old methods miss patterns that these steps create.

Their system, BWARE, pushes compression through feature steps so it can use what those steps reveal about the data. It also reshapes a compressed table into a better form for the next task without first expanding it. Tests show large gains in end to end run time, which helps teams work with data that once barely fit in memory.

Catalog record

CREATORSebastian Baunsgaard, Matthias Boehm
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11067

Browse the full library · About the Tower of Babel