Balanced Co-Clustering of Users and Items for Embedding Table Compression in Recommender Systems DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Clustering CCS: Information systems Recommender systems CCS: Mathematics of computing Graph algorithms

Runhao Jiang, Renchi Yang, Donghao Wu · 2026

Read Balanced Co-Clustering of Users and Items for Embedding Table Compression in Recommender Systems DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Clustering CCS: Information systems Recommender systems CCS: Mathematics of computing Graph algorithms by Runhao Jiang, Renchi Yang, Donghao Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18351.txt.

Introduction

Jiang, Yang, and Wu present BACO, a framework that shrinks recommender embedding tables by clustering users and items. Huge tables strain memory and compute at industrial scale, while past compression either hurts accuracy or costs too much. BACO groups similar users and items to share codebook embeddings, balancing cluster connectivity against cluster size. Tests against full models and 18 baselines cut parameters by over 75 percent with at most about 2 percent recall loss, running up to 346 times faster than the strongest baseline.

Catalog record

CREATORRunhao Jiang, Renchi Yang, Donghao Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78596
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18351

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Balanced Co-Clustering of Users and Items for Embedding Table Compression in Recommender Systems DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Clustering CCS: Information systems Recommender systems CCS: Mathematics of computing Graph algorithms Runhao Jiang, Renchi Yang, Donghao Wu Abstract . Recommender systems have advanced markedly over the past decade by transforming each user/item into a dense embedding vector with deep learning models. At industrial scale, embedding tables constituted by such vectors of all users/items demand a vast amount of parameters and impose heavy compute and memory overhead during training and inference, hindering model deployment under resource constraints. Existing solutions towards embedding compression either suffer from severely compromised recommendation accuracy or incur considerable computational costs. To mitigate these issues, this paper presents BACO , a fast and effective framework for compressing embedding tables. Unlike traditional ID hashing, BACO is built on the idea of exploiting collaborative signals in user-item interactions for user and item groupings, such that similar users/items share the same embeddings in the codebook. Specifically, we formulate a balanced co-clustering objective that maximizes intra-cluster connectivity while enforcing cluster-volume balance, and unify canonical graph clustering techniques into the framework through rigorous theoretical analyses. To produce effective groupings while averting codebook collapse, BACO instantiates this framework with a principled weighting scheme for users and items, an efficient label propagation solver, as well as secondary user clusters. Our extensive experiments comparing BACO against full models and 18 baselines over benchmark datasets demonstrate that BACO cuts embedding parameters by over 75% with a drop of at most 1.85% in recall, while surpassing the strongest baselines by being up to 346 × 346\times faster. Technical Report 1. Introduction In modern recommender systems, deep learning models ( Zhang et al. 2019 ) have become the go-to approach for recommendations, typically working with embedding tables that map each category feature value, e.g., the ID of a user or item, to a unique vector representation. However, in industrial-scale scenarios, these embedding tables consume a vast amount of parameters, often reaching hundreds of GB or even TB, due to the need to represent billions of users/items ( Guo et al. 2021 ) . For instance, embedding tables deployed in Baidu’s advertising systems may occupy up to 10 TB of storage ( Xu et al. 2021 ) , while at Meta’s scale, i.e., 3 billion monthly active users worldwide ( Gupta et al. 2020 ) , the user embedding table in a recommender model can easily reach 715 GB of space for 64-dimensional vectors in 32-bit floating point. As a consequence, the expansion of embedding tables intensifies storage and hardware demands, thus impeding model scalability and deployment in real production environments ( Zhang et al. 2020 ; Coleman et al. 2023 ) . In recent years, embedding table compression (ETC) ( Li et al. 2024 ) , which seeks to reduce the sizes of embedding tables with minimal degradation in precision, has emerged as a popular choice in industry ( Wu et al. 2020 ; Wu et al. 2025 ; Tsang and Ahle 2023 ; Chen et al. 2023 ) and is gaining increasing traction in recommender systems ( Zhang et al. 2020 ; Coleman et al. 2023 ; Chen et al. 2018 ) . Most existing works towards ETC generally follow three compression paradigms: pre-training , in-training , and post-training compressions, where the former generates the mappings for users/items in embedding tables before training recommendation models, while the latter two strategies compress the full embeddings when they are partially or fully learned. Despite being effective, the in-training/post-training scheme additionally introduces considerable training overhead, and still suffers from substantial memory footprint. A common treatment for pre-training ETC is to hash the user/item IDs down to a set of buckets with a manageable size through hashing functions ( Coleman et al. 2023 ; Ghaemmaghami et al. 2022 ; Weinberger et al. 2009 ; Zhang et al. 2020 ) . The users/items mapped to the same bucket will share the same embedding vectors in the reduced embedding tables (a.k.a. codebooks ). Although this methodology is computationally efficient, it relies on hashing that is essentially random, which will represent unrelated users/items by the same embeddings, and hence, engendering severe embedding collisions and performance degradation ( Ghaemmaghami et al. 2022 ; Zhang et al. 2020 ) . Subsequent studies alleviate embedding collision issues through the (i) employment of multiple hash functions ( Shi et al. 2020 ; Zhang et al. 2020 ) , (ii) incorporation of feature and frequency statistics ( Coleman et al. 2023 ; Ghaemmaghami et al. 2022 ; Zhang et al. 2018 ) , and (iii) learned hashing techniques ( Tsang and Ahle 2023 ; Liang et al. 2024 ) . These methods either still incur subpar recommendation performance, or require additional user/item information or training costs. Most importantly, the collaborative signals underlying the user-item interactions are largely overlooked for ETC. Very recently, Wu et al. 2025 made an attempt to exploit the collaborative information of users/items by reframing the ETC task as a graph clustering problem. They simply apply the highly-efficient Louvain algorithm ( Blondel et al. 2008 ) over the user-item interaction graph to derive clusters of users/items as their buckets, which surprisingly yield remarkable improvements in recommendation quality. Unfortunately, Louvain suffers from an inherent drawback of resolution limit ( Kim et al. 2022 ) , leading to suboptimal results. Inspired by the efficacy of leveraging collaborative signals, we make further inroads by presenting BACO , a fast and effective solution for ETC via BA lanced CO -clustering. Specifically, we first reveal two factors, i.e., intra-cluster connectivity and cluster-size balance , that are crucial to clustering for ETC, through an empirical study, which in essence correspond to the embedding collision and codebook collapse ( Tsang and Ahle 2023 ) , respectively. Based thereon, we develop a theoretically-grounded balanced co-clustering framework aiming at optimizing these two factors, and establish its theoretical connections to classic graph clustering algorithms. Building on the framework, we propose a well-thought-out hybrid weighting scheme (HWS) for users and items, and develop a fast optimization solver through local greedy label propagation ( Raghavan et al. 2007 ) to circumvent the resolution limit. To account for the multiple and evolving interests of users, BACO further constructs secondary clusters for users (SCU) rapidly based upon the primary clusters, thereby overcoming the representation limitation of each user without inducing additional space overhead. Our comprehensive empirical evaluations and ablation studies manifest that (i) our BACO can consistently achieve markedly superior recommendation quality over 18 ETC baselines, while often being highly efficient, and (ii) our proposed HWS and SCU strategies can conspicuously enhance recommendation accuracies even when working with other clustering baselines. 2. Related Work We review existing studies on ETC in the sequel and defer reviews on co-clustering and bipartite graph clustering to Appendix B . Hashing-based Methods. Hashing methods offer a straightforward and efficient means of compressing embedding tables by mapping IDs into a smaller index space using hash functions. For instance, the basic hashing method ( Weinberger et al. 2009 ) simply employs random function to achieve compression. Although efficient, this approach may introduce collisions. ( Zhang et al. 2018 ) increases the probability that colliding objects are

Read the complete text