OmniSage: Large Scale, Multi-Entity Heterogeneous Graph Representation Learning DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Learning

Anirudhan Badrinath, Alex Yang, Kousik Rajesh, Prabhat Agarwal, Jaewon Yang, Haoyu Chen, Jiajing Xu, Charles Rosenberg · 2025

Read OmniSage: Large Scale, Multi-Entity Heterogeneous Graph Representation Learning DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Learning by Anirudhan Badrinath, Alex Yang, Kousik Rajesh, Prabhat Agarwal, Jaewon Yang, Haoyu Chen, Jiajing Xu, Charles Rosenberg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17811.txt.

Introduction

Anirudhan Badrinath and co-authors from Pinterest describe a single system that learns compact codes for the many kinds of items on the platform, in a 2025 paper. Such codes power search and recommendations. Older methods each handled one angle: links between items, the order of user actions, or the content of posts themselves.

Their system, OmniSage, blends all three through several paired learning tasks. Custom infrastructure trains it on graphs with billions of nodes. Once learned, the same codes serve many products at once. The company reports about a two and a half percent rise in saves across five applications after rollout. The model code was released in public, an unusual step for work at this scale.

Catalog record

CREATORAnirudhan Badrinath, Alex Yang, Kousik Rajesh, Prabhat Agarwal, Jaewon Yang, Haoyu Chen, Jiajing Xu, Charles Rosenberg
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17811

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OmniSage: Large Scale, Multi-Entity Heterogeneous Graph Representation Learning DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Learning latent representations CCS: Computing methodologies Multi-task learning Anirudhan Badrinath, Alex Yang, Kousik Rajesh, Prabhat Agarwal, Jaewon Yang, Haoyu Chen, Jiajing Xu, Charles Rosenberg Abstract . Representation learning, a task of learning latent vectors to represent entities, is a key task in improving search and recommender systems in web applications. Various representation learning methods have been developed, including graph-based approaches for relationships among entities, sequence-based methods for capturing the temporal evolution of user activities, and content-based models for leveraging text and visual content. However, the development of a unifying framework that integrates these diverse techniques to support multiple applications remains a significant challenge. This paper presents OmniSage, a large-scale representation framework that learns universal representations for a variety of applications at Pinterest. OmniSage integrates graph neural networks with content-based models and user sequence models by employing multiple contrastive learning tasks to effectively process graph data, user sequence data, and content signals. To support the training and inference of OmniSage, we developed an efficient infrastructure capable of supporting Pinterest graphs with billions of nodes. The universal representations generated by OmniSage have significantly enhanced user experiences on Pinterest, leading to an approximate 2.5% increase in sitewide repins (saves) across five applications. This paper highlights the impact of unifying representation learning methods, and we will open source the OmniSage code by the time of publication. 1. Introduction Pinterest is a content discovery platform with over 550 million monthly active users ( Pinterest 2024 ) engaging with over 1.5 billion Pins every week ( Pinterest 2024 ) . Each Pin consists of an image and text, representing ideas that users can explore and save. Users organize these Pins into boards for ease of access and categorization. Given the vast number of Pins available on Pinterest, it is critical to provide relevant and engaging recommendations for each surface, including the Homefeed, the related Pins feed, and search results. To support Pinterest’s extensive, multidisciplinary applications, it is important to develop a universal, shareable, and rich understanding of entities (Pins, boards, items, queries, and users) ( Ying et al. 2018 ; Baltescu et al. 2022 ; Agarwal et al. 2024 ; Pancha et al. 2022 ) . Figure 1 . An example illustrating how different entities and their interactions on Pinterest are represented as a heterogenous graph. A diagram showing various entities on Pinterest and their interactions represented as a heterogeneous graph, demonstrating relationships and connections. Representation learning, which involves creating latent embedding vectors for entities, has been crucial in many industrial applications, such as people recommendation ( Sankar et al. 2021 ) , news recommendation ( Ge et al. 2020 ) , job recommendation ( Borisyuk et al. 2024 ) and shopping ( Liu et al. 2022 ) . Representation learning methods have evolved to consume different types of signals. Graph neural networks are specialized in understanding the relationships among entities in graphs ( Hamilton et al. 2017b ; Kipf and Welling 2017 ) . Sequence models can capture how users’ interests evolve over time by encoding a sequence of user activities ( Pancha et al. 2022 ) . Content-based models convert textual and image content into embeddings ( Devlin et al. 2019 ; He et al. 2022 ) . Despite the individual strengths of these approaches, the development of a method that synergistically integrates the advantages of all these techniques remains relatively unexplored. In this paper, we aim to develop a unifying, large-scale framework that leverages the three major sources of signals, namely graphs, content-based and user activity history (sequence) signals, to learn and generate representations that are universally useful for multiple downstream applications. This is challenging for several reasons. A core challenge is scaling up graph neural networks, especially for sampling neighbors and fetching node features across billions of nodes and edges on billions of training examples. Additionally, we must optimally extend graph neural networks (GNNs) at scale to accommodate heterogeneity, i.e., different node and edge types within graphs. The third is to effectively capture graphs, content signals, and user activity sequences. Graphs and sequences are distinct data types, each requiring different model architectures. The fourth is to learn representations that can effectively support multiple applications. The impact of various tasks and model architectures on the performance of representations across multiple applications has been unclear. We note that existing large-scale representation learning methods have not addressed all the aforementioned challenges comprehensively. Most existing large-scale graph-based methods have focused on handling only graphs ( Lerer et al. 2019 ; Zheng et al. 2024 ; Han et al. 2023 ; Yang 2019 ) , omitting user activity sequences or content signals. LiGNN ( Borisyuk et al. 2024 ) presents a large-scale GNN infrastructure capable of handling sequences but it does not focus on developing universal representations; instead, it implements GNN models customized to each specific use case. We present OmniSage, a novel large-scale representation learning that combines graph neural networks with sequence and content models. Our contributions are as follows: • Scalable GNN training and inference: We develop infrastructure to sample neighbors and fetch neighbors’ features efficiently for a massive scale of training and inference data. Our infrastructure can support graphs with billions of entities and host heterogeneous graphs with multiple node types and edge types. This addresses the first and second challenges we mentioned above. • Multi-task contrastive learning with graphs, sequences and content : For the challenge of handling graphs, user activity sequences, and content, we adopt a contrastive learning framework ( Wang et al. 2021 ) to formulate tasks covering the three different data types in a unified manner. In particular, we define three contrastive learning tasks: entity-entity task (from graphs), entity-feature task (from content), and the user-entity task (from user activity sequences). • Deploying universal representation for multiple tasks : Using our framework, we learn representations and deploy them to power multiple applications. We conducted rigorous ablation analysis to study the impact of each task on different applications. The organization for the rest of paper is as follows. Sec. 2 discusses related work. Sec. 3 discusses the tasks OmniSage is trained on and the model architecture. Sec. 4 presents offline and online experimental results and analyses. 2. Related Work We discuss related work in a few main areas of representation learning, primarily about Graph Neural Networks. Graph Neural Networks (GNNs) are a powerful tool to learn representations from the graph data. Several architectures have been developed, including GraphSage ( Hamilton et al. 2017b ) , Graph Convolutional Networks ( Kipf and Welling 2017 ) , Graph Attention Networks ( Velickovic et al. 2018 ) and Graph Transformers ( Yun et al. 2019 ) . Our work expands on GraphSage by sampling the neighbors of a given node using an aggregator network. However, there are two differences. Firstly, instead of mean/max/min pooling for aggregation, we utilize a transformer network ( Yun et al. 2019 ) . Secondly, we employ random walks ( Grover and Leskovec 2016 ) to sample neighbors, as it is easy to scale and more effective

Read the complete text