EBind : a practical approach to space binding

Jim Broadbent, Felix Cohen, Frederik Hvilshøj, Eric Landau & Eren Sasoglu · 2025

Read EBind : a practical approach to space binding by Jim Broadbent, Felix Cohen, Frederik Hvilshøj, Eric Landau & Eren Sasoglu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14229.txt.

Introduction

Jim Broadbent, Felix Cohen, Frederik Hvilshøj, and two co-authors present EBind, a lean way to bind the embedding spaces of different senses into one. Their recipe uses a single encoder per modality and leans hard on data quality, training a competitive joint model on one GPU in hours instead of days. The model spans image, text, video, audio, and 3D at under two billion parameters.

Training mixes three sources: millions of automatically assembled five-way matched sets, a million human-judged triples marked negative, partial, or positive, and millions of pre-existing captioned items. Across thirteen evaluations the small model beat rivals several times its size. Code, weights, and data are open-sourced, along with a new audio-to-3D classification benchmark.

Catalog record

CREATORJim Broadbent, Felix Cohen, Frederik Hvilshøj, Eric Landau & Eren Sasoglu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-14229

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EBind : a practical approach to space binding Jim Broadbent, Felix Cohen, Frederik Hvilshøj, Eric Landau & Eren Sasoglu Abstract We simplify space binding by focusing on two core components, a single encoder per modality and high-quality data; enabling training state-of-the-art models on a single GPU in a few hours as opposed to multiple days. We present EBind , an E asy, data-centric, and parameter-efficient method to Bind the embedding spaces of multiple contrastive models. We demonstrate that a simple 1.8B-parameter image-text-video-audio-3D model can outperform models 4 to 17 × \times the size. The key to achieving this is a carefully curated dataset of three complementary data sources: i) 6.7M fully-automated multimodal quintuples sourced via SOTA retrieval models, ii) 1M diverse, semi-automated triples annotated by humans as negative, partial, or positive matches, and iii) 3.4M pre-existing captioned data items. We use 13 different evaluations to demonstrate the value of each data source. Due to limitations with existing benchmarks, we further introduce the first high-quality, consensus-annotated zero-shot classification benchmark between audio and PCs. In contrast to related work, we will open-source our code, model weights, and datasets. (a) Model Overview. CL means Contrastive Loss. (b) New Human Annotations. (c) Avg. over 13 benchmarks. Figure 1: Overview of the EBind approach and results. 1 Introduction Multimodal contrastive models have emerged as foundational components of modern AI systems. From CLIP’s revolutionary image-text alignment ( Radford et al. 2021 ) to CLAP’s audio-text embeddings ( Elizalde et al. 2023 ) and Uni3D’s 3D-text representations ( Zhou et al. 2024 ) , these models power advanced machine learning applications like retrieval systems ( Abootorabi et al. 2025 ) , automatic labeling ( Gao et al. 2024 ; Zhang et al. 2024a ) , and conditional generation ( Li et al. 2023 ; Ramesh et al. 2022 ; Steiner et al. 2024 ; Guo et al. 2023 ) . This ability to process many modalities, like text, images, audio, video, and 3D point clouds (PC), has led to multimodal learning being widely recognized as a critical enabler of progress toward artificial general intelligence ( Song et al. 2025 ) . The natural progression toward truly unified multimodal understanding has led researchers to explore binding separate bi/tri-modal embedding spaces into joint representation spaces, as demonstrated by pioneering work such as ImageBind ( Girdhar et al. 2023 ) , LanguageBind ( Zhu et al. 2024 ) , and OmniBind ( Kong et al. 2025 ) . Binding multiple modalities together demonstrates emergent properties like the ability to do similarity searches between any two modalities. In this work, we focus on models that embed not only vision and language but also audio and PCs, e.g., Zhang et al. 2024b and Wang et al. 2025 . Such multimodal models not only have the potential to power next-generation LLMs, retrieval systems, and generative models spanning more modalities, but also to help advance fields like autonomous driving ( Shao et al. 2022 ) , 3D scene understanding ( Vu et al. 2022 ) , and robotics ( Huang et al. 2023 ) . However, despite their theoretical appeal and demonstrated feasibility, the field faces several limitations that hinder widespread adoption and rapid development. Current Limitations are associated with data, compute, and evaluations. First, there is a lack of easy-access data for doing contrastive learning across the five modalities audio, image, video, text, and PC in combination. The scarcity causes research to focus on methodologies that treat modalities separately ( Guo et al. 2023 ) or build artificially paired data via retrieval models ( Zhang et al. 2024b ; Wang et al. 2025 ) . The latter methodology is critical as, to the best of our knowledge, there exist no such paired datasets in the open-source community. In turn, progress slows down and reproducibility becomes impossible. Second, from a computational perspective, current approaches either suffer from excessive resource requirements or lack performance. Some models range from 7-30B parameters ( Kong et al. 2025 ; Wang et al. 2025 ) , creating a barriers to entry for research groups with fewer resources and limits the democratization of multimodal AI research. Other smaller sub-1B parameter models sometimes perform 3-4\times worse ( Guo et al. 2023 ; Wang et al. 2023 ; Zhang et al. 2024b ) . Finally, the evaluation landscape presents additional challenges. Particularly pronounced are issues with PCs. Benchmarks predominantly remain limited to synthetic benchmarks rather than real-world scenarios ( Deitke et al. 2023 ; Wu et al. 2015 ) and, audio-PC does not yet have a benchmark. Furthermore, multiple publications have argued that testing on data that the underlying model was trained on is okay ( Wang et al. 2025 ; Wang et al. 2021 ) which, to us and many others, is wrong. Our Contributions: EBind . In response to these challenges, we present EBind , a simple yet effective model and methodology that achieves state-of-the-art (SOTA) performance for its compact 1.8B-parameter size, often outperforming models 4-17 times larger. Our key insight centers on prioritizing two core components: i) employing a simple, well-chosen model architecture and ii) leveraging carefully curated, high-quality training data. EBind democratizes multimodal model training by making it possible to obtain SOTA results on a single GPU within hours rather than days of distributed training. This efficiency stems from a simple choice of model and training scheme that has a low memory footprint, coupled with a data-centric approach, which we validate through comprehensive empirical analysis. We introduce a systematic three-tier data curation strategy. Inspired by a mix of related work ( Zhang et al. 2024b ; Wang et al. 2025 ; Kong et al. 2025 ; Girdhar et al. 2023 ) , we construct our training corpus from: (1) 6.7M fully-automated multimodal quintuples generated using state-of-the-art retrieval models, (2) 3.4M high-quality pre-existing captioned data items, and (3) 1M human-annotated samples with explicit positive, negative, and partial match labels. This principled approach to data construction enables us to systematically study the contribution of each data source to the final model performance. To address evaluation limitations, we further develop a first-of-its-kind, high-quality, consensus-annotated evaluation benchmark that combines PCs and audio in a zero-shot task. Unlike previous work, we open-source our complete codebase, model weights, and curated datasets, enabling true reproducibility and fostering further research. Through comprehensive evaluations across 14 datasets spanning all five modalities, we demonstrate the individual value of each component of our data curation strategy. Our experiments validate the central hypothesis that data quality and careful curation strategies can achieve superior performance compared to architectural complexity and scale. We show that our simpler approach can often match or exceed the performance of much larger, more complex models. This holds across diverse multimodal understanding tasks. 2 Related Work Contrastive representation learning, pioneered by the CLIP model ( Radford et al. 2021 ) , establishes a shared embedding space between modalities. While the shared embedding space of CLIP, and later advancements like SigLIP ( Zhai et al. 2023 ) and Perception Encoder ( Bolya et al. 2025 ) , cover vision and text, a natural expansion of the field has been to adapt the contrastive learning approach to, match text and audio ( Elizalde et al. 2023 ; Mei et

Read the complete text