CoRLD: Contrastive Representation Learning Of Deformable Shapes In Images

Tonmoy Hossain, Miaomiao Zhang · 2025

Read CoRLD: Contrastive Representation Learning Of Deformable Shapes In Images by Tonmoy Hossain, Miaomiao Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17162.txt.

Introduction

Tonmoy Hossain and Miaomiao Zhang learn deformable shape features for image classification in a 2025 paper. Shape models describe anatomy by deformation from a template. Past methods needed that template at test time, limiting use. Fine differences among similar shapes also escaped them.

Their framework, CoRLD, learns in latent deformation spaces. A class-aware contrastive objective pulls like classes together. Unlike classes are pushed apart in the same space. No reference image is needed as model input. Templates serve only as training targets in the loss. Validation used brain MRI shapes and adrenal CT shapes. The model extracted features that separated healthy, mild, and diseased states. Classification gains followed from the richer shape codes. The authors stress flexibility across medical applications. Template-free testing widens where shape models can deploy.

Catalog record

CREATORTonmoy Hossain, Miaomiao Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17162

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CoRLD: Contrastive Representation Learning Of Deformable Shapes In Images Tonmoy Hossain, Miaomiao Zhang Abstract Deformable shape representations, parameterized by deformations relative to a given template, have proven effective for improved image analysis tasks. However, their broader applicability is hindered by two major challenges. First, existing methods mainly rely on a known template during testing, which is impractical and limits flexibility. Second, they often struggle to capture fine-grained, voxel-level distinctions between similar shapes (e.g., anatomical variations among healthy individuals, those with mild cognitive impairment, and diseased states). To address these limitations, we propose a novel framework - Contrastive Representation Learning of Deformable shapes (CoRLD) in learned deformation spaces and demonstrate its effectiveness in the context of image classification. Our CoRLD leverages a class-aware contrastive supervised learning objective in latent deformation spaces, promoting proximity among representations of similar classes while ensuring separation of dissimilar groups. In contrast to previous deep learning networks that require a reference image as input to predict deformation changes, our approach eliminates this dependency. Instead, template images are utilized solely as ground truth in the loss function during the training process, making our model more flexible and generalizable to a wide range of medical applications. We validate CoRLD on diverse datasets, including real brain magnetic resonance imaging (MRIs) and adrenal shapes derived from computed tomography (CT) scans. Experimental results show that our model effectively extracts deformable shape features, which can be easily integrated with existing classifiers to substantially boost the classification accuracy. Our code is available at GitHub . 1 Introduction Deformable shape features have demonstrated their effectiveness in various image analysis tasks, including image classification [ 13 , 16 , 31 ] , segmentation [ 21 , 38 ] , and object recognition [ 12 , 28 ] . Existing methods have studied different representations of geometric shapes, such as landmarks [ 8 , 11 ] , point clouds [ 1 ] , and medial axes [ 27 ] . However, these techniques often overlook the interior structures of objects, limiting their ability to capture the intricate details of complex objects in images. In contrast, deformation-based shape representations (e.g., elastic deformations or fluid flows) focus on detailed shape information from images [ 10 , 30 ] . These methods assume that many objects in generic classes can be represented as deformed versions of an ideal template, enabling a transformation that reflects geometric changes and captures fine-grained shape details. Recent advances in deep learning have significantly expanded the capabilities of deformation-based shape representation learning [ 4 , 15 , 32 ] . These methods leverage two main categories of parametrization: stationary velocity fields (SVF) [ 2 ] and large deformation diffeomorphic metric mapping (LDDMM) [ 7 ] . The former offers a computationally efficient parametrization, widely adopted across deep learning architectures [ 6 , 9 , 23 ] . LDDMM, on the other hand, provides a mathematically elegant approach to model complex large deformations with well-defined distance metrics in deformation spaces [ 7 , 17 , 34 ] . Both methods have been heavily integrated into networks, with primary applications focused on image alignment and registration [ 6 , 37 ] , a task they perform well but do not fully explore the power of deformation-based representations. Recent efforts have developed a deep learning framework that integrates image intensity features with geometric transformations in unified spaces [ 15 , 32 ] ; demonstrating its effectiveness in substantially improving the performance of classifiers. However, these methods still face challenges. They often require reference images during inference, which can be impractical and limit their flexibility in dynamic and diverse real-world scenarios. Additionally, they struggle to capture fine-grained voxel-level differences between similar shapes, such as distinguishing between healthy individuals and those with mild cognitive impairment. To address these issues, this paper introduces a novel framework, Contrastive Representation Learning of Deformable shapes (CoRLD), in learned deformation spaces. We demonstrate its effectiveness in image classification by integrating the learned representations with image intensity and texture features. Inspired by recent works in contrastive learning that aim to capture fine-grained structural and semantic differences [ 5 , 22 ] , our model CoRLD employs a class-aware contrastive supervised learning objective in latent deformation spaces. This promotes similarity among representations of similar classes while ensuring clear separation between dissimilar groups. Additionally, CoRLD decouples the template from the network input, using it exclusively as a guidance in the training process. The contributions of our proposed model are threefold: (i) Develop a novel model, CoRLD, that for the first time learns class-aware contrastive shape features in the latent space of geometric deformations. (ii) Effectively eliminate the requirement of a template image to learn deformable shape representations. (iii) Our model is easily adaptable to be integrated with various feature extractors, serving as a plug-and-play enhancement module to boost the performance of classification tasks. We validate the effectiveness of our model in diverse multi-class/binary image classification tasks on real brain MRIs [ 19 ] and adrenal shapes derived from CTs [ 36 ] . Experimental results show that our model outperforms the state-of-the-art, achieving improved performance across all tasks without requiring the reference images during inference time. 2 Background: Deformable Registration To Derive Shape Representations From Images This section briefly reviews the concept of deformable image registration [ 2 , 7 , 39 ] , which is commonly used to derive deformation-based shape representations from images [ 20 , 40 ] . Based on the premise that objects in many generic classes can be described as deformed versions of an ideal template image, descriptors in this class arise naturally by matching the template to an input image while preserving topology. The resulting transformation can be viewed as geometric shapes that capture the variations between individual images and the template. In highly sensitive domains such as medical imaging, it is critical for transformations to be diffeomorphisms (i.e., smooth, bijective mappings with smooth inverses) in order to preserve the topological structures of objects. Let \Omega=\mathbb{R}^{d}/\mathbb{Z}^{d} be a d -dimensional torus domain with periodic boundary conditions. Given a reference image S and a target image T on the torus domain \Omega ( S(x),T(x):x\in\Omega\rightarrow\mathbb{R} ), a diffeomorphic transformation, \phi_{t} , for t\in[0,1] can be defined as a flow over time to deform a template image to match a target image by a composite function, S\circ\phi^{-1}_{t} , where \circ denotes an interpolation operator. Such a transformation is typically parameterized by time-dependent velocity fields under the LDDMM [ 7 ] , or SVF that remains constant over time [ 2 ] . While we employ SVF for implementation in this paper, our framework is easily applicable to the other. For a stationary velocity field v , the diffeomorphisms, \{\phi_{t}\} , are generated as solutions to the equation: \frac{d\phi_{t}}{dt}=v\circ\phi_{t},\,\,\text{s.t.}\,\,\,\,\phi_{0}=x. (1) The solution of Eq. ( 1 ) is identified as an exponential map using a scaling and squaring scheme [ 2 ] . The velocity field, v , is often used as representations of diffeomorphisms due to its nice properties of linearity [ 2 , 26 ] . The objective function to estimate velocity fields from a given pair of template and target images can be formulated as E(v)=\frac{1}{\sigma^{2}}\text{Dist}(S\circ\phi_{1}^{-1}(v),T)+\text{Reg}(v),\text{s.t. Eq.}~\eqref{eq:svf}, (2) where \sigma^{2} is a noise variance

Read the complete text