Chaos-SSL: An Attention-Based Self-Supervised Learning Framework with Chaotic Transformation for Medical Image Classification

Joao Batista Florindo 1 1 Institute of Mathematics, Statistics and Scientific Computing, University of Campinas, Rua Sergio Buarque de Holanda, 651, Campinas, Brazil [email protected] · 2026

Read Chaos-SSL: An Attention-Based Self-Supervised Learning Framework with Chaotic Transformation for Medical Image Classification by Joao Batista Florindo 1 1 Institute of Mathematics, Statistics and Scientific Computing, University of Campinas, Rua Sergio Buarque de Holanda, 651, Campinas, Brazil [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27146.txt.

Introduction

Florindo presents Chaos-SSL, a method for medical image sorting using chaotic maps as a complex twist for contrast learning. Standard methods rely on simple shape and color twists. They may miss fine texture details needed for subtle illness, so stage one pre-trains with Logistic, Tent, and Sine maps for harder, richer views. A second stage fuses cues with general ones from a larger ImageNet model through focus. The Tent-map variant with focus fusion reaches top scores on skin and retina sets, beating rivals.

Catalog record

CREATORJoao Batista Florindo 1 1 Institute of Mathematics, Statistics and Scientific Computing, University of Campinas, Rua Sergio Buarque de Holanda, 651, Campinas, Brazil [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26573
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27146

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Chaos-SSL: An Attention-Based Self-Supervised Learning Framework with Chaotic Transformation for Medical Image Classification Joao Batista Florindo 1 1 Institute of Mathematics, Statistics and Scientific Computing, University of Campinas, Rua Sergio Buarque de Holanda, 651, Campinas, Brazil [email protected] Abstract Self-Supervised Learning (SSL) has emerged as a powerful paradigm to mitigate the reliance on large, annotated datasets, a common bottleneck in medical image analysis. However, standard SSL methods, which rely on simple geometric and color augmentations, may fail to capture the fine-grained, complex textural details necessary for classifying subtle pathologies. This paper introduces Chaos-SSL, a novel two-stage framework for medical image classification. In the first stage, we propose a new self-supervised pre-training strategy that leverages 1D chaotic maps (Logistic, Tent, and Sine) as a complex, non-linear augmentation for contrastive learning. We hypothesize that these chaotic transformations create “harder” and more semantically-rich views, forcing a network to learn robust representations of fine-grained medical textures. In the second stage, we introduce an attention-based fusion model that dynamically combines the specialized features from our Chaos-SSL model with the general-purpose features of a larger, ImageNet-pre-trained model. We validate our method on two public datasets: ISIC 2018 (skin lesions) and APTOS 2019 (diabetic retinopathy). Our results demonstrate that the Chaos-SSL model pre-trained with a Tent map for 30 epochs, followed by attention fusion, achieves performance fully competitive with the state-of-the-art, yielding an accuracy of 0.9261 on ISIC 2018 and 0.8726 on APTOS 2019. This significantly outperforms existing SSL methods, including several recent approaches. 1 INTRODUCTION Deep learning, particularly Convolutional Neural Networks (CNNs), has become the cornerstone of modern medical image analysis, achieving human-level performance on tasks such as classification, segmentation, and detection [ Huang et al., 2023 ] . However, this success is heavily predicated on the availability of large-scale, high-quality, and expertly annotated datasets. In the medical domain, acquiring such annotations is exceptionally expensive, time-consuming, and requires specialized expertise, leading to a “data scarcity” bottleneck. Self-Supervised Learning (SSL) has emerged as a compelling solution to this problem [ Huang et al., 2023 ] . By designing pretext tasks that do not require human labels, SSL methods can learn rich, generalizable feature representations from vast quantities of unlabeled data. The dominant SSL paradigm, contrastive learning, (e.g., SimCLR [ Chen et al., 2020 ] and MoCo [ He et al., 2020 ] ), trains a model to pull representations of positive pairs (e.g., two augmented views of the same image) closer together in an embedding space, while pushing negative pairs (views from different images) apart. The efficacy of contrastive learning is fundamentally dependent on the quality of its data augmentations. Standard augmentations—such as random crops, flips, color jitter, and grayscale—are designed to be “domain-preserving” and teach invariance to simple geometric or color changes. While effective for natural images, these augmentations may be insufficient for medical imaging, where pathological information is often encoded in subtle, fine-grained textural differences rather than in global object shape or color [ Bisht, 2024 ] . This limitation has spurred research into more sophisticated SSL strategies. Some focus on pretext tasks, such as solving Jigsaw puzzles, as seen in the recent FG-SSL paper by Park & Ryu (2024), to learn spatial relationships [ Park and Ryu, 2024 ] . Others explore more complex, deformable augmentations [ Arabi and Zaidi, 2024 ] . However, a significant gap remains in developing augmentation strategies that can specifically model the complex, non-linear, and semi-chaotic nature of biological textures and disease patterns. This paper poses a new research question: Can we create a more powerful SSL framework by replacing simple, stochastic augmentations with complex, deterministic, non-linear transformations derived from chaos theory? We propose Chaos-SSL , a novel framework that uses 1D chaotic maps as a data augmentation strategy for contrastive learning. Our hypothesis is twofold: 1. By applying chaotic maps (Logistic, Tent, and Sine) pixel-wise to an image, we create a “hard” positive view that exhibits complex, non-linear distortions. To minimize the contrastive loss, the model is forced to learn features that are invariant to this chaotic distortion, thereby capturing essential, fine-grained textural information. 2. A single model cannot optimally capture all necessary features. Therefore, we hypothesize that a final model, which uses an “attention mechanism” to fuse the specialized, texture-aware features of our Chaos-SSL model with the robust, context-aware features of a large ImageNet-trained model, will achieve state-of-the-art performance. To validate this, we implement a two-stage pipeline. First, we pre-train a ConvNeXt-Tiny model using our chaotic contrastive method. Second, we fuse its features with a ConvNeXt-Large model using an attention-based ensemble. We test this on the ISIC 2018 and APTOS 2019 datasets and compare our results against the state-of-the-art, including the recent FG-SSL [ Park and Ryu, 2024 ] method. Our contributions are: • The first (to our knowledge) application of chaotic maps as an explicit data augmentation technique for self-supervised contrastive learning. • The design of a ChaoticTransform class compatible with standard deep learning pipelines. • An attention-based ensemble model that effectively fuses generalist (ImageNet) features with specialist (Chaos-SSL) features. • A comprehensive empirical study showing our method significantly outperforms prior approaches on two challenging medical classification benchmarks. This paper is structured as follows: Section 2 reviews related work. Section 3 details our proposed methodology. Section 4 presents our experimental results. Section 5 discusses the implications of our findings, and Section 6 concludes the paper. 2 RELATED WORK Our work is situated at the intersection of three active research areas: self-supervised learning in medical imaging, data augmentation, and feature fusion. 2.1 Self-Supervised Learning in Medical Imaging SSL has been a major focus of the medical imaging community since 2020 [ Huang et al., 2023 ] . It is a promising solution for the challenges of small and imbalanced datasets, which are common in medicine [ Espis et al., 2025 ] . The field has evolved from early pretext tasks (e.g., rotation prediction) to more sophisticated contrastive and non-contrastive methods. Recent works have focused on adapting SSL to the specific properties of medical data. For instance, FG-SSL [ Park and Ryu, 2024 ] adapts the Jigsaw puzzle pretext task to medical images. It uses a “progressive Jigsaw puzzle” strategy, arguing that learning to piece together patches of different granularities helps the model learn fine-grained features. Their method, combined with BarlowTwins (a non-negative contrastive loss) [ Zbontar et al., 2021 ] , demonstrates strong performance. Other recent approaches include leveraging self-distillation (e.g., DINOv2) [ Hussien et al., 2025 ] and combining contrastive learning with masked autoencoders [ Wolf et al., 2023 ] . These works confirm that the type of pretext task or learning signal is a critical design choice. 2.2 Chaos-Based Data Augmentation While the SSL framework is important, the data augmentation pipeline is arguably one of its most critical components. Recent research, such as a 2024 study on segmentation [ Arabi and Zaidi, 2024 ] , has shown that specialized, deformable data augmentations can outperform standard contrastive learning. This suggests that creating more “difficult” or “semantically relevant” transformations is key. Our work draws inspiration from the intersection of chaos theory and deep learning. Chaos theory provides a mathematical foundation for modeling complex, non-linear, and deterministic systems. Recent studies, such as “Neurochaos Learning” (2025) [ Henry and Nagaraj,

Read the complete text