Stylistic-STORM (ST-STORM) : Perceiving the Semantic Nature of Appearance
Hamed Ouattara, Pierre Duthon, Pascal Houssam Salmane, Frédéric Bernardin, Omar Ait Aider · 2026
Read Stylistic-STORM (ST-STORM) : Perceiving the Semantic Nature of Appearance by Hamed Ouattara, Pierre Duthon, Pascal Houssam Salmane, Frédéric Bernardin, Omar Ait Aider (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16086.txt.
Introduction
Ouattara and four colleagues introduce ST-STORM, a framework treating look and feel as a stream apart from content. Methods chase light- or shape-proof features, suiting object recognition. Rain, snow, scattering, and halos carry weather data, and driving grip and sight hinge on ground. ST-STORM splits two streams: Content seeking meaning, Style catching look and feel. Style isolates look and feel: F1 of 97 percent on Multi-Weather and 94 percent on ISIC 2024 with 10 percent labels, keeping Content meaning at 80 percent on ImageNet-1K.
Catalog record
| CREATOR | Hamed Ouattara, Pierre Duthon, Pascal Houssam Salmane, Frédéric Bernardin, Omar Ait Aider |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105347 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16086
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stylistic-STORM (ST-STORM) : Perceiving the Semantic Nature of Appearance Hamed Ouattara, Pierre Duthon, Pascal Houssam Salmane, Frédéric Bernardin, Omar Ait Aider Abstract One of the dominant paradigms in self-supervised learning (SSL), illustrated by MoCo or DINO, aims to produce robust representations by capturing features that are insensitive to certain image transformations such as illumination, reflectance, or geometric changes. This strategy is appropriate when the objective is to recognize objects independently of their appearance (a cat remains a cat despite fur color, lighting, rain, or snow). However, it becomes counterproductive as soon as appearance itself constitutes the discriminative signal. In weather analysis, for example, rain streaks, snow granularity, atmospheric scattering, as well as reflections and halos, are not noise: they carry the essential information. In critical applications such as autonomous driving, ignoring these cues is risky, since grip and visibility depend directly on ground conditions and atmospheric conditions. We introduce ST-STORM , a hybrid SSL framework that treats appearance ( style ) as a semantic modality to be disentangled from content. Our architecture explicitly separates two latent streams, regulated by gating mechanisms. The Content branch aims at a stable semantic representation through a JEPA scheme coupled with a contrastive objective, promoting invariance to appearance variations. In parallel, the Style branch is constrained to capture appearance signatures (textures, contrasts, scattering) through feature prediction (Style-JEPA) and reconstruction under an adversarial constraint. We evaluate ST-STORM on several tasks, including object classification (ImageNet-1K), fine-grained weather characterization, and melanoma detection (ISIC 2024 Challenge). The results show that the Style branch effectively isolates complex appearance phenomena (F1=97% on Multi-Weather and F1=94% on ISIC 2024 with 10% labeled data), without degrading the semantic performance (F1=80% on ImageNet-1K) of the Content branch, and improves the preservation of critical appearance information compared with MoCo-v3 and I-JEPA. I Introduction The search for universal visual representations has long been guided by a principle of stability: to be robust, a model must recognize an object regardless of its superficial variations. This idea already appeared in handcrafted methods such as the Harris–Stephens repeatable corner detector [ 22 ] , SIFT descriptors [ 30 , 31 ] (scale and rotation invariance, robustness to moderate photometric variations), and SURF [ 6 ] . This philosophy, referred to as invariance-based learning by Assran et al. [ 3 ] in their article introducing the I-JEPA model, is now found in modern self-supervised learning (SSL): artificially perturbed views of the same image (croppings, color alterations, geometric transformations) are constrained to project toward a common representation [ 36 , 12 ] . While this insensitivity often promotes high-level semantic abstraction, it operates by elimination: the network thus learns to treat texture, luminance, and image grain not as descriptive characteristics, but as nuisances to be filtered out in order to reach the object’s “truth.” However, this bias becomes a critical limitation as soon as one moves beyond “coarse” object recognition toward fine-grained tasks, where the discriminative information lies precisely in style or texture . Distinguishing cat breeds (Siamese, Ragdoll, Bombay), for instance, relies on appearance cues (coat patterns, colorimetry, micro-textures), whereas a strongly invariant SSL model has learned to attenuate these variations in favor of more generic signals (silhouette, presence of ears, tail). Similarly, in medical imaging, many diagnostic decisions depend on micro-structures and textural signatures (granularity, glandular organization, nuclear irregularities, stromal patterns); in this context, learning to “ignore” grain, local contrasts, or certain photometric variations may suppress essential markers for cancer detection or grading. More generally, several works [ 40 , 9 , 38 ] highlight that the invariance useful for semantic classification (e.g., “this is a road”) is not necessarily the one required for fine scene analysis. This mismatch is particularly marked in weather analysis: rain streaks, fog diffusion, snow granularity, halos, and reflections are not noise to be removed, but the very signal one seeks to measure ( Fig. 1 ). It therefore becomes necessary to preserve these appearance cues rather than dilute them into a systematically invariant abstraction. The partly arbitrary nature of the choice of invariances, and the biases it induces by construction , calls into question the ability of such SSL methods to produce truly universal representations. This observation has motivated the emergence of alternative approaches, including I-JEPA [ 3 ] . This so-called predictive method differs from contrastive or distillation-based frameworks that explicitly align augmented views: I-JEPA learns by predicting the latent representations of masked regions from their context. Although this objective does not directly impose invariance to augmentations, it also provides no explicit mechanism to preserve appearance. In practice, prediction naturally favors the most stable and predictable factors of variation. This bias is reinforced when supervision is defined in the latent space of a deep target encoder with a large receptive field, which tends to smooth photometric details: local high-frequency variations may fluctuate strongly without being necessary for global semantic coherence. Thus, in domains where discriminative information lies in fine signals (rain streaks, specularities on wet roads, atmospheric scattering), this implicit preference for “smoothed” representations may lead to underestimating appearance components that are nonetheless crucial. It is precisely this absence of explicit consideration of appearance that ST-STORM seeks to address. Unlike invariance-based SSL methods, we do not consider style as a nuisance to be removed ( Fig. 1 ); and unlike predictive frameworks of the I-JEPA type, we introduce dedicated mechanisms to preserve and organize appearance cues. Our central hypothesis is that appearance (or style ) features constitute a semantic modality in their own right, complementary to content. ST-STORM is therefore two-headed : one branch learns a robust content representation that is transferable across styles, while a second branch learns a semantic representation of appearance . Fig. 1: Toward a semantic representation of appearance conditions. The goal is to transform the perception of style: no longer to see it as a random disturbance, but as a structured category. This approach mimics the human ability to dissociate the object (the car) from the context (the rain), while understanding that rain is a physical entity with predictable consequences (slippery road, reduced visibility), which is crucial for decision-making in autonomous driving. This hypothesis is supported by recent progress in generative AI, and in particular in style transfer, which shows that it is possible to strongly alter the appearance of a scene while preserving its structure (content), as illustrated in Fig. 2 . Unpaired methods such as CycleGAN [ 46 ] or CUT [ 32 ] simulate complex weather conditions (rain, snow, fog) by mainly modifying texture, colorimetry, and diffusion, while preserving the scene “content.” Fig. 2: Weather simulation by CycleGAN style transfer [ 46 ] . Left column: real images (source). Right column: stylized outputs reproducing rain, snow, or fog at different intensity levels. This example shows that an unpaired model can synthesize characteristic weather cues (rain streaks, luminous veil, color drift), which motivates the idea of treating weather as a style variation. We leverage style transfer and spectral perturbations (using the Fast Fourier Transform (FFT) [ 13 ] and the Sliced Wasserstein Distance (SWD) [ 7 ] ) to introduce stylistic chaos serving as directed augmentation: from a source image, we synthesize views that preserve content while altering appearance in a controlled manner. Unlike MAE-style