Diamonds in the Sky: Pareidolic Animals in Clouds

Miriam Horovicz, Yacov Hel-Or, Yael Moses · 2026

Read Diamonds in the Sky: Pareidolic Animals in Clouds by Miriam Horovicz, Yacov Hel-Or, Yael Moses (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01361.txt.

Introduction

Horovicz, Hel-Or, and Moses teach machines to see animals in clouds. People often spot animal shapes in clouds by pareidolia. Top recognition tools usually fail on such faint shapes. Their method predicts which animals people are likely to see. It also helps people perceive a chosen animal they missed. A diffusion model reshapes cloud segments toward an animal form. The trick works only when the animal fits the cloud shape.

A generated image then serves as the prediction. Subtle visual hints often suffice to guide the eye. A short morphing video runs from the image back to the cloud. That video further boosts human perception of the shape. The work blends machine vision with human perception cues.

Catalog record

CREATORMiriam Horovicz, Yacov Hel-Or, Yael Moses
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01361

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Diamonds in the Sky: Pareidolic Animals in Clouds Miriam Horovicz, Yacov Hel-Or, Yael Moses Abstract People often see animal shapes in clouds, a phenomenon known as pareidolia. We propose an AI-based method that aims to predict which animals people are likely to perceive in clouds, even though state-of-the-art recognition methods typically fail to detect such animals. Additionally, we introduce a method to assist individuals in perceiving specific pareidolic animals, even if they did not recognize them initially. Our approach uses a diffusion model to transform cloud segments into an animal shape that visually resemble the original cloud. This diffusion technique is inspired by the observation that the diffusion process succeeds only when the target animal resembles the shape of the cloud, and that subtle visual hints often suffice to help individuals recognize specific pareidolic animals. A generated image, successfully derived from the diffusion model, is then used to predict the pareidolic animal. Additionally, a short morphing video transitioning from the generated image back to the original cloud segment is employed to further enhance the human’s perception of the pareidolic animals. 1 Introduction A child excitedly points at the cloudy sky during recess: “Look, a horse!” (see, Figure 1 ). The child’s classmates gather, some see the horse, others a sheep or a zebra, while a few perceive only the original cloud. Their perception may shift if a hint is given, such as pointing out where the horse’s head is. This phenomenon, known as pareidolia, is common and highlights humanity’s innate ability to recognize familiar shapes in random cloud formations. Original Horse Sheep Figure 1 : Our method predicts pareidolic sheep and horse in the original cloud image, aligning with the perception of 60% of participants in our survey. In contrast, SOTA recognition systems (OneFormer & CLIP) failed to recognize any animal in the original image. In this work, we address two computational aspects of pareidolia in cloud images: (i) predicting which animals are likely to be perceived in a given cloud image, and (ii) enhancing the human ability to perceive specific pareidolic animals, if possible, even if they were not initially perceived. A straightforward approach for predicting pareidolic animals is to use a state-of-the-art (SOTA) object detector. Object detectors (e.g., OneFormer 8 ) or zero-shot classification (e.g., CLIP 14 ) typically fail to detect the pareidolic animal as the object does not actually appear in the image, and the shape of the cloud lacks clarity and context. In contrast, humans can still perceive pareidolic animals. A previous attempt to predict pareidolic faces in natural images ( 6 ) fine-tuned a face detection model on diverse datasets, to improve its ability to recognize patterns similar to those of faces. In contrast, our method does not require additional datasets or further training and can work in a zero-shot manner. Our method is inspired by the observation that a subtle visual hint is often enough to help an individual recognize a specific pareidolic animal. The core idea is to apply slight modifications to a segmented cloud, extracted from a sky image, ensuring that the modified image (i) closely resembles the original segmented cloud, and (ii) is recognizable by a detection model. The modified image is then used for the prediction of the pareidolic animal and a short guided video , created by morphing between the generated image and the original cloud segment, is used to improve human perception of the pareidolic animal. We implement this concept by diffusing a segmented cloud image toward an animal shape within the same segment using a proposed Masked Delta Denoising Score (MDDS) method. In a post-processing step, a modified cloud image is selected if it satisfies both recognizability and similarity criteria. To evaluate our approach, we collected a cloud dataset and conducted an extensive user perception study. The results demonstrate a strong correlation between our predictions and human perception. Furthermore, the guided videos shown to participants significantly enhance their perception of the pareidolic animals. Our main contributions are: (1) Introducing the new task of pareidolic animal detection in clouds, which addresses the computational challenge of identifying animal shapes in ambiguous formations; (2) Utilizing a zero-shot image modification rather than training specialized object detectors, enabling our approach to function without additional training or fine-tuning; (3) Introducing the Masked Delta Denoising Score (MDDS), a region-constrained text-to-image method that can diffuse cloud segments while preserving the background elements; and (4) Implementing a comprehensive evaluation methodology through a perceptual user study, validating both the predictive power of our approach and its effectiveness in enhancing pareidolic animal perception in clouds. In a wider scope, this research opens new questions about pareidolic recognition, shifting from traditional object detection toward modification of abstract elements into recognizable forms. This work reveals a fundamental gap in current vision systems: while humans readily perceive animal shapes in clouds, state-of-the-art detectors fail completely. The method enables applications in virtual and augmented reality, such as procedural generation of natural environments, as well as computational tools for cognitive scientists studying pattern perception. Our approach demonstrates how diffusion models can be adapted to model human-like interpretive perception, opening new directions for perceptually-aligned vision systems. 2 Previous Works Pareidolia refers to the human tendency to perceive meaningful patterns, such as faces or animals, in ambiguous stimuli. The neurological basis for pareidolia has been studied by Liu et al. 11 and Wardle et al. 20 , highlighting how the human brain is specifically tuned to recognize faces even in highly abstract patterns. Recent work by Hamilton et al. 6 identified a significant gap between human perception and machine detection of pareidolic faces, introducing a dataset of 5,000 images containing face-like patterns in various objects. Gupta and Dobs 5 demonstrated that deep neural networks trained on both face identification and object categorization can develop human-like pareidolic perception, suggesting that pareidolia may result from the visual system’s optimization. Computational approaches to pareidolia have been explored. Song et al. 18 proposed a novel approach with “Pareidolia Face Reenactment”, animating static illusory faces to move in tandem with human facial expressions in videos. The field of object detection has made significant strides with deep learning and transformer-based models such as OneFormer 8 , DETR 1 , and Mask2Former 2 . Vision-language models like CLIP 14 and OWL-ViT 12 have further advanced the capabilities of zero-shot object recognition. However, these models excel at detecting well-defined objects with clear boundaries and relevant context. When applying these detectors to cloud images, even state-of-the-art detectors fail to recognize pareidolic animals. This limitation highlights the lack of imaginative capacity in machine perception and illustrates the gap between conventional object detectors and human perception. A recent work 6 aimed to detect face structures in abstract forms. Their solution involved fine-tuning a pre-trained object detection network on diverse and abstract datasets. While faces benefit from strong, meaningful features that make them easier to detect, animal shapes in clouds present greater variability and ambiguity. Our approach extends the concept of triggering pareidolia beyond faces to encompass a broader range of animal forms. Instead of fine-tuning networks with additional datasets, our method enhances and reveals animals in clouds through controlled image modifications. We leverage diffusion models and require neither additional training nor laborious data collection. 3

Read the complete text