Learning Through Little Eyes: Attribute Discrimination Beyond Objects

Patrick Batsell, Satoshi Tsutsui, Bihan Wen · 2025

Read Learning Through Little Eyes: Attribute Discrimination Beyond Objects by Patrick Batsell, Satoshi Tsutsui, Bihan Wen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18951.txt.

Introduction

Patrick Batsell, Satoshi Tsutsui, and Bihan Wen ask whether AI models raised on infant-scale data learn attributes the way babies do. Children master not just categories but color, size, and texture from little experience. Earlier baby-scale vision-language models were tested mostly on object naming. Their benchmark, posted to arXiv in December 2025, renders 67 everyday object classes synthetically, varying attributes independently of identity.

Infant-trained models like CVCL form strong visual representations for size and match others on texture, but they discriminate color poorly in images and ground color words weakly. Web-scale models show the mirror image: strong color grounding from text, weaker visual size discrimination. The split shows visual and linguistic attribute knowledge develop on separate tracks, a clue for both developmental science and training-data design.

Catalog record

CREATORPatrick Batsell, Satoshi Tsutsui, Bihan Wen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-18951

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Through Little Eyes: Attribute Discrimination Beyond Objects Patrick Batsell, Satoshi Tsutsui, Bihan Wen Abstract Infants learn to recognize not only object categories but also fine-grained attributes such as color, size, and texture within their first two years of life. Prior work explores Child’s View for Contrastive Learning (CVCL), a CLIP-style model trained on infant egocentric video as a computational model of early infant learning, but it focuses only on class-level recognition. This leaves it unclear whether infant-scale learning also supports attribute discrimination. To address this, we introduce a benchmark that systematically varies color, size, and texture, allowing controlled tests of within-class attribute recognition. Comparing CVCL with CLIP shows clear differences: CVCL is better at size discrimination, CLIP achieves higher accuracy on color discrimination. Both models represent texture in image embeddings but fail to ground texture linguistically, suggesting a gap between visual and language spaces. † † address: 1 Rice University, 2 ROSE Lab, School of EEE, Nanyang Technological University 1 Introduction Infants demonstrate remarkable efficiency in learning to recognize not only object categories but also fine-grained visual attributes such as color, size, and texture within their first two years of life [ 3 , 13 , 9 ] . This developmental ability has inspired research in computer vision that seeks to model learning under similarly constrained data conditions [ 2 , 5 , 10 , 14 ] . A recent milestone is Child’s View for Contrastive Learning (CVCL) [ 18 ] , which trains a CLIP-style model [ 12 ] on \sim 37,000 infant egocentric video frames from the dataset [ 17 ] paired with parental speech transcripts. Despite being trained on only about 0.01% of CLIP’s data, CVCL achieves impressive object recognition accuracy, consistent with developmental psychology findings that infants acquire concepts from sparse but structured experiences. However, prior evaluation of CVCL has been restricted to coarse class-level recognition. This leaves open the question of whether infant-scale models can also master attribute-level discrimination—a core perceptual ability that infants develop at a very young age and which is essential for real-world recognition. Developmental psychology emphasizes that children’s visual understanding depends not only on identifying objects but also on perceiving differences within object classes—for instance, distinguishing a red ball from a green one, or recognizing that two cups differ in size despite belonging to the same category [ 8 ] . These abilities are central to real-world perception but remain underexplored in computational infant-scale models. Existing evaluations of infant-scale vision-language models have primarily focused on object class recognition, with little attention to whether such models capture fine-grained visual attributes [ 5 , 18 ] . This gap makes it difficult to assess whether models like CVCL can discriminate attributes independently of object identity, motivating the need for a benchmark that evaluates attribute discrimination in a controlled way. (a) Infant’s Environment (b) Model (c) Test Img. (d) +Color (e) +Size (f) +Texture Figure 1 : (a, b): Infants are efficient learners, which has inspired research under similar circumstances; prior work [ 18 ] trained a CLIP-like model using infants’ egocentric views and transcribed parental speech. However, their testing is limited to object category discrimination. (c–f): We benchmark the model with infant-level attribute discrimination, controlling color, size, and texture without changing other visual characteristics. In this work, we introduce a benchmark 1 1 1 Our dataset is available at the following: https://github.com/PatrickBats/SyntheticKonkleDataset that systematically varies color, size, and texture attributes across multiple object classes, building on the Konkle “things” dataset used in the original CVCL paper [ 6 ] . The Konkle dataset was developed to capture everyday categories that infants are especially likely to encounter in their environment, making it a suitable testbed for evaluating learning outcomes at the infant scale. Existing attribute datasets such as Animals with Attributes or CUB focus on animals or narrow expert-labeled domains that are not representative of infants’ everyday perceptual experience [ 7 , 19 ] . Moreover, no existing dataset provides both infant-relevant categories and systematic control over low-level attributes. For this reason, we generated synthetic variants of Konkle classes, preserving their ecological relevance for infant perception while introducing controlled attribute variation. This design isolates individual attributes and enables evaluation of whether models recognize differences within a category. Contributions. The key contributions of this work are: • We propose a benchmark explicitly designed to disentangle color, size, and texture, enabling rigorous attribute-level evaluation of vision–language models. • We provide the first systematic analysis of CVCL on attribute discrimination tasks, uncovering cases where CVCL outperforms CLIP (e.g., size discrimination within classes) and others where it falls behind (e.g., color discrimination). • We reveal biases and limitations in both CVCL and CLIP, highlighting that large-scale training does not guarantee robust attribute-level representations, while infant-scale learning may encode unique strengths. 2 Benchmark Attribute Discrimination 2.1 Benchmark Design We construct a controlled benchmark that systematically varies three visual attributes—color, size, and texture—across multiple everyday object classes. These attributes were chosen because they are among the earliest perceptual features that infants reliably recognize and use to organize visual categories, making them a natural testbed for evaluating infant-scale models [ 3 , 21 , 13 , 9 ] . Following the original CVCL paper [ 18 ] , we draw 67 object classes from the Konkle “things” dataset, a large-scale collection of high-quality object images spanning hundreds of everyday categories that infants are especially likely to encounter in their environment [ 6 ] . Rather than relying on real-world photographs, we employ the OmniGen2 generative model [ 22 ] to synthesize images. Synthetic generation provides precise control over attribute variation, balanced coverage of all attribute combinations, and minimization of confounds such as background clutter or lighting. This enables us to disentangle object identity from attribute values and directly evaluate attribute-level discrimination. For each class, 108 images are generated by systematically crossing the three attribute dimensions. • 9 distinct colors (blue, brown, gray, green, orange, pink, purple, red, yellow) • 3 size bins (small, medium, large), • 2 texture variants (smooth, bumpy) Images are rendered at 224 \times 224 resolution on a uniform white background, following the methodology of the Konkle “things” dataset. Size bins are defined by the proportion of pixels occupied: small ( <20\% ), medium ( 20 – 70\% ), and large ( >70\% ). To increase robustness and within-class diversity, we also generated two distinct style variants per class (different-looking but still clearly the same object). These style variants enrich the dataset but are not directly evaluated as an attribute in our benchmark. We restrict texture to two variants (smooth vs. bumpy) to align with studies of developmental psychology showing that infant texture discrimination is typically tested in binary form [ 1 ] . This procedure yields a total of 7,236 images, ensuring systematic and comparable attribute variation across classes. Figure 2 : Illustration of the text-encoder (image–text) test: a query (“blue ball”) is matched against candidates of the same class differing only in color. 2.2 Evaluation Protocol Our evaluation focuses on within-class discrimination. In each trial, a query image is drawn from a given class, and the task is to determine whether the model distinguishes attribute differences within that class. We test three conditions independently: 1.

Read the complete text