Disentanglement and Compositionality of Letter Identity and Letter Position in Variational Auto-Encoder Vision Models
Bruno Bianchi, Aakash Agrawal, Stanislas Dehaene, Emmanuel Chemla, Yair Lakretz · 2024
Read Disentanglement and Compositionality of Letter Identity and Letter Position in Variational Auto-Encoder Vision Models by Bruno Bianchi, Aakash Agrawal, Stanislas Dehaene, Emmanuel Chemla, Yair Lakretz (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10446.txt.
Introduction
Bruno Bianchi, Yair Lakretz, and co-authors test if sight models split letter kind from letter spot as human readers do, in a 2024 paper. Readers can count letters, drop one, or add one at will. That skill needs kind and spot kept apart in the mind in a loose way.
A famed loose coder was trained on word shots and tried on a fresh bench. It splits plain traits such as where a word sits on the page. It fails hard on kind versus spot, though, and lacks a sense of word length. New word mixes and lengths thus trip it in full.
Catalog record
| CREATOR | Bruno Bianchi, Aakash Agrawal, Stanislas Dehaene, Emmanuel Chemla, Yair Lakretz |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-10446
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Disentanglement and Compositionality of Letter Identity and Letter Position in Variational Auto-Encoder Vision Models Bruno Bianchi, Aakash Agrawal, Stanislas Dehaene, Emmanuel Chemla, Yair Lakretz Abstract Human readers can accurately count how many letters are in a word (e.g., 7 in “buffalo”), remove a letter from a given position (e.g., “bufflo”) or add a new one. The human brain of readers must have therefore learned to disentangle information related to the position of a letter and its identity. Such disentanglement is necessary for the compositional, unbounded, ability of humans to create and parse new strings, with any combination of letters appearing in any positions. Do modern deep neural models also possess this crucial compositional ability? Here, we tested whether neural models that achieve state-of-the-art on disentanglement of features in visual input can also disentangle letter position and letter identity when trained on images of written words. Specifically, we trained beta variational autoencoder ( β \beta -VAE) to reconstruct images of letter strings and evaluated their disentanglement performance using CompOrth - a new benchmark that we created for studying compositional learning and zero-shot generalization in visual models for orthography. The benchmark suggests a set of tests, of increasing complexity, to evaluate the degree of disentanglement between orthographic features of written words in deep neural models. Using CompOrth, we conducted a set of experiments to analyze the generalization ability of these models, in particular, to unseen word length and to unseen combinations of letter identities and letter positions. We found that while models effectively disentangle surface features, such as horizontal and vertical ‘retinal’ locations of words within an image, they dramatically fail to disentangle letter position and letter identity and lack any notion of word length. Together, this study demonstrates the shortcomings of state-of-the-art β \beta -VAE models compared to humans and proposes a new challenge and a corresponding benchmark to evaluate neural models. 1 Introduction Reading is an invention of human modern culture. Unlike other domains of visual processing such as of faces, reading skills are not innate and require extensive practice ( Dehaene et al. 2015 ) . Reading acquisition therefore must rely on the development of a new neural mechanism in the human brain. Given that letters are the building blocks of words, to process new words, the neural mechanism needs to identify single letters in the input, their positions in a word, and compose this information to process entire words. While brain imaging has localized where in the brain visual processing of words occurs ( Cohen et al. 2002 ) , what is the precise neural mechanism that enables us to recognize words is largely unknown. Recent advances in deep neural network models have drastically improved the accuracy on Optical Character Recognition (OCR) tasks Li et al. 2023 . Deep neural models can now achieve similar-to-human performance on a variety of tasks, including vision and language. Although neural models are often considered black boxes, full access to their neural computations during processing is possible. Analyzing the properties of these networks provides new opportunities to study neural mechanisms underlying orthographic processing, and in particular, into how letter-identity and letter-position information are extracted from raw images and then composed together to encode whole words. Figure 1: (A) The CompOrth Benchmark: schemes of the three types of generalization tests. (B) An illustration of the architecture of a auto-encoder for processing images of written words. To study this question in neural models, we developed CompOrth - a battery of tests, which evaluates compositionality in models and their generalization performance. CompOrth provides several tests, which can be used to both evaluate the ‘behavioral’ performance of the models, as well as study neural mechanisms in the model. The tests are designed in a way that directly probes the question of whether a neural model extracts and disentangles letter-identity and letter-position information from raw images, and whether it can compose them together to encode entire words. The main hypothesis of this work is that vision models can achieve such functional disentanglement of letter identity and position, required to succeed on CompOrth, by neurally disentangling this information, representing it in separate units of the model. This is since neural disentanglement could facilitate composition of letter identity and letter position in downstream computations, thus improving generalizations to unseen combinations of letters and positions. Beta Variational Auto-Encoders ( \beta -VAEs) are a leading model for neural disentanglement ( Higgins et al. 2017 ) , and, interestingly, they have been shown to also align with neural activity recorded from the primate cortex ( Higgins et al. 2021 ) . Here, we thus study \beta -VAEs using CompOrth, testing whether strong neural disentanglement in the models could lead to improved performance on CompOrth, given its requirement for both disentanglement and compositional abilities as of humans. Our results show that \beta -VAEs learn to disentangle surface properties of written words, such as ‘retinal’ horizontal and vertical position. However, beta -VAEs dramatically fail to disentangle identity and positional information of letters, and to combine them together. We show that such disentanglement of letter identity and position is lacking both at the behavioral and neural levels of the model. Furthermore, we show that beta -VAEs lack a robust notion of word length, failing to generalize to unseen word lengths in CompOrth. Finally, we provide arguments for why other types of neural models might suffer from the same limitation, and therefore suggest CompOrth as a challenging benchmark for future models. 2 Related Literature Literature on cognitive sciences contains competing theories about how words are neurally encoded in the human brain. Based on experiments in humans, early studies theorized the presence of letter combination detectors Dehaene et al. 2005 , i.e., letters combine to form bigrams, which are further combined to form larger n-grams and finally words. Other theories suggested neural encoding based on open bigrams - neurons that are tuned for higher-order combinations of letters, which are not necessarily adjacent Grainger and Whitney 2004 . Most recently, a compositional neural encoding scheme was suggested, whereby letter identities and letter positions directly combine to form words Agrawal et al. 2020 , in line with early suggestions in the literature Davis and Bowers 2004 . Modern neural models now provide new opportunities to study how words can be neurally encoded, possibly informing the above debate. One of the computational tasks in the field, most closely related to reading, is Optical Character Recognition (OCR). Various neural models were suggested for OCR, including Recurrent Neural Networks Breuel et al. 2013 , Convolutional Neural Networks (CNNs) Zhang et al. 2017 , Transformers Li et al. 2023 ; Azadbakht et al. 2022 , and hybrid architectures Naseer and Zafar 2019 ; Jain et al. 2017 . Some studies have also tried to identify neural mechanisms in models trained on OCR, or similar tasks. For example, Hannagan et al. 2021 studied neural activations of units of CNNs that were trained to recognize images of objects and words. They found that a compositional encoding scheme emerged also in the models. During training, the models developed special units that encode either letter identity or ordinal letter position in a word (but not n-grams). This evidence from neural models thus provide support in favor of