BrainBits: How Much of the Brain are Generative Reconstruction Methods Using?
David Mayo, Christopher Wang, Asa Harbin, Abdulrahman Alabdulkareem, Albert Shaw, Boris Katz, Andrei Barbu · 2024
Read BrainBits: How Much of the Brain are Generative Reconstruction Methods Using? by David Mayo, Christopher Wang, Asa Harbin, Abdulrahman Alabdulkareem, Albert Shaw, Boris Katz, Andrei Barbu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02783.txt.
Description
A 2024 arXiv research paper by David Mayo, Christopher Wang, Asa Harbin, Abdulrahman Alabdulkareem, Albert Shaw, Boris Katz, Andrei Barbu. When evaluating stimuli reconstruction results it is tempting to assume that higher fidelity text and image generation is due to an improved understanding of the brain or more powerful signal extraction from neural recordings.
Catalog record
| CREATOR | David Mayo, Christopher Wang, Asa Harbin, Abdulrahman Alabdulkareem, Albert Shaw, Boris Katz, Andrei Barbu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-02783
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BrainBits: How Much of the Brain are Generative Reconstruction Methods Using? David Mayo, Christopher Wang, Asa Harbin, Abdulrahman Alabdulkareem, Albert Shaw, Boris Katz, Andrei Barbu Abstract When evaluating stimuli reconstruction results it is tempting to assume that higher fidelity text and image generation is due to an improved understanding of the brain or more powerful signal extraction from neural recordings. However, in practice, new reconstruction methods could improve performance for at least three other reasons: learning more about the distribution of stimuli, becoming better at reconstructing text or images in general, or exploiting weaknesses in current image and/or text evaluation metrics. Here we disentangle how much of the reconstruction is due to these other factors vs. productively using the neural recordings. We introduce BrainBits, a method that uses a bottleneck to quantify the amount of signal extracted from neural recordings that is actually necessary to reproduce a method’s reconstruction fidelity. We find that it takes surprisingly little information from the brain to produce reconstructions with high fidelity. In these cases, it is clear that the priors of the methods’ generative models are so powerful that the outputs they produce extrapolate far beyond the neural signal they decode. Given that reconstructing stimuli can be improved independently by either improving signal extraction from the brain or by building more powerful generative models, improving the latter may fool us into thinking we are improving the former. We propose that methods should report a method-specific random baseline, a reconstruction ceiling, and a curve of performance as a function of bottleneck size, with the ultimate goal of using more of the neural recordings. 1 MIT CSAIL, CBMM 2 MIT Lincoln Laboratory 3 Google DeepMind 1 Introduction Applying powerful generative models to decoding images and text from the brain has become an active area of research with many proposed methods of mapping brain responses to model inputs. A race between publications is driving down the reconstruction error to produce higher fidelity images and text [ 27 , 17 , 28 ] . It could be easy to assume that as the field gets better at reconstructing stimuli, we will simultaneously be getting better at modeling vision and language processing in the brain. We argue that this is not necessarily the case. There are several reasons why a method might have higher quality reconstructions yet actually require the same or less signal from the brain. For example, a much larger model can learn a stronger prior over the space of images and text, so even if it were given less information from the brain, it might produce better reconstructions. In particular, a generative model might become more fine-tuned toward the distribution of images and text that are used in standard datasets. This is problematic because so few open neuroscience datasets exist, and even fewer at the scale that would enable this research. It is easy to inadvertently overfit a model and over-optimize for the particular biases of the standard benchmarks, never mind explicitly tuning the parameters. Finally, there is the separate, confounding issue of how to best evaluate the reconstructions. Even the best intentioned modeling approaches on novel data can run afoul of the extremely limited image and text evaluation methods that we have today. Later in the manuscript, we demonstrate the importance of appropriately calibrating and understanding the shortcomings of these methods. Given that better decoding need not explain more of the brain, we create the first metric to measure this: BrainBits. BrainBits measures how reconstruction performance varies as a function of an information bottleneck. We learn linear mappings from the neural recordings to a smaller-dimensional space, optimizing the reconstruction objective of each method. The result of running BrainBits on state-of-the-art reconstruction methods is striking: a bottleneck that is a small percentage of the full brain data size is sufficient to guide the generative models towards images of seemingly high fidelity. For fMRI, the entire brain volume often has on the order of 100K total voxels and about 14K voxels in the visual area, which is what the methods we report here use. We find that a reduction through a bottleneck of only 30 to 50 dimensions provides the vast majority of the performance of a reconstruction method depending on the metric. BrainBits enables us to disentangle the contributions of the generative model’s prior and the signal extracted from neural recordings when evaluating models. This is critical to soundly using stimuli reconstruction as a tool for making neuroscientific progress. We would like reconstruction methods that explain more of the brain rather than merely relying on better priors. In particular, we propose three components: to produce a method-specific random baseline that uses no neural recordings, to compute a method-specific reconstruction ceiling, and to compute reconstruction performance as a function of the bottleneck size. Ideally, models would achieve near full performance only with large bottlenecks, showing that they are relying on the neural signal for their performance. Models that have high random baselines and then exploit only a few bits of information from the brain in order to achieve their, at first glance, impressive performance, are doing so largely from their prior. And while all the examples of BrainBits we provide here use fMRI, the method can be applied to any neural recording modality. BrainBits also provides interpretability, by showing which brain areas contribute to decoding as a function of the bottleneck size and making the activity of these regions available for probing via decoder. Figure 1 : BrainBits bottlenecking framework as applied to BrainDiffuser. The goal of image reconstruction is to generate an image based on brain signal. The brain signal is mapped to a hidden vector (gold) by a compression mapping g_{L} , which is then used to predict VDVAE, CLIP-text, and CLIP-vision latents via a mapping f_{L} . As in [ 18 ] , these latents are used to produce the final reconstruction. In our studies, we restrict the information available from the brain by varying the dimension of the hidden vector. \includeinkscape [width=0.8]svg-inkscape/all_examples_figures_img_0_edit_svg-tex.pdf_tex (a) BrainDiffuser \includeinkscape [width=0.78]svg-inkscape/takagi_img_grid_formatted_edit_svg-tex.pdf_tex (b) Takagi & Nishimoto 2023 Bottleneck Text output 100 we both lived in different countries she moved out of state to college to study abroad in the us we never dated for more than a year and we only… 1000 same city i had just graduated from a university in a state i lived in on a scholarship that was much higher than what most schools have and the system… Full the same university we had just moved from the us to a different state she had a degree in psychology and a job that i was not one for but… Ground truth we’re both from up north we’re both kind of newish to the neighborhood this is in florida we both went to college not great colleges but man we graduated and… (c) Tang et al. 2023 Figure 2 : High quality stimuli can be reconstructed from a fraction of the data. Shown here are images and text reconstructed for several bottleneck sizes using our BrainBits approach. Images and text are shown for subject 1 for all three methods. Examples where the original methods could reasonably reconstruct the stimuli were chosen; the same images for both