Bayesian In Vivo Tracking of Synapses using Joint Poisson Deconvolution and Diffeomorphic Registration
Shashwat Kumar, Dominic M. Padova, Binish Narang, Gabrielle I. Coste, Austin R. Graves, Richard L. Huganir, Adam S. Charles, Michael I. Miller, Anuj Srivastava · 2026
Read Bayesian In Vivo Tracking of Synapses using Joint Poisson Deconvolution and Diffeomorphic Registration by Shashwat Kumar, Dominic M. Padova, Binish Narang, Gabrielle I. Coste, Austin R. Graves, Richard L. Huganir, Adam S. Charles, Michael I. Miller, Anuj Srivastava (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13455.txt.
Introduction
Shashwat Kumar and eight colleagues present a Bayesian framework for tracking synapses, the tiny junctions between neurons, in living brain tissue over time. Imaging of glowing tagged receptors suffers from low signal, shot noise, tissue motion, shifting glow and blur. Their template model treats synapses as shifting brightness points moving under tissue warping. The Bayesian solution maps synapse spots, cleans and sharpens images, infers glow strengths, corrects motion, and gives confidence regions. They show it on simulated data and on two weeks of mouse microscopy data.
Catalog record
| CREATOR | Shashwat Kumar, Dominic M. Padova, Binish Narang, Gabrielle I. Coste, Austin R. Graves, Richard L. Huganir, Adam S. Charles, Michael I. Miller, Anuj Srivastava |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46557 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13455
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bayesian In Vivo Tracking of Synapses using Joint Poisson Deconvolution and Diffeomorphic Registration Shashwat Kumar, Dominic M. Padova, Binish Narang, Gabrielle I. Coste, Austin R. Graves, Richard L. Huganir, Adam S. Charles, Michael I. Miller, Anuj Srivastava Abstract Synapses are densely packed submicron structures that dynamically reorganize during learning and memory formation. Longitudinal in vivo imaging of fluorescently tagged synaptic receptors offers a promising opportunity to study large-scale synaptic dynamics and how these processes are disrupted in neurological disease. However, in vivo imaging with 2-photon microscopy uses low laser power and therefore suffers from low signal-to-noise ratio (SNR) and high shot noise, nonlinear tissue motion between days, nonstationary fluctuations in synaptic fluorescence, and significant blur induced by the microscope point spread function (PSF). Together, these factors make it challenging to detect and track synapses, especially in regions with high synaptic density. This paper presents a novel template-based framework for modeling synapses as varying luminance point sources that move under a nonlinear tissue deformation. Taking a unified Bayesian approach, we apply this model to microscopy data by deriving a posterior that incorporates a diffeomorphic mapping for domain warping, a Gaussian point spread function for the imaging process, and a Poisson observation model for raw photon counts. The Bayesian solution simultaneously: (1) Constructs a probabilistic template of synapse locations, (2) denoises and deconvolves the image data, (3) infers fluorescence intensities, (4) performs diffeomorphic image registration to correct for tissue motion, and (5) provides confidence regions for these parameter estimates. We demonstrate the framework on both a 2D+t simulated dataset and a 3D+t longitudinal in vivo microscopy dataset of fluorescent synapses imaged in a mouse over two weeks. 1 1 footnotetext: These authors contributed equally to this work. 1 Introduction Figure 1: Longitudinal in vivo synapse imaging is noisy and exhibits nonlinear motion. (a) Raw XY slices across days show low signal-to-noise ratio and substantial shot noise. (b) Output of a denoising autoencoder (XTC). Insets visualize synaptic motion by comparing their positions with first day. Synapses are the fundamental unit of neural connectivity and communication that enable animals to learn, adapt, and form memories ( 15 ; 16 ) . Recent advances in transgenic mouse lines and in vivo imaging technologies have made it possible to longitudinally image hundreds of thousands of synapses in vivo ( 11 ) (Fig. 1 ). Detecting and tracking synaptic changes at this scale could reveal the mechanisms underlying learning and adaptive computation in living animals, and potentially lead to new learning rules for artificial systems. However, large-scale longitudinal synapse tracking remains elusive. Synaptic fluorescence is non stationary across imaging sessions due to biological plasticity and imaging variability. Synapses also move with dendritic branches and surrounding tissue, leading to nonlinear tissue deformation between observations. Additionally, longitudinal deep tissue imaging requires lower laser power to avoid photobleaching of tissue, leading to poorer SNR and higher shot noise (Fig. 1 , row 1). While past works have shown promising results by combining denoising ( 24 ) , segmentation ( 6 ) , and tracking ( 14 ) , these tracking-by-detection approaches can fail in crowded or low-SNR regimes and do not explicitly model nonlinear tissue deformation (Fig. 2 ). In particular, such pipelines typically rely on denoising autoencoders followed by CNN-based classification and thresholding to produce discrete detections. As illustrated in Figure 2 , denoising can blur nearby synapses in crowded regions, causing downstream segmentation networks to merge closely spaced synapses into a single structure. Errors introduced during the denoising \rightarrow detection \rightarrow tracking pipeline can then propagate across stages and become difficult to correct retrospectively. Furthermore, object detectors make local decisions over limited spatiotemporal neighborhoods, which can bias detections toward brighter synapses, skew fluorescence estimates, and discard uncertainty information. To address these challenges, we draw inspiration from a similar problem in astrophysics: catalogue building. Here, given images of the sky, astronomers either hand engineer or use Markov Chain Monte Carlo (MCMC) to build a star catalogue directly from images ( 4 ) . Unlike astronomical scenes, however, synapses move across imaging sessions due to nonlinear tissue deformation. To model this motion, we use tools from computational anatomy ( 12 ) and represent synapses as dynamic catalogue of point sources moving under a smooth topology-preserving tissue deformation. By allowing the same catalogue of point sources to evolve under the deformation field, the model consistently explains observed image peaks across time while maintaining coherent synapse identities. We jointly infer synapse locations and trajectories, synaptic fluorescence, and diffeomorphic motion fields, directly from noisy images, rather than follow the status quo denoise-segment-track pipeline which discards uncertainty, compounds errors, and can fail under crowding and deformation. Figure 2: Failure modes of the denoising-segmentation-tracking pipeline. Multiple XY slices at different depths ( z -planes) from a small 3D image volume are shown. The denoising autoencoder frequently blurs adjacent synapses. Constellation 1 contains two synapses (Autoencoder, Slice 4) that are merged into a single detection by the segmentation stage. Constellation 2 contains a cluster of six synapses that become blurred by the autoencoder in Slices 4 and 5, again leading to merge errors. In contrast, the Bayesian model is able to deconvolve these touching synapses. Contributions: • Tracking-by-synthesis with a diffeomorphic template. We fit a latent catalogue of point sources ”wiggling” under the effect of diffeomorphic transformations to synthesize virtual synapses which can provide temporally coherent explanations of longitudinal microscopy images. • Physics-based generative model of image formation. Our model bakes in the imaging physics with an explicit parameterization of the Point Spread Function while modeling both foreground signal and background shot noised based on Poisson statistics. • Joint Bayesian inference with uncertainty. By comparing the synthesized volumes with real data, our model jointly performs registration, builds the catalogue, denoises the data while providing calibrated uncertainty estimates for all parameters. 2 Related Work Longitudinal in vivo synapse tracking has historically relied on sparse labeling and manual analysis because dense 3D synapse imaging is noisy, crowded, and undergoes nonlinear deformation across imaging sessions ( 20 ) . Large-scale longitudinal reconstruction of neurons has recently become possible ( 23 ) , suggesting that analogous large-scale synapse tracking may also be achievable. Recent advances in transgenic mouse models and multiphoton microscopy have enabled longitudinal in vivo imaging of hundreds of thousands of synapses, opening new opportunities for studying synaptic plasticity at scale ( 11 ) . Existing computational pipelines typically decompose the problem into separate denoising ( 24 ) , segmentation ( 6 ) , registration, and tracking ( 14 ) stages. As an alternative to the detection paradigm, sparse deconvolution approaches model fluorescence images as convolutions of latent point sources with a microscope point spread function (PSF), often using continuous-domain regularization over Radon measures for super-resolution recovery ( 8 ) or Bayesian sparse inference formulations ( 17 ) . Related work in microscopy has also explored Bayesian and variational image restoration, multiview deconvolution, and PSF estimation for fluorescence and multiphoton imaging ( 18 ; 2 ) . Probabilistic catalogue construction in astrophysics similarly infers latent point sources directly from noisy telescope images using Bayesian inference and MCMC methods ( 4 ; 19 ) . These approaches jointly model image formation, overlapping point spread functions, and uncertainty in source