Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes Journal: opticajournal Publication type: Research Article
Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,* · 2026
Read Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes Journal: opticajournal Publication type: Research Article by Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,* (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29220.txt.
Introduction
Leonidas Zimianitis and colleagues built RIPPLE, a tool that recasts microscopy annotation as sparse correction. A user clicks a starting point, the tool proposes a full track, and the user steps in only where the track drifts. They tested it on five hard microscopy sets, four of jellyfish motion and one of fast-moving sperm landmarks. RIPPLE matched the quality of full manual annotation while cutting manual clicks by three to twenty-five times across the sets. It can thus supply the gold-standard data that future trackers need.
Catalog record
| CREATOR | Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,* |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73244 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29220
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes Journal: opticajournal Publication type: Research Article Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,*, Leonidas Zimianitis, 1 Pasindu Thenahandi, 1, † {\dagger} Kai Buckhalter, 1, † {\dagger} Dineth Jayakody, 1 Julian O. Kimura, 2,3 Xinyue Liang, 2,3 Karen Cunningham, 2,3 Azeem Ahmad, 4 Balpreet S. Ahluwalia, 4,5 Sampath Jayarathna, 1 Nikos Chrisochoides, 1,6 Brandon Weissbourd, 2,3 and Dushan N. Wadduwage 1,6,7,* Abstract Tracking the dynamics of non-canonical biological systems in microscopy videos remains a persistent challenge. Both classical and learning-based trackers depend on expert-reviewed data to be evaluated and adapted, yet exhaustive manual annotation rarely scales to the videos where these tools are needed most. We developed RIPPLE (Refinement Interpolation Platform for Point Location Estimation), which recasts annotation as sparse correction: a user clicks a starting point, RIPPLE proposes a full trajectory, and the user intervenes only where the trajectory drifts. We tested RIPPLE on five challenging microscopy datasets from our laboratories, four from the transparent jellyfish Clytia hemisphaerica and one tracking landmarks on rapidly moving sperm. Across these, RIPPLE matched the quality of exhaustive manual annotation while reducing manual clicks by 3 to 25 times across datasets. RIPPLE thereby fills a missing layer between manual annotation and fully automated tracking, enabling immediate quantification of biological dynamics, method benchmarking, and the production of the gold-standard data needed to adapt future automated microscopy trackers. 1 Introduction Modern microscopy now resolves living systems across orders of magnitude in space and time, capturing how molecules, cells, and entire nervous systems change moment to moment [ 1 , 2 ] . Extracting biology from these recordings hinges on a single computational task: following the same object reliably from one frame to the next as the sequence evolves [ 3 , 4 , 5 , 6 ] . Tracking turns raw video into the quantitative measurements that drive discovery, from receptor and intracellular dynamics at the subcellular scale [ 3 , 7 , 4 , 8 , 9 ] , to cell behavior, proliferation, and lineage relationships in time-lapse microscopy [ 10 , 11 , 12 , 13 , 14 ] , to relating brain-wide activity to behavior in freely moving and deforming nervous systems [ 15 ] . Despite a long history of tracking research, every major class of method depends on the same fragile resource: high-quality, expert-reviewed data [ 6 , 16 ] . Classical and semi-automated packages such as TrackMate [ 17 , 18 ] , u-track [ 3 , 19 ] , and OrganoidTracker [ 20 ] require carefully curated reference tracks so methods can be evaluated objectively and tracker outputs compared against trajectories human experts have inspected [ 4 , 21 ] . Learning-based and retrainable systems, including DeLTA [ 11 ] , Cellpose [ 22 ] , StarDist [ 23 ] , SLEAP [ 24 ] , and DeepLabCut [ 25 ] , depend on expert-annotated examples for training and fine-tuning [ 16 ] . The newest generation of general-purpose computer-vision trackers extends this dependency further [ 26 , 27 , 28 , 29 , 30 ] . These models can in principle follow any chosen point through large motions, occlusions, and temporary disappearances, making them attractive for dim, crowded, blurry, and deforming microscopy targets that move in and out of focus [ 31 , 32 , 2 , 1 , 33 ] . Yet adapting them to biological video still requires curated specimen-specific datasets that do not exist at the necessary scale [ 16 , 30 , 34 ] . Across paradigms, then, the practical obstacle is not running a tracker; it is generating the data that experts need to evaluate, adapt, and improve the tracker. Producing such data is expensive. Manual annotation at scale quickly exceeds what individual labs can afford [ 35 , 16 ] : even community benchmarks built across multiple institutions still rely on labor-intensive gold-standard labelling [ 33 , 36 ] , and focused studies report hundreds of hours of effort despite using semi-automated tools for assistance, with track annotation taking 2.5 hours on average per track [ 10 ] . To cope, researchers typically chain automated detection or tracking with rounds of manual tuning, curation, and editing [ 20 , 37 , 12 , 18 , 38 , 35 , 39 ] . These hybrid workflows reduce effort relative to fully bespoke annotation, but still require expert review to validate and correct outputs [ 20 , 39 , 38 , 40 ] , and they often force users to retune parameters or chain multiple tools whenever the dataset or experimental setting changes [ 18 , 41 , 42 , 40 ] . They also strain on exactly the conditions where they are needed most: low signal-to-noise ratios, motion blur, transient disappearances, out-of-focus motion, deformation, and changing feature appearance routinely break automated trackers [ 31 , 32 , 1 , 33 ] , forcing yet more frequent manual intervention [ 38 ] . What is missing is a unified framework that lets experts annotate difficult microscopy data efficiently, especially when automated pipelines are unavailable, brittle, or expensive to adapt, while preserving the data quality those pipelines ultimately depend on. We address this gap with RIPPLE ( R efinement I nterpolation P latform for P oint L ocation E stimation), a platform that recasts the central manual task—keeping a point on the right object across time—into a sparse-correction problem. The user clicks a starting point, RIPPLE proposes a full trajectory using image-motion-guided interpolation, and the user only intervenes where the trajectory drifts. Because each correction propagates locally through the surrounding frames, a single click can rapidly correct many frames. We tested RIPPLE on five challenging microscopy datasets we had previously acquired in our laboratories that span the regimes where automated tracking typically struggles. Four are from the transparent jellyfish Clytia hemisphaerica , an emerging model for whole-nervous-system imaging in behaving animals [ 43 , 44 , 45 ] in which rapid, deformable body motion routinely defeats both classical and deep-learning trackers; the fifth tracks landmarks on rapidly moving sperm. Across all five datasets, RIPPLE matched the quality of exhaustive manual annotation while reducing manual click effort by 3 to 25 times across datasets. TAP-Vid [ 46 ] solved the analogous sparse point-tracking problem in general computer vision, and it motivated our sparse-correction workflow. However, TAP-Vid was too slow for our