BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography
Shengyu Chen, Shihang Feng, Yi Luo, Xiaowei Jia, Youzuo Lin · 2025
Read BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography by Shengyu Chen, Shihang Feng, Yi Luo, Xiaowei Jia, Youzuo Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20029.txt.
Introduction
Shengyu Chen and four co-authors present BrainPuzzle, a method for imaging the brain with ultrasound sent through the skull. Bone distorts the sound badly, and full arrays of probes are hard to fit in clinical practice, so both physics-only and data-only methods struggle. Their system aims to recover an accurate map of sound speed in brain tissue.
BrainPuzzle works in two stages, first using time-reversal acoustics to form migration fragments that keep structure even with weak signals. A transformer network with a graph-based attention unit then fuses those fragments into one quantitative image. Tests on two synthetic datasets show better accuracy and completeness than rival approaches.
Catalog record
| CREATOR | Shengyu Chen, Shihang Feng, Yi Luo, Xiaowei Jia, Youzuo Lin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20029
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography Shengyu Chen, Shihang Feng, Yi Luo, Xiaowei Jia, Youzuo Lin Abstract Current ultrasound imaging techniques face significant challenges in producing clear brain images, primarily due to the mismatch in speed of sound between the skull and brain tissues, as well as the difficulty of effectively coupling large probes with the skull. In this paper, our goal is quantitative transcranial ultrasound: recovering a high-quality speed-of-sound (SoS) map of the brain. Purely physics-based full-waveform inversion (FWI) faces two practical obstacles in the cranial setting: (i) weak signals due to skull-induced attenuation, mode conversion, and phase aberration; and (ii) incomplete coverage , since full-aperture arrays are clinically and manufacturing-wise infeasible. On the other hand, fully end-to-end learning from raw channel data struggles to learn strongly nonlocal, nonlinear wave physics through bone. It often yields anatomically plausible but quantitatively biased SoS under low SNR and sparse aperture. We present BrainPuzzle , a hybrid two-stage framework. Stage 1 applies reverse time migration (TRA; time-reversal acoustics) to multi-angle acquisitions to form migration fragments that are structurally faithful even at low SNR. Stage 2 performs machine-learning mapping from TRA fragments to a coherent, quantitative SoS image via a transformer-based super-resolution encoder–decoder augmented with a graph-based attention unit (GAU) that models inter-fragment relations. A key design choice is a partial-array acquisition, implemented by a movable low-count transducer set, which improves feasibility and coupling while the hybrid algorithm compensates for the missing aperture. Experimental results on two distinct synthesized datasets demonstrate the superior performance of BrainPuzzle in reconstructing complete brain images from fragmented ultrasound data, highlighting its potential to advance the field of ultrasound brain image reconstruction. I Introduction Brain imaging is central to modern healthcare, enabling non-invasive assessment of neurological disorders, monitoring disease progression, and guiding treatment decisions. Magnetic resonance imaging (MRI) is widely regarded as the gold standard for structural and functional brain imaging due to its superior soft tissue contrast and versatility [ 1 , 2 ] . Computed tomography (CT), while lower in resolution, remains the first-line modality in acute care, particularly for detecting hemorrhage and trauma, because of its speed and accessibility [ 3 , 4 ] . Despite their clinical utility, both MRI and CT face significant limitations: MRI is costly, slow, and contraindicated for some patients, while CT exposes patients to ionizing radiation and relies on bulky, immobile equipment. These barriers can delay timely diagnosis in critical scenarios such as stroke, where rapid imaging is essential for effective intervention. This creates a pressing need for portable, real-time brain imaging modalities that can be deployed at the point of care. One promising avenue for addressing the limitations of MRI and CT in diagnosing neurological conditions, particularly when speed, portability, and patient constraints are paramount, is ultrasound imaging [ 5 , 6 ] , known for its non‐invasive nature and extensive utility in obstetrics, cardiology, and abdominal medicine, among other fields. In these areas, ultrasound has proven invaluable for monitoring fetal development, assessing cardiac function, detecting organ abnormalities, and identifying vascular or musculoskeletal problems, largely because it offers real‐time visualization without exposing patients to harmful ionizing radiation or requiring bulky, immobile machinery. A common approach to ultrasound tomography is full-waveform inversion (FWI) [ 7 , 8 , 9 , 10 , 11 ] , yet in the transcranial setting, it is challenging both physically and numerically. Physically , the skull–brain speed-of-sound contrast ( \sim\!3,000 m/s vs. \sim\!1,520 m/s) induces strong attenuation, refraction, mode conversion, and phase aberration: (i) high-frequency components poorly penetrate bone, and (ii) surviving signals are distorted and low-SNR; moreover, full-aperture coverage around the head is clinically and manufacturing-wise infeasible, exacerbating limited-view artifacts. Numerically , FWI minimizes a data–simulation misfit, but the objective is highly nonconvex and prone to cycle skipping without low-frequency content and a good initial model—both scarce in practice. Identifiability further degrades with band-limited sources, uncertainties in the source wavelet and array geometry, and modeling errors (inaccurate skull properties, attenuation/dispersion, elastic/anisotropic effects, boundary conditions), while multi-parameter inversions suffer parameter cross-talk. Computationally, each iteration requires many large-scale PDE and adjoint solves with heavy memory for checkpointing, rendering 3D problems expensive. Consequently, while ultrasound holds clear advantages in accessibility and safety over MRI and CT, its ability to deliver high-resolution, noninvasive brain images in real time is hampered by the skull’s acoustic properties and the limitations of current computational methods. Overcoming these barriers is critical to unlocking the full potential of ultrasound for rapid, point-of-care neurological assessment, particularly in time-sensitive scenarios such as stroke. In this work, we take a hybrid path, forming a physics-consistent method with machine learning to obtain quantitative SoS efficiently. Fig. 1: BrainPuzzle workflow. Stage 1: physics-driven RTM/TRA converts multi-view channel data into migration fragments under partial-aperture, low-SNR conditions. Stage 2: a transformer+GAU network fuses fragments and outputs a quantitative speed-of-sound (SoS) map. Movable partial-array sweeps provide multi-view coverage. In recent years, the geophysical community has made remarkable progress in addressing high speed of sound contrasts in seismic wave propagation using techniques such as reverse time migration (RTM) [ 12 , 8 ] . RTM were originally developed for hydrocarbon exploration in complex geological settings like salt basins, where the speed of sound in salt (4,500 m/s) significantly exceeds that in surrounding sedimentary layers (2,500 m/s) [ 13 , 14 , 15 , 16 ] . By accurately modeling wave propagation in these heterogeneous media, RTM has proven effective in reconstructing high-resolution subsurface images despite strong acoustic impedance mismatches. This same challenge of imaging through high speed of sound barriers arises in medical ultrasound applications—particularly in brain imaging—where the skull presents a substantial contrast in speed of sound relative to brain tissue. Similar to how salt structures obstruct seismic imaging of deeper formations, the skull impedes ultrasound wave transmission, complicating efforts to visualize brain structures. This parallel suggests that the success of RTM in geophysical imaging could inform advances in medical imaging, where it is recognized as the time reversal acoustics (TRA) technique. While RTM/TRA has been highly successful in geophysics, a direct translation to transcranial ultrasound does not work out of the box. First, acoustic coupling is problematic: large-aperture probes couple poorly to the rigid, curved skull, unlike compliant soft-tissue surfaces; immersive, water-coupled multi-transducer rigs have been proposed but are too complex and costly for routine clinical use. Second, skull penetration is intrinsically hard at \sim 2 mm wavelength: high-frequency content is attenuated and phase-aberrated, calling for precise focusing (e.g., RTM/TRA) even under low SNR. Third, modeling fidelity is limited by strong speed-of-sound contrast and uncertainty in bone properties, dispersion/attenuation, and bone–soft-tissue interfaces. To address these constraints, we introduce BrainPuzzle , a hybrid two-stage pipeline that separates physics formation from learned completion . Stage 1 applies physics-driven RTM (TRA) to convert low-SNR, limited-aperture waveforms into migration fragments that localize boundaries and preserve kinematics. Stage 2 performs ML mapping from fragments to a coherent, quantitative SoS image using a transformer-based super-resolution network augmented with a graph-based attention unit (GAU) to reason over inter-fragment relations and suppress noisy or redundant inputs. For practicality, we adopt a partial-array acquisition—implemented as a movable, low-count transducer set that sweeps multiple views—reducing hardware cost and improving local coupling, while the two-stage algorithm