Uncertainty-aware retinal layer segmentation in OCT through probabilistic signed distance functions

Mohammad Mohaiminul Islam 1,2, Coen de Vente 1,2, Bart Liefers 3, Caroline Klaver 3, Erik J Bekkers 1, Clara I. Sánchez 1,2 · 2024

Read Uncertainty-aware retinal layer segmentation in OCT through probabilistic signed distance functions by Mohammad Mohaiminul Islam 1,2, Coen de Vente 1,2, Bart Liefers 3, Caroline Klaver 3, Erik J Bekkers 1, Clara I. Sánchez 1,2 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04935.txt.

Introduction

Eye scans called OCT show the retina's layers, and marking those layers guides care for retinal disease. Islam and co-authors present a method that outlines each layer through a signed distance function, a smooth map whose zero line traces the layer edge, instead of labeling pixels one by one. They add probability modeling so each shape estimate carries its own uncertainty.

The method beat rival approaches in both scores and visual checks. On scans spoiled by shadowing, blinking, speckle, or motion, the uncertainty maps flagged the doubtful zones. The authors see the work as a step toward judging layer integrity, a marker of how disease advances.

Catalog record

CREATORMohammad Mohaiminul Islam 1,2, Coen de Vente 1,2, Bart Liefers 3, Caroline Klaver 3, Erik J Bekkers 1, Clara I. Sánchez 1,2
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-04935

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Uncertainty-aware retinal layer segmentation in OCT through probabilistic signed distance functions Mohammad Mohaiminul Islam 1,2, Coen de Vente 1,2, Bart Liefers 3, Caroline Klaver 3, Erik J Bekkers 1, Clara I. Sánchez 1,2 Abstract In this paper, we present a new approach for uncertainty-aware retinal layer segmentation in Optical Coherence Tomography (OCT) scans using probabilistic signed distance functions (SDF). Traditional pixel-wise and regression-based methods primarily encounter difficulties in precise segmentation and lack of geometrical grounding respectively. To address these shortcomings, our methodology refines the segmentation by predicting a signed distance function (SDF) that effectively parameterizes the retinal layer shape via level set. We further enhance the framework by integrating probabilistic modeling, applying Gaussian distributions to encapsulate the uncertainty in the shape parameterization. This ensures a robust representation of the retinal layer morphology even in the presence of ambiguous input, imaging noise, and unreliable segmentations. Both quantitative and qualitative evaluations demonstrate superior performance when compared to other methods. Additionally, we conducted experiments on artificially distorted datasets with various noise types—shadowing, blinking, speckle, and motion—common in OCT scans to showcase the effectiveness of our uncertainty estimation. Our findings demonstrate the possibility to obtain reliable segmentation of retinal layers, as well as an initial step towards the characterization of layer integrity, a key biomarker for disease progression. Our code is available at https://github.com/niazoys/RLS_PSDF . \midlauthor 1 Informatics Institute, University of Amsterdam, Netherlands. 2 Department of Biomedical Engineering and Physics, Amsterdam UMC, Netherlands. 3 Department of Ophthalmology & Epidemiology, Erasmus MC, Rotterdam, Netherlands. † † volume: – 218 † † year: 2024 † † workshop: Full Paper – MIDL 2024 † † editors: Accepted for publication at MIDL 2024 keywords Probabilistic signed distance function, Implicit representation, OCT 1 Introduction In recent years, deep learning methods have demonstrated remarkable success in automating the delineation and segmentation of retinal layers in Optical Coherence Tomography (OCT) scans. The task of retinal layer segmentation is primarily tackled via pixel-wise classification, an approach extensively explored in recent works Li et al. (2020) ; Liu et al. (2024) ; Kugelman et al. (2022) ; Sousa et al. (2021) ; Lou et al. (2020) ; Chen et al. (2019) ; Kugelman et al. (2018) ; Santos et al. (2019) . This technique, however, is known to have challenges in precisely delineating the small structures and nuanced contours when employing cross-entropy or dice loss Abraham and Khan (2019) . The issue is further exacerbated when the layer targeted for segmentation is exceptionally thin, often reduced to a one-pixel width line for layer boundaries or as a consequence of disease manifestation, resulting in inaccurate Lin et al. (2023) , and disconnected boundaries (see Fig. 4 ) Lan et al. (2020) ; Sousa et al. (2021) . The alternative is to switch to a regression-based approach, predicting layer coordinates per vertical scan (A-scan) line, which addresses the problem of disconnected layer boundaries. Notably, deep learning models that take a two-dimensional B-scan as input and directly output a coordinate for each A-scan Liefers et al. (2019) ; Ngo et al. (2019) , and models that directly predict the height of each layer, ensuring a correct layer ordering Morelle et al. (2023) , have been proposed. However, the regression-based approach lacks mechanistic interpretability as the predictions are not in one-to-one correspondence from input to output, i.e. it reduces all pixel information in a vertical column to a single coordinate, making the relationship between input and anticipated boundary ambiguous. Due to this reduction, the geometric grounding of the predictions is challenged, limiting the neural network’s ability to exploit geometric priors and regularities. We present a new level set approach that overcomes both the challenges of thin layer segmentation and the lack of geometric grounding. Our approach involves predicting an SDF that parametrizes the layer boundary via a level set. The predicted SDF promotes an enhanced spatial congruence between the input and output via a one-to-one pixel correspondence, thereby delivering more robust supervisory signals for the learning algorithm. Additionally, our approach is amenable to probabilistic modeling through a Gaussian likelihood assumption. The SDF has seen application in broader medical image segmentation contexts Xue et al. (2020) ; Raju et al. (2022) ; Bogensperger et al. (2023) , but their utility in retinal layer segmentation remains unexplored. On the other hand, the literature on aleatoric uncertainty estimation via Gaussian likelihood in medical image segmentation is extensive Abdar et al. (2021) ; Gawlikowski et al. (2021) . Although Dong et al. (2018) introduced a probabilistic framework for SDF using a Normal-Beta mixture distribution, their approach does not extend to the uncertainty in segmentation or shape inference challenges. To the best of our knowledge, this research represents the initial effort to employ SDF to address the challenge of segmenting thin retinal layer boundaries and incorporate Gaussian uncertainty in SDF for segmentation tasks. Following are the key contributions of this work: • We present a redefined approach to thin layer boundary segmentation with SDF. • We extend Gaussian modeling for aleatoric uncertainty estimation in our framework. • We show that the proposed uncertainty estimation can offer a means to flag unreliable segmentation, particularly under compromised layer visibility or integrity. 2 Method Consider an OCT B-scan, or image, I:\mathcal{X}\times\mathcal{Y}\rightarrow\mathbb{R} that assigns to each coordinate x,y an intensity value I(x,y) , with x\in\mathcal{X} the horizontal coordinate and y\in\mathcal{Y} the vertical coordinate. Let a_{x}\in I denote a single A-scan at horizontal location x as a_{x}:\mathcal{Y}\rightarrow\mathbb{R} , and it is defined a_{x}(y):=I(x,y) . The ground truth of a retinal layer can be parametrized as a function {y}^{gt}:\mathcal{X}\rightarrow\mathcal{Y} that assigns to every a-scan a corresponding vertical y coordinate. The y location in single A-scan a_{x} may then be denoted as y^{gt}_{x}:=y^{gt}(x) . With this notation in place, we present three methods for retinal layer segmentation: pixel-wise, regression, and signed distance function (SDF) approach. Pixel-wise approach : A neural network f predicts a segmentation function s:\mathcal{X}\times\mathcal{Y}\rightarrow[0,1] that returns a probability for the layer to each position. Specifically, a network with parameters \theta generates s=f^{segm}[I;\theta] , such that ideally s(x,y^{gt}_{x})=1 at the location of the layer, and zero otherwise. Typically, the pixel-wise segmentation predictions are parametrized with Bernoulli distributions, giving a probability for object presence and uncertainty that is directly reflected by the entropy (i.e., -s\log(s)-(1-s)\log(1-s) ) of the distribution. Notably, this approach can only express uncertainty in the presence of the structure, but not its shape. Regression approach ( REGR & pREGR ) : A neural network f^{regr} predicts a regression function y^{regr}:\mathcal{X}\rightarrow\mathcal{Y} that parametrizes the layer similarly as done in the ground truth, generating {y}^{regr}=f^{regr}[I;\theta] such that \forall_{x}:{y}^{regr}_{x}\approx y^{gt}_{x} . Such a model will be referred to with label REGR . To incorporate uncertainty in the predicted location we let the neural network parametrize a predictive distribution p(y(x)\mid I,\theta)=\mathcal{N}(\mu(x),\sigma(x)^{2})\,, (1) which we model as a Gaussian distribution with mean \mu(x)=f^{regr}_{\mu}[I;\theta](x) and variance \sigma(x)=f^{regr}_{\sigma}[I;\theta](x) . Such a probabilistic approach will be referred to with pREGR . Signed distance function approach ( SDF ) : A neural network f^{sdf} predicts a signed distance function d:\mathcal{X}\times\mathcal{Y}\rightarrow\mathbb{R} with the property that it satisfies the Eikonal constraint, that is \forall_{x,y}:\lVert\frac{\partial}{\partial y}d(x,y)\rVert=1 , and d(x,y^{gt}_{x})=0 , such that d can be interpreted as a distance to the layer. The Eikonal constraint ensures that

Read the complete text