Neural network parametrized level sets for image segmentation
Otmar Scherzer [email protected], Cong Shi [email protected], Thi Lan Nhi Vu [email protected] · 2026
Read Neural network parametrized level sets for image segmentation by Otmar Scherzer [email protected], Cong Shi [email protected], Thi Lan Nhi Vu [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16516.txt.
Introduction
Scherzer, Shi, and Vu segment images with neural level set functions. Chan-Vese methods are a leading segmentation approach. Older versions store the level set function pixel by pixel. Splines later gave leaner parametrized forms. A two-layer network equals a polygonal level set form, the authors show. That link recasts the network as a trial function for Chan-Vese energy. Training on sample images first yields better starts. Convergence then runs faster.
Catalog record
| CREATOR | Otmar Scherzer [email protected], Cong Shi [email protected], Thi Lan Nhi Vu [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62560 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16516
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural network parametrized level sets for image segmentation Otmar Scherzer [email protected], Cong Shi [email protected], Thi Lan Nhi Vu [email protected] Abstract The Chan-Vese functionals have proven to by a first-class method for segmentation and classification. Previously they have been implemented with level-set methods based on a pixel-wise representation of the level-sets. Later parametrized level-set approximations, such as splines, have been studied. In this paper we consider neural networks as parametrized approximations of level-set functions. We show in particular, that parametrized two-layer networks are most efficient to approximate polyhedral segments and classes. We also prove the efficiency for segmentation and classification. \newpagestyle headers \headrule \sethead [ 1][ Authors][]Title1 \setfoot 1 Faculty of Mathematics University of Vienna Oskar-Morgenstern-Platz 1 A-1090 Vienna, Austria 2 Johann Radon Institute for Computational and Applied Mathematics (RICAM) Altenbergerstraße 69 A-4040 Linz, Austria 3 Christian Doppler Laboratory for Mathematical Modeling and Simulation of Next Generations of Ultrasound Devices (MaMSi) Oskar-Morgenstern-Platz 1 A-1090 Vienna, Austria 1. Introduction Image segmentation and classification aims to partition an image into regions of desired properties. Accurate segmentation and classification plays a crucial role in many areas of applications such as object recognition, medical diagnosis, autonomous driving, and scene understanding, to name but a few. Basis for this work are the variational Chan-Vese segmentation [ 4 ] and classification [ 14 ] methods. In these approaches, piecewise constant functions are computed that minimize an energy functional. The regions of constant intensity are the segments and classes to be detected. The theoretical foundations of the Chan-Vese model date back to the seminal work of Mumford & Shah [ 10 ] and Morel & Solimini [ 9 ] . In computational practice, the Chan-Vese functionals are often minimized via a level-set approach, where the segments and classes are represented by the level-sets. level-set methods, originally introduced by Osher & Sethian [ 11 ] , have proven a powerful approach to solve image segmentation and classification tasks, because the implicit representation of segments and classes allows to find objects of complex topologies, such as, for instance, segments consisting of multiple connected domains. There exist two categories of level-set algorithms (see Figure 1 ): Unparametrized level-set algorithms consider the input images and the level-set functions, from which segments and classes are detected, pixel-wise. There, the data are represented as a vector of pixel values. Parametrized algorithms (see, for instance, [ 15 , 7 , 2 , 12 ] ) use ansatz-functions (such as splines or finite elements) to represent the level-sets and input images. This means, in particular, that the segments and classes are specified double implicitly : as the zero level-sets of the representing functions (first), which in turn are represented via the parametrization (second). The different concepts can be compared with finite difference and finite element methods for solving differential equations: The latter represents the solution of the differential equation implicitly by finite element parametrizations, wheareas the former are given explicitly as function values on a grid. In fact, hybrid level-set algorithms combining the advantages of both parametrized and unparametrized strategies have also been developed (see [ 8 ] ). Figure 1 : Commutative diagram illustrating the relationships among the classical, parametrized, and smooth Chan–Vese models. The classical (unparametrized) model can be approximated by the parametrized non-smooth model, which can then be approximated by the smooth variant. The achievements of this paper are as follows: (i) We propose a parametrized Chan-Vese method for image segmentation and classification, where we use deep neural networks for parametrization of the level-set functions. The efficiency of neural networks is unquestioned nowadays, but there remains a lack of transparency regarding why this is the case and how they should be parametrized (that means, which networks one should implement)? Such a motivation is the first goal of this paper: We give illustrative examples that demonstrates why (deep) two-hidden-layer networks efficiently represent segments and classes (see Section 2 ) defined from level-sets. This result puts the mathematical foundations of level-set methods and neural networks in perspective (see Section 3 ). (ii) We use these insights to provide an efficient neural network parametrized Chan-Vese algorithm for segmentation and classification (see Section 4 ). We note that by classification, we mean determining which object a pixel in the image belongs to. This differs from the terminology commonly used in the machine learning community, where classification usually refers to assigning a category label to an entire image. Before we go deeper into the analysis, we summarize the notations, which we use throughout the paper: Table 1 : Used notation Name Notation Reference Activation function \sigma ( 2.1 ) Affine linear function {\tt a} ( 2.2 ) Shallow neural network {\tt s} ( 2.3 ) Deep neural network {\tt t} ( 2.5 ) Set of one-layer networks {\tt N} ( 2.4 ) Set of two-layer networks {\tt T} ( 2.6 ) Number of neurons in the first layer n_{1} ( 2.3 ), ( 2.5 ) Number of neurons in the second layer n_{2} ( 2.5 ) Number of level lines m ( 3.1 ) Multiphase level-set function {\tt m} ( 3.4 ) A level-set function {\ell} ( 3.5 ) Regions to be segmented \Xi_{\imath} ( 3.5 ) and their constant values c_{\imath} ( 3.7 ) Unparametrized Chan-Vese functional E^{\tt f}_{CV} ( 3.2 ), ( 3.6 ) Parametrized Chan-Vese functional E^{\tt f}_{CV} ( 3.5 ) In the following, we start with an example motivating the efficiency of neural networks for segmentation. We then provide an overview of Chan-Vese segmentation models. Throughout this paper, we constrain ourselves to an image domain \Omega\subseteq\mathds{R}^{2} , meaning that the application we have in mind is image segmentation and classification. Without explicitly stating, we always assume that \Omega is bounded, satisfies the cone property (see [ 1 ] ), and has piecewise C^{1} -boundary. 2. Heaviside and sigmoid networks In this section, we define Heaviside and sigmoid networks: 2.1 Heaviside and sigmoid networks. Let \varepsilon>0 . \begin{aligned} \sigma:\mathds{R}\to\mathds{R}\,,\quad x\mapsto\left\{\begin{array}[]{rcl}1&\text{ for }&x>0\\ \frac{1}{2}&\text{ for }&x=0\\ 0&\text{ for }&x<0\end{array}\right.\end{aligned}\quad\quad\text{ and }\quad\quad\begin{aligned} \sigma_{\varepsilon}:\mathds{R}\to\mathds{R}\,,\quad x\mapsto\frac{1}{1+\mathrm{e}^{-\frac{x}{\varepsilon}}},\end{aligned} (2.1) are called Heaviside and sigmoid functions, respectively. • A Heaviside network function , N=\sigma\circ{\tt a} , is a composition of an Heaviside and an affine linear function \displaystyle{\tt a}:\mathds{R}^{2}\to\mathds{R}\,,\quad{\vec{x}}\mapsto\vec{w}^{T}{\vec{x}}+b, (2.2) with parameters \vec{w}\in\mathds{R}^{2},b\in\mathds{R} . • A one-layer (shallow) Heaviside network with n_{1} neurons (see 2(a) ) is a linear combination of Heaviside ansatz functions N_{j} , j=1,\ldots,n_{1} : {\vec{x}}\in\mathds{R}^{2}\mapsto{\tt s}({\vec{x}}):={\tt s}[\vec{a},{\bf W},\vec{b}]({\vec{x}}):=\sum_{j=1}^{n_{1}}a_{j}N_{j}({\vec{x}})=\sum_{j=1}^{n_{1}}a_{j}(\sigma\circ{\tt a}_{j})({\vec{x}})=\sum_{j=1}^{n_{1}}a_{j}\sigma(\vec{w}_{j}^{T}{\vec{x}}+b_{j})\,, (2.3) where {\bf W}=(\vec{w}_{1},\ldots,\vec{w}_{n_{1}})\in\mathds{R}^{n_{1}\times 2} , \vec{a}=(a_{1},\ldots,a_{n_{1}})\in\mathds{R}^{n_{1}} and \vec{b}=(b_{1},\ldots,b_{n_{1}})\in\mathds{R}^{n_{1}} are called the parametrizations of the function {\tt s} . The set of all one-layer neural networks is denoted by {\tt N}:=\left\{{\tt s}[\vec{a},{\bf W},\vec{b}]:{\bf W}\in\mathds{R}^{n_{1}\times 2},\vec{a}\in\mathds{R}^{n_{1}},\vec{b}\in\mathds{R}^{n_{1}}\right\}\;. (2.4) • A two-layer Heaviside neural networks with n_{1} neurons in the first layer and n_{2} neurons in the second layer (see 2(b) ) is defined as {\vec{x}}\in\mathds{R}^{2}\mapsto{\tt t}({\vec{x}}):={\tt t}[{\bf A},\vec{c},{\bf D},\vec{b},{\bf W}]({\vec{x}}):=\sum_{i=1}^{n_{2}}c_{i}\sigma\left(\sum_{j=1}^{n_{1}}a_{ij}\sigma({\tt a}_{j}({\vec{x}}))+d_{ij}\right)\;. (2.5) {\bf A}=(a_{ij})\in\mathds{R}^{n_{2}\times n_{1}} , \vec{c}=(c_{i})\in\mathds{R}^{n_{2}} , {\bf D}=(d_{ij})\in\mathds{R}^{n_{2}\times n_{1}} and \vec{b}=(b_{j})\in\mathds{R}^{n_{1}} , {\bf W}=(w_{ij})=(\vec{w}_{j})\in\mathds{R}^{n_{1}\times 2} (note that {\tt a}_{j} depends on {\bf W} and \vec{b} ) are the parametrization of {\tt t} . The set of all two-layer neural networks is denoted by {\tt T}:=\left\{{\tt t}[{\bf A},\vec{c},{\bf D},\vec{b},{\bf W}]:{\bf A}\in\mathds{R}^{n_{2}\times n_{1}},\vec{c}\in\mathds{R}^{n_{2}},{\bf D}\in\mathds{R}^{n_{2}\times n_{1}},\vec{b}\in\mathds{R}^{n_{1}},{\bf W}\in\mathds{R}^{n_{1}\times 2}\right\}\,. (2.6) • A sigmoid network is defined analogously to a Heaviside network by replacing