Bioinspired CNNs for border completion in occluded images
Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi · 2026
Read Bioinspired CNNs for border completion in occluded images by Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10694.txt.
Introduction
Catarina P Coutinho and co-authors borrow the mathematics of border completion in the visual cortex to build convolutional filters that resist image occlusion. Their network, BorderNet, is designed from that model of how vision fills in missing edges. They tested it under stripe and grid occlusions, on EMNIST, MNIST, and Fashion-MNIST. In all cases BorderNet improved performance over the comparison setup. The gains varied with occlusion severity and dataset, but the design helped throughout.
Catalog record
| CREATOR | Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20296 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.10694
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bioinspired CNNs for border completion in occluded images Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi Abstract We exploit the mathematical modeling of the border completion problem in the visual cortex to design convolutional neural network (CNN) filters that enhance robustness to image occlusions. We evaluate our CNN architecture, BorderNet, on three occluded datasets—MNIST, Fashion-MNIST, and EMNIST—under two types of occlusions: stripes and grids. In all cases, BorderNet demonstrates improved performance, with gains varying depending on the severity of the occlusions and the dataset. 1 Introduction Visual encoding of information in higher mammals faces significant challenges, as for example, situations where occlusions partially hide an object, making its identification nontrivial. The mathematical modelling of mammalian visual cortex (V1) ability to reconstruct partially occluded images, is a current and active research area (see [ 6 ] and refs. therein). Starting from the pioneering study by Hubel and Wiesel, [ 14 , 15 ] , whose ice-cube model of the visual cortex first provided a functionally meaningful anatomic characterization of the primary visual cortex, later models focused in understanding finer mechanisms as in [ 13 ] , where Hoffman provides a mathematical representation of V1 as a contact bundle, explaining the orientation selectivity occurring in contour detection. In fact, anatomically, the border directions in a perceived image are selected within hypercolumns, the functional units in V1 composed of columns of neurons tuned to specific orientations. Each column responds maximally to a preferred orientation, enabling the construction of a local orientation map across the visual field. Information from the dominant orientation at each location is then relayed to higher cortical areas for further processing [ 10 ] . A key functional property emerging from this hypercolumnar organization is contour integration , which is the ability to reconstruct partially occluded boundaries from their visible portions. This phenomenon was first described on a phenomenological level by Gestalt psychology under the law of good continuation, one of the Prägnanz principles governing perceptual organization [ 16 ] . Continuity plays a central role in shape perception, allowing the visual system to integrate spatially distributed orientation cues into smooth and coherent contours. Neurophysiologically, this capability is supported by the horizontal connectivity between hypercolumns: neurons with collinear orientation preferences tend to excite each other, while orthogonally tuned neurons are inhibited. These association fields as in Figure 1 , [ 10 ] effectively promote the completion of interrupted contours, providing a biological solution to the occlusion problem. Figure 1: Association Fields This understanding of receptive fields of simple and complex cells, together with the anatomically observed structured arrangement of the orientation selective columns, led to finer mathematical formulations grounded in differential geometry (see [ 4 ] , [ 3 ] , [ 18 ] , [ 5 ] , [ 2 ] ). In particular, modeling V1 as a contact bundle as in [ 13 ] led to take advantage of the natural sub-Riemannian structure thus providing a rigorous framework in which contour completion can be interpreted as the solution of a sub-Riemannian geodesic problem. At the same time a growing number of researchers in machine learning, started to draw a closer parallellism between the human visual perception and the successful algorithms of deep learning (see [ 12 ] , [ 9 ] , [ 8 ] and refs. therein). In this work, we want to present the border completion in V1 from a theoretical point of view, via the Hamiltonian sub Riemannian formalism along the lines in [ 11 ] , which however had a different scope. Then, we shall take advantage of the mathematical modelling to investigate how the biological mechanisms underlying contour integration can be translated into a computational framework to enhance convolutional neural networks (CNNs) robustness against occlusions in image classification tasks. Building on our previous geometric models of V1, we introduce biologically inspired directional filters into LeNet5, a CNN whose architecture bears notable similarities to the early visual pathway [ 19 ] . These predefined filters mimic the action of orientation-selective receptive fields and border integration operators. We test our proposed architecture BorderNet on occluded versions of the MNIST, FashionMNIST and EMNIST datasets, where images are corrupted by diagonal black stripes, and grids. Our model is trained exclusively on the original, unmodified dataset; occluded images are used only at test time. Our results show that incorporating orientation-aware filters significantly improves classification accuracy under such occlusions, thus confirming the proof of concept preliminary results obtained in [ 7 ] . This paper is organized as follows. Section 2 reviews the mathematical framework underlying our approach and details the proposed bio-inspired architecture and dataset construction. Sections 3 and 4 present and discuss the experimental results, comparing the performance of the standard LeNet5 model with that of the enhanced network endowed with border integration capabilities. 2 Mathematical Modeling for border completion in V1 In this section we discuss the mathematical modeling for the mechanism of border completion in the primary visual cortex V1, via the calculation of the sub Riemannian geodesics with respect to a bracket generating distribution. We shall use the Hamiltonian formalism, instead of the more established Lagrangian one [ 5 ] , [ 18 ] . These calculations appeared originally in [ 11 ] ; we briefly recap them, since the different focus and scope of [ 11 ] may not make the reader aware of their significance for the present purpose. In sub Riemannian geometry, the metric on a manifold M is replaced by a sub Riemannian metric, which is a semidefinite positive symmetric bilinear form g on the tangent bundle, typically assumed to be of constant (non maximal) rank (see [ 1 ] , [ 17 ] and refs. therein). Hence its non degenerate locus defines a distribution \mathcal{D} on M , i.e. a smooth assignment M\ni x\mapsto\mathcal{D}_{x}\subset T_{x}M,\qquad g|_{\mathcal{D}_{x}}\,\hbox{non degenerate,} (1) where dim \mathcal{D}_{x}< dim T_{x}M . We call a distribution bracket generating when a finite number of brackets of the vector fields that generate it, generate the tangent space to M at each point. Typically (but not always) in sub Riemannian geometry we assume the distribution \mathcal{D} as in ( 1 ) to be bracket generating. We call sub Riemannian geodesics for the sub Riemannian metric g the shortest paths connecting two given points in the manifold M . In general, the sub Riemannian geodesic problem may not have a solution and when the solution exists it may not be unique: the Hamiltonian or Lagrangian formulation of the question may indeed lead to different solutions [ 17 ] . However, despite the fact the two approaches are not in general equivalent in sub Riemannian geometry, with some extra regularity hypotheses, as for example the assumption of \mathcal{D} coming from a principal bundle distribution, they are. We will see that indeed, viewing the visual cortex as contact bundle as in [ 13 ] , gives to it a natural a principal bundle structure [ 2 ] , so that the Hamiltonian and Lagrangian formulations for the geodesic question lead to the same answer. We start by modeling the functional architecture of the primary visual cortex in its border completion capability, (see [ 18 ] , [ 5 ] ,