Enhancing CNNs robustness to occlusions with bioinspired filters for border completion
Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi · 2025
Read Enhancing CNNs robustness to occlusions with bioinspired filters for border completion by Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17619.txt.
Introduction
Catarina Coutinho and co-authors add brain-inspired filters to image networks so they cope better when parts of an image are hidden. Their 2025 paper models how the visual cortex fills in missing borders. Tests used a modified LeNet 5 network on digit images with blocked parts. The authors report steady gains, above all in accuracy, for partly hidden images. A simple step drawn from brain science, they argue, can help networks stay accurate under poor viewing conditions.
Catalog record
| CREATOR | Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 11 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17619
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing CNNs robustness to occlusions with bioinspired filters for border completion Catarina P. Coutinho, Aneeqa Merhab, Janko Petkovic, Ferdinando Zanchetta, Rita Fioresi Abstract We exploit the mathematical modeling of the visual cortex mechanism for border completion to define custom filters for CNNs. We see a consistent improvement in performance, particularly in accuracy, when our modified LeNet 5 is tested with occluded MNIST images. 1 Introduction Visual perception has evolved as a fundamental tool for living organisms to extract information from their surroundings and adapt their behavior. However, encoding visual information presents several challenges. One major issue is occlusion, i.e. an object’s outline is partially hidden by an obstacle. In such cases, correctly identifying the object is far from straightforward. One functional solution is the orientation selectivity mechanism in the mammalian brain, [ 9 , 17 ] . This mechanism allows to construct a percept of orientation at every point of a perceived image, and it is implemented via a specific anatomical object, the hypercolumn [ 10 ] . The hypercolumn is, at its core, a group of cells, referred to as columns , each exhibiting maximal response to a specific orientation realizing what is called orientation tuning . This ultimately led to more sophisticated mathematical modeling [ 8 ] , later on developed by others including [ 20 , 2 ] (see also [ 3 ] and refs. therein). When an image is processed, the hypercolumn’s response is driven by the column corresponding to the dominant orientation at that location, and this information is relayed to higher cortical areas. Understanding how columnar orientation selectivity emerges and how differently tuned columns interact has been a major area of research since the discovery of cortical hypercolumns, from experimental [ 22 ] , [ 27 ] , computational [ 26 ] , [ 7 ] , [ 11 ] , and theoretical perspectives [ 25 ] , [ 24 ] [ 13 ] . One crucial property enabled by the hypercolumnar structure is contour integration . First observed and investigated by the Gestalt school of psychology under the name of "law of good continuation" [ 15 ] , this property allows the human (mammalian) brain to reconstruct occluded contours building up from the information present in the visible portion of the image [ 4 ] . This reconstruction can be understood in terms of neighbouring association fields , which integrate aligned orientation cues scattered throughout the input, and produce smooth, coherent contours [ 1 ] . This effect is, in fact, the behavioural counterpart of the hypercolumnar horizontal connectivity, i.e. the interneuronal connections that excite (or inhibit) collinear (or orthogonal) columns in adjacent hypercolumns. This mechanism effectively resolves the occlusion problem, as partially hidden contours can be induced from their visible portions, allowing the complete object to be fully perceived, see the seminal work [ 14 ] , and later on in [ 6 ] , [ 16 ] , [ 20 ] , [ 8 ] for mathematical modeling. In this work we are interested in understanding if this biological mechanism can be implemented computationally in a neural network model to effectively increase its robustness against image occlusion during a classification task. The parallels between the cortical connectivity and the neural network is currently a lively field of research, [ 19 ] , [ 23 ] , with bioinspired solutions leading to significant improvements in a variety of tasks [ 18 ] , [ 12 ] . Building on these and other previous results [ 21 ] we show how LeNet 5, a CNN known for its strong similarities with the mammalian visual pathway, can benefit from the addition of biologically inspired directional filters, closely resembling the receptive field observed for the cortical hypercolumns. We show that incorporating these filters significantly improves the model performance when classifying occluded images , i.e. images where a black, oriented striping has been applied, despite the model being trained on an unmodified dataset, thus realizing a contour integration, very similar to the human one [ 1 ] . Notably, this performance improvement does not stem from a simple increase in parameter count but appears to result from the specific geometric features of the introduced filters. The structure of the paper is as follows. In Sec. 2 , we recall briefly the mathematical modeling introduced in [ 21 ] , [ 5 ] , which is the base for our subsequent treatment. We also describe the bioinspired deep learning architecture, where we use predefined filters to mimic the action of the vector fields on a contour and the border detection operator. We also present our occluded dataset, obtained from MNIST, with diagonal occlusions, that we shall use for our testing. It is important to remark that at no stage of our training or validation, we employ such occluded dataset, reserving it only for testing. In Sec. 3 , we discuss the results, namely we compare the accuracies obtained by vanilla LeNet 5 with the ones achieved with our enhanced CNN with border integration capabilities. 2 Methodology In this section we describe the mathematical modeling of border perception as introduced in [ 5 ] and then the filter implementation mimicking the vector fields employed for the border completion. At the end, we explain the occluded dataset that we have created for our experiments. Mathematical Model of border perception. Following [ 5 ] , we think of an image as a smooth function I\colon D\to\mathbb{R} , where D\subset\mathbb{R}^{2} corresponds to a receptive field in the retina or equivalently in the visual cortex V1. We now give a key definition, which is the base for our subsequent bioinspired CNN. Definition 1 Let I\colon D\to\mathbb{R} be a smooth function, and \mathrm{reg}(D)\subseteq D the subset of the regular points of I , i.e. the points with non vanishing gradient. We define the orientation map of I as \Theta\colon\mathrm{reg}(D)\to S^{1}\qquad(x,y)\mapsto\Theta(x,y)\,=\,\mathrm{argmax}_{\theta\in S^{1}}\{Z(\theta)I(x,y)\} where Z:=Z(x,y,\theta)\,=\,-\sin\theta\,\partial_{x}+\cos\theta\,\partial_{y}, is called the orientation vector field . Let I:\mathrm{D}\longrightarrow\mathbb{R} be as above and (x_{0},y_{0})\in\mathrm{D} a regular point. Then, there there exists a unique \theta_{x_{0},y_{0}}\in S^{1} for which the function \zeta_{x,y}:S^{1}\longrightarrow\mathbb{R} , \zeta_{x,y}(\theta):=Z\,I(x,y) attains its maximum. Hence, the map \Theta is well defined and differentiable. This is an immediate consequence of the implicit function theorem (see [ 5 ] for more details). Notice that the locality of the operator Z (viewing vector fields as operators on functions) mirrors the locality of the hypercolumnar anatomical connections. In [ 5 ] , we show that, employing Z to obtain a differential constraint via a contact distribution, we can define a sub-Riemannian geodesic problem. The geodesic curves solutions to this problem appear close to the ones experimentally observed in [ 1 ] , see Fig. 1 . Figure 1: The association field. This highlights the key role of Z and suggest the implementation of custom filter replicating the orientation map \Theta . Deep Learning Models. We take into exam three CNN models: LeNet 5 (Vanilla LeNet) and two modified LeNet 5, that we call BorderNet and RandomNet, in which four custom filters were added at the beginning as a sequence of convolutions. For BorderNet these filters were created based on the analogy with the visual cortex, each filter featuring one orientation - horizontal, vertical,