A Retinomorphic Optical Spiking Neuron for Camouflaged Object Detection
Srilagna Sahoo, Adwaaiit Pande, Kartikey Thakar, Shubham Sahay, Saurabh Lodha · 2026
Read A Retinomorphic Optical Spiking Neuron for Camouflaged Object Detection by Srilagna Sahoo, Adwaaiit Pande, Kartikey Thakar, Shubham Sahay, Saurabh Lodha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00818.txt.
Introduction
Sahoo and co-authors build an eye-like optical neuron in this 2026 paper. Their device aims at fast, low-power front-end vision, in the style of a retina. It rests on a Hodgkin-Huxley model of neuron firing. A two-dimensional anti-ambipolar phototransistor, run below threshold, keeps power use low.
The neuron encodes light by wavelength and brightness as spikes. Energy per spike is 0.9 picojoules in the dark and 2 picojoules at mid wavelengths. Spike rates run from near zero to 2 kilohertz. Response times beat the human retina by a wide margin. The device mimics retinal tricks: center-surround fields, adaptation to bright scenes, and color opponency. Paired with a spiking network, it hunts camouflaged objects. The authors report accuracy gains of 4.4 to 28.4 percent over standard spiking networks across three datasets.
Catalog record
| CREATOR | Srilagna Sahoo, Adwaaiit Pande, Kartikey Thakar, Shubham Sahay, Saurabh Lodha |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00818
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Retinomorphic Optical Spiking Neuron for Camouflaged Object Detection Srilagna Sahoo, Adwaaiit Pande, Kartikey Thakar, Shubham Sahay, Saurabh Lodha Abstract Advanced vision systems require retinomorphic, energy-efficient spike-based preprocessing of dynamic visual scenes. Here, we demonstrate multiple retinal preprocessing functionalities by leveraging a Hodgkin-Huxley-based optical spiking neuron (OSHN) that incorporates a two-dimensional anti-ambipolar phototransistor operated in the subthreshold regime to minimize power consumption. OSHN exhibits wavelength- and intensity-sensitive spike encoding with energy consumption per spike of 0.9 pJ under dark, 2 pJ at 480 nm (mid wavelength, M), and 24.5 pJ at 800 nm (long wavelength, L). The low (biological)-to-high spiking rate (0 - 2 kHz) with substantially faster response times (4.2 µs - 1.25 ms) than the human retina (30 ms - 60 ms), reveal OSHN’s fast decision-making capability. OSHN facilitates concurrent spectral-spatial processing by emulating retinal antagonistic center-surround receptive fields (CSRFs) at a single wavelength (480 nm or 800 nm) with varying intensities, visual adaptation (at 480 nm) to prevent system saturation, and L-M cone opponency in midget ganglion cells. Finally, a CSRF-augmented spiking neural network (SNN) has been developed for camouflaged object detection, achieving 4.4 % \% , 10.4 % \% , and 28.4 % \% improvements in accuracy over conventional SNN on FMNIST, COD10K, and synthetic camouflaged datasets, outperforming existing photoactive spiking architectures while enabling event-driven intelligent edge vision systems. keywords 2D WSe 2 , Visible-NIR, Anti-ambipolar Phototransistor, Neuromorphic Vision, Receptive Field, Color Opponency Surging demand for advanced visual perception systems across next-generation intelligent applications, such as opto-bionics, autonomous navigation, and edge artificial intelligence (AI), has highlighted the limitations of high latency, limited dynamic range, high power consumption, and data redundancy in conventional vision systems. Their von Neumann architecture requires analog-to-digital conversion circuits to convert sensory analog input signals to digital format, leading to area- and energy-inefficiencies. 1 In contrast, the human retina encodes continuous photonic stimuli into voltage spike trains and sends them to the visual cortex for processing, enabling a compact, low-power biological vision system. 2 ; 3 Bio-inspired neuromorphic vision systems that closely mirror the retina’s in-sensor computing can alleviate the von Neumann bottleneck and enable event-driven spike encoding, rather than entire image frames, thereby reducing data redundancy while supporting low-power computation. 4 ; 5 ; 6 Two-dimensional (2D) material-based optoelectronic devices offer a compelling platform for low-power, neuromorphic opto-sensory computing due to their ultra-thin scalability, intrinsic mechanical flexibility, bandgap tunability, and strong light-matter interactions. 7 ; 8 ; 6 ; 9 ; 10 ; 11 ; 12 Forward phototransduction in the human retina occurs through photoreceptor cells (PCs) \rightarrow to \rightarrow bipolar cells (BCs) \rightarrow to \rightarrow retinal ganglion cells (RGCs), along with two interneurons: horizontal cells (HCs) and amacrine cells (ACs), which are responsible for lateral interactions. 13 The HCs collect responses from different PCs and send lateral-inhibitory feedback to the PC-BC synapses, shaping the center-surround receptive field (CSRF) 14 of the BCs and the RGCs, facilitating spatial contrast enhancement 15 , color opponency 16 , and edge detection 17 preprocessing functionalities. Other retinal preprocessing functionalities include wavelength and intensity encoding 18 and visual adaptation (VA). 3 ; 19 ; 20 Biomimicking the VA functionality of PCs has been widely reported using a phototransistor or an optical synaptic architecture within an artificial neural network (ANN)-based machine vision system. 21 ; 22 ; 19 ; 20 A step further, ambipolar-WSe 2 -based phototransistors exhibiting dual-polarity photoresponses have been exploited for replicating graded potential photoresponse characteristics of PCs and BCs, thereby demonstrating simulation of the BC receptive field. 23 ; 24 ; 25 These retinomorphic vision sensory systems have focused mostly on emulating only PC or PC \rightarrow BC characteristics, representing a partial emulation of the human retinal path, and processing of continuous-time analog signals. The absence of spike information encoding has restricted their integration into biologically plausible spiking neural network (SNN)-based vision systems. Few research groups have demonstrated introductory light-to-spike encoding based on a leaky integrate-and-fire (LIF) neuron model utilizing separate blocks of a photoelectric synapse and an MoS 2 -threshold switch memristor 26 or an MoS 2 -based 1T-1C device. 27 Furthermore, a monolayer MoS 2 device has been reported to emulate LIF neuron behavior, exhibiting wavelength-dependent spike responses in an SNN. 28 Stochastic optical spike encoding in an SNN architecture has also been demonstrated using a combination of a Si-photodiode and a MoS 2 FET 2 or a b-AsP/MoTe 2 3 heterostructure. Although the above studies demonstrate retina-like light-spike encoding, they fail to capture the many preprocessing functionalities that enable the human eye to distinguish minute feature details, such as spatial background contrast relative to the foreground, temporal resolution, and a wide dynamic range. Despite their simplicity and computational efficiency, the IF or LIF neuron models fall short of the biological realism of the Hodgkin-Huxley (HH) model, as they fail to capture the dynamics of ion-channels and the precise shape of the action potential ( V_{M} ); rendering them unsuitable for accurate and detailed biophysical integration. Hence, it is vital to develop an HH neuronal model-based optical neurocomputing architecture, that can support both biomedical and robotic integration. This work presents an anti-ambipolar phototransistor based on a single 2D photoactive channel material, WSe 2 29 ; 11 , featuring three back gates: a channel gate ( G_{C} ) and two barrier gates ( G_{B} s). The consistent subthreshold operation of the 2D anti-ambipolar phototransistor (2D subthreshold phototransistor, 2DSpT) is enabled by effective electrostatic control through complementary bias sweeping of G_{C} and G_{B}s , resulting in low-power operation. The optoelectronically modulated, bell-shaped transfer curve of this anti-ambipolar phototransistor resembles the dynamics of sodium ion (Na + ) conductance in biological neurons. 8 ; 30 An optical spiking neuron based on the HH neuron model (OSHN) has been developed that incorporates the WSe 2 phototransistor’s (as a Na-channel) behavioral model, implemented in 45 nm CMOS technology, to mimic wavelength-intensity-sensitive (WIS) spike encoding under dark and illumination (480 nm and 800 nm). The WIS spike encoding was achieved with energy consumption per spike (EPS) of 0.9 pJ in the dark and 2 pJ and 24.5 pJ under 480 nm (M, mid wavelength) and 800 nm (L, long wavelength) illumination, respectively. It exhibits a low (biological)-to-high spiking rate (0 - 2 kHz) while achieving response times (4.2 µs - 1.25 ms) substantially faster than the retina (30 ms - 60 ms). 31 OSHN outperforms a similar HH-vision system (0.5 Hz - 25 Hz spiking rate and 1.1×10 6 pJ EPS at 580 nm) based on Si-photodiodes integrated with a bilayer organic transistor 18 by exhibiting 80 \times higher spiking rate and 10 6 -fold lower EPS. Relative to OSHN, a visual neural encoder 32 exhibiting a higher spiking rate (0.35 MHz – 1.85 MHz) and a comparable visual cue response time (1 µs – 13 µs) also requires 500-fold greater energy per spike (EPS, 1 nJ). The above reported optical spike encoding systems show higher spike rates, but at the cost of higher energy consumption, and relatively few studies have focused on first-spike arrival time, which is an important parameter for quick decision-making capability. These reports exhibit limited retinal functionalities (WIS and VA are widely discussed, whereas RF is rarely addressed) with partial emulation of the