TRON: Trainable, Architecture-Reconfigurable Random Optical Neural Networks

Ziao Wang 1,† , Fei Xia 1,2,†,∗ , Logan G. Wright 3,4,6 , Tatsuhiro Onodera 3,4,5 , Martin Stein 3,4,6 , Jianqi Hu 1 , Peter L. McMahon 3 , Sylvain Gigan 1,∗ · 2026

Read TRON: Trainable, Architecture-Reconfigurable Random Optical Neural Networks by Ziao Wang 1,† , Fei Xia 1,2,†,∗ , Logan G. Wright 3,4,6 , Tatsuhiro Onodera 3,4,5 , Martin Stein 3,4,6 , Jianqi Hu 1 , Peter L. McMahon 3 , Sylvain Gigan 1,∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16228.txt.

Introduction

Wang and seven colleagues introduce TRON, a trainable optical neural network that can be reshaped for different architectures. Optical processors promise vast parallelism and bandwidth with lower energy use, but scalable, reconfigurable designs have been missing. TRON uses a scattering medium and a digital mirror device as a learnable dense matrix multiplier, tunes its optics in place, and searches architectures directly on the optics.

Catalog record

CREATORZiao Wang 1,† , Fei Xia 1,2,†,∗ , Logan G. Wright 3,4,6 , Tatsuhiro Onodera 3,4,5 , Martin Stein 3,4,6 , Jianqi Hu 1 , Peter L. McMahon 3 , Sylvain Gigan 1,∗
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47507
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16228

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TRON: Trainable, Architecture-Reconfigurable Random Optical Neural Networks Ziao Wang 1,† , Fei Xia 1,2,†,∗ , Logan G. Wright 3,4,6 , Tatsuhiro Onodera 3,4,5 , Martin Stein 3,4,6 , Jianqi Hu 1 , Peter L. McMahon 3 , Sylvain Gigan 1,∗ Abstract Abstract Deep learning has triggered explosive growth in the demand for specialized hardware processors, thus motivating the development of scalable and reconfigurable computing substrates. Optical processors offer a fundamentally different computing paradigm, combining massive parallelism and ultrahigh bandwidth with the potential for substantial energy savings. However, progress has been constrained by the absence of scalable and reconfigurable architectures that can implement a broad class of network architectures. Here, we introduce TRON, a scalable and trainable optoelectronic deep optical neural network that exploits a multi-scattering medium and a DMD as a learnable, high-dimensional dense optical matrix multiplier, processing with fixed and tunable optical operations. We perform in-situ optimization of the optical parameters involved in the scattering process, together with automated neural architecture search (NAS) and optimization directly on optics. The experimental results demonstrate that in-situ NAS is essential to discover architectures that adapt to both the task and hardware constraints, establishing a viable path towards large-scale optical processors for next-generation machine learning and data-intensive computing. I Introduction Deep learning 36 ; 53 ; 23 has become a central driver of progress in artificial intelligence, enabling breakthroughs that include, but are not limited to, computer vision 25 ; 34 ; 15 , natural language processing 39 ; 60 ; 13 ; 8 , and scientific data analysis 31 ; 17 . This rapid expansion has led to an unprecedented demand for specialized processing hardware 30 ; 50 ; 56 , accompanied by a sharp increase in computational costs and energy consumption 3 ; 57 . As deep neural networks continue to scale in size and complexity, improving the efficiency of the underlying computing platforms has emerged as a critical challenge 33 ; 47 . Optical computing offers a fundamentally different computing paradigm by performing analog computations directly in the optical domain. Owing to the intrinsic properties of light, optical systems naturally provide ultrahigh bandwidth, massive parallelism, and low latency, making them attractive candidates for energy-efficient information processing 42 ; 64 ; 19 ; 9 ; 54 ; 5 . Inspired by the success of neural networks on electronic computing platforms, optical neural networks (ONNs) have been proposed as a class of optical processors capable of executing machine learning workloads in optical hardware 42 ; 64 ; 19 ; 9 ; 54 . In principle, ONNs can combine the expressive power of neural networks with the physical advantages of optics to enable scalable and efficient computations. Recent experimental advances have demonstrated ONNs on integrated photonic and free-space platforms 40 ; 6 ; 27 ; 43 ; 37 ; 61 ; 38 ; 10 ; 5 ; 32 ; 67 ; 24 ; 69 ; 63 ; 66 . Integrated photonic implementations provide compact and stable optical processors for small-scale but fast matrix multiplications and have been applied to tasks such as optimization 2 , advanced machine learning 63 ; 66 ; 26 ; 1 , optical communications, and signal processing 27 , while free-space optical platforms offer high-dimensional processing for imaging 43 ; 37 , sensing 61 ; 67 , and standard machine learning tasks 38 ; 10 ; 32 ; 69 . These demonstrations underscore the potential of optical processors to perform neural network computations by encoding information on optical signals. Despite this progress, most of the ONNs demonstrated to date remain limited in scalability and flexibility. Many optical processors are based on fixed or relatively shallow network architectures, usually with fewer than three layers, and include only a small number of input neurons (often under a few hundred). Diffractive neural networks made using static optical elements, for example, are optimized for one type of task and lack reconfigurability after fabrication 64 ; 38 ; 54 . Programmable ONNs 6 ; 61 ; 12 expand the diversity of computing tasks but are still typically limited to a few layers, making their applicability to large-scale deep learning problems further limited 55 ; 29 . Scaling up matrix-vector multiplication, which is the core operation in deep neural networks, remains also a major challenge for optical processors, particularly in closed-loop training and high-speed operation due to hardware speed limitations 64 ; 54 ; 44 . All these limitations hinder the ability of current ONNs to represent complex functions and to generalize in various tasks that require deeper and wider neural networks 64 ; 54 ; 4 . Here, we present an alternative approach that overcomes the above limitations by exploiting the high-dimensional, analog, and complex weight mixing intrinsic to optical scattering media. Complex scattering media, characterized by strong spatial heterogeneity in their optical properties, have previously been used to realize large-scale optical random projections 21 for kernel machines 52 , linear operators 41 ; 46 and learning algorithms based on random features 35 ; 62 . However, such systems have largely been limited to fixed, untrainable transformations. In this work, we transform fixed optical scattering into a programmable and trainable computational resource by actively controlling the high-dimensional, input-dependent mixing of light through a complex scattering medium using a spatial light modulator. This enables reconfigurable, high-dimensional matrix-vector multiplication, while intensity detection at the camera introduces an inherent nonlinearity. We refer to this architecture as a trainable random optical neural network (TRON), as it merges the trainability of a neural network with the properties of an optical random scattering medium. By treating the scattering-based system as a flexible computational layer, we demonstrate in situ reconfiguration of both network depth and width, enabling automated optimization of network architecture and weights directly on the physical system. Our approach combines massive optical parallelism with scalability, reconfigurability, and efficient trainability via backpropagation, which offloads the dominant forward passes workload to the optical hardware, while retaining electronic control and training-time gradient computation. Using this framework, we demonstrate accurate in situ inference on both scientific and real-world datasets, establishing a pathway towards scalable optical processors for large-scale machine learning and other data-intensive computing tasks. II Results II.1 Scalable, automated and hardware-efficient architecture design for deep TRON tailored for computing tasks To introduce our concept, we start from a conventional optical computing configuration based on a randomly scattering medium, in which the input data is encoded by a specialized SLM that has binary pixels as input named the digital micromirror device (DMD), then mapped through the fixed scattering medium and detected in intensity, implementing a large-scale single-layer random projection with no trainable parameters (Fig. 1 A). Here, instead of using the randomly scattering medium only as a fixed random projector, we exploit the inherent analog, complex-valued “optical weights” with up to 10 12 in dimension (Supplementary Section 1) to design an TRON with reconfigurable randomized matrix-vector multiplication. The general principle starts by partitioning the modulator pixels into two sections: one for trainable parameters optimized for specific tasks, and the other as input for training or inference data. This partitioning allows trainable complex-weight mixing in the medium, followed by intensity detection as a nonlinear operation, effectively implementing a trainable one-layer TRON (Fig. 1 B,

Read the complete text