Nonlinear Computation with Linear Optics via Source-Position Encoding
Nick Richardson, Cyrill Bösch, Ryan P. Adams · 2025
Read Nonlinear Computation with Linear Optics via Source-Position Encoding by Nick Richardson, Cyrill Bösch, Ryan P. Adams (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20401.txt.
Introduction
Light-based computers promise fast, frugal neural networks, but light struggles to produce the nonlinear bends that such networks need. Nick Richardson, Cyrill Bösch, and Ryan Adams found a way around that wall in 2025. They encode the data in where the light enters a fully linear optical system. The position itself then supplies the nonlinearity. Only the ability to aim the input at a data-chosen spot is required.
Around that trick they built an automated design framework that shapes optical hardware for one task at a time, borrowing modern optimization tools. The resulting devices beat purely linear methods on classification tasks and rivaled ordinary electronic networks, all at low power.
Catalog record
| CREATOR | Nick Richardson, Cyrill Bösch, Ryan P. Adams |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20401
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nonlinear Computation with Linear Optics via Source-Position Encoding Nick Richardson, Cyrill Bösch, Ryan P. Adams Abstract Optical computing systems provide an alternate hardware model which appears to be aligned with the demands of neural network workloads. However, the challenge of implementing energy efficient nonlinearities in optics – a key requirement for realizing neural networks – is a conspicuous missing link. In this work we introduce a novel method to achieve nonlinear computation in fully linear media. Our method can operate at low power and requires only the ability to drive the optical system at a data-dependent spatial position. Leveraging this positional encoding, we formulate a fully automated, topology-optimization-based hardware design framework for extremely specialized optical neural networks, drawing on modern advancements in optimization and machine learning. We evaluate our optical designs on machine learning classification tasks: demonstrating significant improvements over linear methods, and competitive performance when compared to standard artificial neural networks. 1 Introduction Modern machine learning systems demand an unprecedented scale of resources to drive application performance ( Radford et al., 2019 ; Brown et al., 2020 ) . Sustaining these efforts requires infrastructure developments, or improvements in efficiency; most likely both. The resulting emphasis on domain-specific hardware ( Jouppi et al., 2017 ) , coincident with the rampant popularity of neural networks for machine learning applications, has sparked a resurgence of interest in alternative hardware platforms for neural network workloads ( Schuman et al., 2022 ) . Computing with optics is particularly attractive, since optical signals are well-aligned with parallel, high-bandwidth-requiring dataflows, like those found in many neural networks ( Sui et al., 2020 ) . The linear scattering phenomena inherent to electromagnetic energy propagation is amenable to efficient implementations of the multiply-accumulate-based kernels which dominate neural network workloads ( Ivanov et al., 2021 ) . All that said, a critical unsolved problem is achieving efficient nonlinearities in optical hardware. Conventional materials-based optical nonlinearities typically require some combination of exotic materials, difficult fabrication procedures, or high-power light sources which negate the efficiency gained through more-or-less passive linear wave propagation ( Zuo et al., 2019 ; Feldmann et al., 2021 ; Keyes, 1985 ) . An alternative is to give up on an all-optical design, and compromise with optoelectronic transduction; essentially executing linear computational kernels in the optical domain, and nonlinearities in standard electronics ( Hughes et al., 2018a ; George et al., 2019 ) . This strategy seems to use both media in their ‘ideal’ operating regime, but much like analog electronic neural networks, these systems are ultimately gated by fundamental inefficiencies involved in transducing signals between the two physical media ( Rekhi et al., 2019 ) . As a result, the past year has seen several works concerned with developing low-power methods for nonlinear computation using linear media ( Xia et al., 2024 ; Li et al., 2024 ; Wanjura & Marquardt, 2024 ; Yildirim et al., 2024 ; Momeni et al., 2023 ) ; largely with an emphasis on machine learning applications. A discussion on prior art in inverse design for computational electromagnetics, and background on nonlinear optics are provided in Section A.3.3 and Section A.3.1 . We discuss recent efforts toward nonlinear computation with linear optics, and its relationship to our own work in Section A.3.2 . In this work, we contribute a novel method for nonlinear computation using low power, fully linear optics: source positional encoding. We exploit the fact that the relationship between the measured fields and the position of the source is nonlinear, and encode the data directly in the source position. Then, we optimize the spatial distribution of material such that the source-position-to-measured-field approximates a desired transfer function (e.g., a classifier). By harnessing a custom, differentiable full-wave field solver in concert with topology optimization for design of the optical hardware, we avoid analytic simplifications of the physics beyond discretization of Maxwell’s equations (a source of error which is well understood and largely controllable). In Section 2.1 , we detail the fundamental physics underlying our position-based encoding method. Section 2.2 describes a proposed system design (see Figure 2 ) for an optical classifier leveraging positional encoding as a nonlinearity. Section 2.3 describes the inverse problem associated with the hardware design; which is addressed with topology optimization and differentiable simulation. Section 3 presents experimental results across an array of test problems, with an emphasis on ablations verifying the effectiveness of our optical nonlinearity over fully linear methods. Finally, Section 4 offers limitations of our method and promising future directions. 2 Method 2.1 Source positional encoding Consider Maxwell’s equations 1 1 1 Our notation, and a brief review of the relevant electromagnetics is reviewed in Section A.2 . in the frequency domain, denoting the electric field with \mathcal{E} , and the source with \mathcal{J} . The resultant wave equation over a domain \Omega\subset\mathbb{R}^{3} and subject to Dirichlet boundary conditions can be written as \displaystyle\nabla\times\mu_{r}^{-1}(\mathbf{z})\nabla\times\mathcal{E}(\mathbf{z},\omega)-\omega^{2}\epsilon_{r}(\mathbf{z})\mathcal{E}(\mathbf{z},\omega) \displaystyle=j\omega\mathcal{J}(\mathbf{z},\omega) (1) \displaystyle\mathbf{z}\in\Omega,\quad\mathcal{E}(\mathbf{z},\omega)=0\quad \displaystyle\forall\mathbf{z}\in\partial\Omega. (2) The medium is modeled as isotropic and lossless, i.e. the relative permeability \mu_{r} and relative permittivity \epsilon_{r} are real-valued scalars. The corresponding generalized eigensystem is: \displaystyle\nabla\times\mu_{r}^{-1}(\mathbf{z})\nabla\times\mathcal{E}(\mathbf{z},\omega)=\omega^{2}\epsilon_{r}(\mathbf{z})\mathcal{E}(\mathbf{z},\omega). (3) We further define the following inner product: \langle\mathcal{E}(\mathbf{z},\omega),\mathcal{E}^{\prime}(\mathbf{z},\omega)\rangle_{\epsilon_{r}}:=\int_{\Omega}\mathcal{E}^{*}(\mathbf{z},\omega)\epsilon_{r}(\mathbf{z})\mathcal{E}^{\prime}(\mathbf{z},\omega)\;d\mathbf{z}. (4) The wave operator \mathcal{M}:=\nabla\times\mu_{r}^{-1}\nabla\times is self-adjoint with respect to this inner product. Therefore, by the spectral theorem ( Hermite, 1855 ; Cauchy, 1829 ) , \mathcal{M} has a discrete spectrum with eigenvalue-eigenfunction pairs (w_{i},\mathcal{E}_{i}) . Suppose the eigenfunctions are chosen to be orthonormal with respect to the inner product ( 4 ), i.e. \langle\mathcal{E}_{i}(\mathbf{z}),\mathcal{E}_{j}(\mathbf{z})\rangle_{\epsilon_{r}}=\delta_{ij} , such that \{\mathcal{E}_{j}\}_{j=1}^{\infty} forms an orthonormal basis. Figure 1: Three material distributions (vacuum with \epsilon_{r}=1 , and two arbitrarily chosen distributions, with \epsilon_{r}=3 in blue regions and \epsilon_{r}=1 in white regions; \mu_{r}=1 for all of them) and the 1st, 3rd and 6th corresponding eigenmodes. Clearly, the mode profiles can be quite distinct from the basic freespace modes (and one another) by varying the material distribution. Complex material distributions give rise to complex modes, implying a highly nonlinear relation between source position and measured field. Figure 2: The input data \mathbf{x} is used to determine which subset of the array of sources are active (illustrated in red). This collection of active sources is assembled into an aggregate electromagnetic source \mathbf{b}:=s(\mathbf{x}) . Below the aggregate source field we illustrate the geometry (hardware) \mathbf{A}(\theta_{g}) , which does not depend on the data but is optimized via a gradient method. The source and geometry are simulated in a differentiable field solver, resulting in the field shown. At a collection of fixed locations (shown as white rectangular regions imposed on the field), the energy is summed and re-mapped via a data-dependent linear decoding D(\mathbf{x};\theta_{d}) . In a classification application, the result is normalized and interpreted as the readout probabilities of the system (see rightmost). Then it follows that any field \mathcal{E}(\mathbf{z},\omega) satisfying ( 1 ) can be decomposed as, \mathcal{E}(\mathbf{z},\omega)=\sum_{i}c_{i}(\omega)\mathcal{E}_{i}(\mathbf{z}). (5) Inserting this decomposition into ( 1 ), using ( 3 ) and computing the inner product ( 4 ) with the eigenfunction \mathcal{E}_{m} results in ( Gilbert, 1971 ; Ulrich et al., 2022 ) : c_{m}(\omega)\omega_{m}^{2}=\omega^{2}c_{m}(\omega)-j\omega\braket{\mathcal{E}_{m}(\mathbf{r})|\mathcal{J}(\mathbf{r},\omega)}_{\epsilon}. (6) The coefficients can be written explicitly as c_{m}(\omega)=\frac{-j\omega}{\omega_{m}^{2}-\omega^{2}}\langle\mathcal{E}_{m}(\mathbf{z}),\mathcal{J}(\mathbf{z},\omega)\rangle_{\epsilon_{r}}. (7) For simplicity, consider the source to be a monochromatic point source at location \mathbf{z}_{s}\in\Omega with frequency \omega_{s} and unit amplitude, i.e. \mathcal{J}(\mathbf{z},\omega)=\delta(\mathbf{z}-\mathbf{z}_{s})\delta(\omega-\omega_{s})