Adaptive Sensing beyond Non-Adaptive Information Limits: End-to-End Co-Design of Geometry, Policy, and Inference
Arvin Keshvari, William Tuxbury, Zin Lin · 2026
Read Adaptive Sensing beyond Non-Adaptive Information Limits: End-to-End Co-Design of Geometry, Policy, and Inference by Arvin Keshvari, William Tuxbury, Zin Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25193.txt.
Introduction
Keshvari, Tuxbury and Lin study adaptive sensing beyond non-adaptive information limits through end-to-end co-design of geometry, policy and inference. Information missed by hardware is lost downstream, yet existing approaches optimize hardware or adaptive measurement alone, rarely both. They formulate the co-design as joint dynamic programming over sensor geometry and a Bellman-optimal adaptive measurement policy. The outer hardware gradient comes from dynamic programming with a sharp Bellman maximum. Relaxations extend the framework from small discrete POMDPs to freeform light-based layouts with over 100,000 design pixels.
Catalog record
| CREATOR | Arvin Keshvari, William Tuxbury, Zin Lin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86088 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.25193
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive Sensing beyond Non-Adaptive Information Limits: End-to-End Co-Design of Geometry, Policy, and Inference Arvin Keshvari, William Tuxbury, Zin Lin Abstract Inverse design has made vast physical parameter spaces a substrate for emergent behavior. In sensing, the stakes of this principle are sharpest at the analog-to-digital boundary, where any information the hardware fails to capture is information no downstream algorithm can recover; hardware optimization alone is therefore not enough, and the geometry must be co-designed with a rule for what to measure next. We formulate this co-design as joint dynamic programming (joint-DP): a single optimization over the continuous hardware geometry and a Bellman-optimal adaptive measurement policy. The outer hardware gradient is computed by differentiable dynamic programming with a sharp Bellman maximum, which the envelope theorem makes exact and bias-free, and a relaxation hierarchy carries the common framework from small discrete POMDPs to 10 5 10^{5} -pixel photonic topologies. Across three case studies, joint-DP beats the natural baseline of its community by a large factor: on a radar beam-search POMDP, classical information-bound-guided geometry selection loses 2.8 × 2.8\times in attainable adaptive value; on a superconducting-qubit flux sensor, joint-DP reduces deployed mean-squared error by 11.3 × 11.3\times over the joint Bayesian Cramér–Rao baseline, with both geometries numerically co-optimized under their respective objectives; and on a 90,000 90{,}000 -pixel photonic metasensor, joint-DP via the Bayesian Fisher-information-matrix surrogate reduces deployed mean-squared error by 123 × 123\times relative to a randomized baseline. For any sensor whose hardware is designed once but whose policy runs for the device’s lifetime, joint optimization of hardware and policy is the minimum principled procedure. 1 Introduction Modern deep learning has revealed that emergent intelligent behavior can be extracted from optimization over vast parameter spaces: neural networks with billions of weights, trained by gradient descent against differentiable objectives, produce capabilities no hand-designed architecture reaches. A structurally analogous revolution has been unfolding in physics. Photonic crystals engineer electromagnetic band structure through lattice geometries no monatomic medium provides [ 52 ] ; metasurfaces compress wavefront-shaping into subwavelength films through the orchestration of millions of sub-wavelength scatterers [ 117 ] ; inverse-designed photonics [ 79 , 50 , 51 , 26 , 66 ] achieves mode converters, spectral filters, and freeform functional elements in footprints no hand-designed waveguide can reach; acoustic and elastic metamaterials confer effective negative moduli through sub-unit-cell resonances [ 29 ] ; topological photonics [ 83 ] and iridescent biological structures [ 113 ] exploit long-range geometric order to produce behavior no constituent chemistry can. The template is the same as deep learning’s: a vast parameter space, namely the geometry of a physical medium, optimized by gradient descent against a differentiable physical objective (scattering amplitudes, information content, coherent-addition structure) produces functional behavior no simple structure can. In this sense, structural complexity in physics is the analog of representational complexity in deep networks : both are substrates through which optimization converts raw degrees of freedom into engineered capability. The consequence is that physical hardware optimization is not a peripheral engineering concern but a fundamental question about where intelligence can live. This question sharpens dramatically in sensing and metrology, at the analog-to-digital boundary where a physical signal becomes a digital record and any information lost there bounds everything any downstream algorithm can recover. The conventional blueprint of the last two decades pairs a generic, task-agnostic transducer front-end with powerful digital reconstruction, and so treats the physical hardware as a passive conduit and asks the digital stages to rescue whatever structure the geometry happens to impose. Computational inverse design already inverts this blueprint on the hardware side, routinely saturating the electromagnetic performance bounds of the underlying scattering problem [ 73 , 98 , 79 , 51 ] , and end-to-end optical co-design extends it by tying the geometry to a downstream reconstruction network, closing the loop from physics to inference in a single gradient [ 101 , 21 , 71 , 109 , 56 , 41 , 3 , 4 , 67 , 65 ] . What remains missing is the policy dimension: the recognition that the geometry must co-design with a rule for what to measure next , i.e., a multi-step adaptive measurement policy that reacts to intermediate data. When such a policy is installed, part of the intelligence-extraction work migrates upstream into the analog domain before digitization, and the co-optimized geometry becomes a participant in the inference itself rather than a conduit to it. This paper supplies that missing dimension. A mature literature on adaptive sensing and sequential Bayesian experimental design constructs formally-optimal multi-step measurement policies for partially-observable Markov decision processes (POMDPs) [ 53 , 102 , 103 , 61 , 43 , 42 , 24 , 60 , 68 , 46 , 97 , 1 , 20 ] , but treats the physical hardware as immutable. The hardware half (inverse design, end-to-end optics) and the policy half (adaptive-sensing POMDP theory) are thus designed separately, each community optimizing its own half against the other’s default: a textbook setup for a joint optimum that nobody reaches. Several near-relatives live in the intersection without closing it: cognitive radar adapts the waveform on a fixed antenna [ 5 , 40 , 37 , 15 ] , Kitaev-style quantum phase estimation adapts the pulse sequence on a fixed circuit [ 36 , 16 , 84 , 19 , 30 , 59 , 17 ] , programmable-metasurface imaging adapts the reconstruction on a fixed scattering medium [ 118 , 48 ] , and variational quantum sensing parametrizes the probe through a trainable neural ansatz rather than a geometric topology [ 86 , 33 ] . None of these treats continuous physical geometry and a multi-step Bellman-optimal measurement policy as co-equal design variables in a single optimization. Closing this gap requires a framework that (a) is cleanly defined across discrete and continuous state spaces, (b) admits a tractable outer gradient with respect to the physical geometry, and (c) offers a hierarchy of relaxations scaling from exact dynamic programming on small POMDPs to high-dimensional continuous hardware inverse design. We supply all three, and call the procedure joint dynamic programming , or joint-DP : a single optimization that treats the continuous hardware \bm{c} and the Bellman-optimal adaptive policy \pi as co-equal decision variables, with \pi re-solved by dynamic programming at each outer iterate in \bm{c} . To our knowledge, this is the first formulation in which continuous physical hardware and a multi-step Bellman-optimal adaptive policy are co-designed as a single optimization problem. Joint-DP improves on the two natural baselines that bracket the problem, on benchmarks where exact comparison is tractable. The adaptive-sensing POMDP literature runs the Bellman dynamic-programming (DP) recursion, the standard backward-in-time value-iteration procedure that solves for an optimal measurement policy at fixed hardware. Joint-DP strictly generalizes this by co-optimizing \bm{c} under the adaptive policy, yielding a 123\times deployed-MSE improvement on the photonic metasensor of Case Study C over a randomized baseline. The OED and physics-of-bounds literatures select \bm{c} to maximize a prior-averaged, fixed-schedule information functional (mutual information, expected-Fisher log-determinant, Expected Value of Perfect Information) and attach an adaptive policy afterwards; on the radar POMDP of Case Study A the information-functional-maximizing \bm{c} loses a factor of 2.8\times in attainable adaptive value to the joint-DP optimum, and on the superconducting-qubit flux