Local Inverse Geometry Can Be Amortized
Aaditya L. Kachhadiya · 2026
Read Local Inverse Geometry Can Be Amortized by Aaditya L. Kachhadiya (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13068.txt.
Introduction
Kachhadiya alone tackles a bind in nonlinear inverse problems: first-order steps are cheap yet brittle, while curvature-aware routes like Gauss-Newton cost more. He trains a two-way stand-in, Deceptron, that can run forward and backward. As solver D-IPG, it drags error-corrected measurement-space proposals back into latent space. A Jacobian Composition Penalty shapes the reverse Jacobian into a local left inverse of the forward one. On seven PDE problems, D-IPG tops standard baselines while solving at up to 77 times lower cost.
Catalog record
| CREATOR | Aaditya L. Kachhadiya |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67021 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13068
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Local Inverse Geometry Can Be Amortized Aaditya L. Kachhadiya Abstract Nonlinear inverse problems often trade inexpensive but fragile first-order updates against curvature-aware methods such as Gauss–Newton and Levenberg–Marquardt, which obtain stronger directions by repeatedly solving Jacobian-based linearized systems. We propose a learned alternative: amortize local inverse geometry into a reusable reverse operator. Our framework learns a bidirectional surrogate, Deceptron, and deploys it through D-IPG (Deceptron Inverse-Preconditioned Gradient), an iterative solver that pulls residual-corrected measurement-space proposals back to latent space. The key mechanism is a Jacobian Composition Penalty (JCP), which trains the reverse Jacobian to act as a local left inverse of the forward Jacobian; its runtime counterpart, RJCP, measures the same inverse-consistency error along optimization trajectories. We prove that D-IPG is first-order equivalent to damped Gauss–Newton under local pseudoinverse consistency, with deviation controlled by composition error and conditioning. Across seven PDE inverse-problem benchmarks, D-IPG outperforms standard baselines, achieves 94.8 % 94.8\% mean success across the six-problem reliability suite, and reaches comparable or better recovery quality at up to 77 × 77\times lower inference-time solve cost on the main benchmarks. 1 Introduction Nonlinear inverse problems require updates that are simultaneously informative, stable, and computationally tractable. Existing optimizers divide sharply along these axes: first-order methods are inexpensive but can be slow or unreliable when the forward Jacobian is ill-conditioned, whereas curvature-aware methods such as Gauss–Newton and Levenberg–Marquardt provide stronger local directions by repeatedly solving linearized inverse problems [ 8 , 11 , 13 ] . The resulting bottleneck is therefore not only forward evaluation, but repeated reconstruction of local inverse geometry during optimization. This paper asks whether that local inverse geometry can instead be amortized: learned once and reused across inverse solves. The goal is not to replace the forward model by a one-shot inverse predictor, but to learn a reverse operator whose differential action converts measurement residuals into informative latent-space corrections. Concretely, we introduce a learned bidirectional module, Deceptron , consisting of a differentiable forward surrogate and a reverse map trained to provide local inverse-oriented differential structure. At inference time, Deceptron induces D-IPG (Deceptron Inverse-Preconditioned Gradient), an iterative solver that forms residual-corrected proposals in measurement space and maps them back to latent space through the learned reverse model. The central technical requirement is therefore differential rather than functional. For D-IPG to behave like a useful inverse solver, the learned reverse Jacobian must approximate the local inverse action of the forward Jacobian on the directions that matter for nonlinear least squares. We promote this structure through a Jacobian Composition Penalty (JCP), together with a corresponding runtime diagnostic, RJCP, that respectively shape and measure local inverse consistency of the learned reverse Jacobian. Section 4 shows that, under local pseudoinverse consistency, the induced D-IPG proposal is first-order equivalent to damped Gauss–Newton, and that its deviation from the damped Gauss–Newton direction is controlled by composition error and local conditioning. We evaluate the proposed framework on PDE inverse problems spanning 1-, 2-, and 3-dimensional heat-equation initial-condition recovery, together with harder 2-dimensional systems including Darcy flow, advection–diffusion, Allen–Cahn, and Navier–Stokes inversion. Across these settings, D-IPG consistently outperforms standard first-order baselines, remains competitive with strong second-order methods, and often attains similar recovery quality at substantially lower runtime. More broadly, the paper advances a simple viewpoint: local inverse geometry, traditionally reconstructed repeatedly through classical second-order machinery, can be amortized into a learned reverse operator and reused inside a safeguarded iterative solver. 2 Related Work Our work is most closely related to classical nonlinear least-squares methods, especially Gauss–Newton, Levenberg–Marquardt, and quasi-Newton procedures, which exploit local curvature information through Jacobian- or Hessian-based linear solves [ 8 , 11 , 13 ] . These methods remain strong baselines for inverse problems, but their cost is dominated by repeated reconstruction of local inverse structure at each iterate. Our objective is not to discard this geometry, but to amortize part of its local inverse action into a reusable learned operator. The paper is also related to learned inverse solvers, amortized inference, and unrolled optimization methods, which use learned mappings or fixed-horizon iterative architectures to accelerate inverse recovery [ 6 , 2 , 12 , 1 ] . Our setting differs in two respects. First, the learned reverse map is not itself the full solver: it supplies local inverse-oriented update information to a separate inference-time optimizer equipped with explicit descent safeguards. Second, our target is not direct functional inversion but usable local inverse action for iterative nonlinear least squares. More broadly, operator-learning approaches such as DeepONets and Fourier neural operators learn solution or inverse maps between function spaces [ 10 , 9 ] , while learned preconditioners aim to accelerate iterative linear solves. Our setting differs from both strands. We do not learn a direct solution operator from observation to latent state, nor a preconditioner for a fixed linear system; instead, we learn a reverse differential operator queried along the trajectory of a nonlinear least-squares solver. Finally, our use of Jacobian composition differs from standard reconstruction or cycle-consistency losses: JCP is introduced not as a representation regularizer, but as an optimization-theoretic constraint that promotes local inverse action of the learned reverse Jacobian and thereby supports a Gauss–Newton-like update mechanism. 3 Method We consider inverse recovery under a differentiable surrogate forward map f_{W}:\mathbb{R}^{d_{\mathrm{in}}}\to\mathbb{R}^{d_{\mathrm{out}}}, where x\in\mathbb{R}^{d_{\mathrm{in}}} denotes the latent variable and y^{\star}\in\mathbb{R}^{d_{\mathrm{out}}} the observed measurement. At inference time, all learned model parameters are fixed, and optimization is performed only over x . We work with the surrogate nonlinear least-squares objective \Phi(x):=\frac{1}{2}\|f_{W}(x)-y^{\star}\|_{2}^{2},\qquad r(x):=f_{W}(x)-y^{\star}, (1) with Jacobian J_{f}(x):=\nabla_{x}f_{W}(x) . The central objective is to replace repeated Jacobian-based local inverse reconstruction by a learned reverse operator that can be reused across iterations. Throughout, all norms are Euclidean for vectors and induced spectral norms for matrices unless stated otherwise. Algorithm 1 D-IPG inference-time update 1: Observation y^{\star} , learned module (f_{W},g_{V}) , initial state x_{0} , feasible set \mathcal{C} , relaxation \rho\in(0,1] , initial step size \alpha_{0}>0 , Armijo constant c\in(0,1) , backtracking factor \beta\in(0,1) , maximum iterations T 2: for t=0,1,\dots,T-1 do 3: y_{t}\leftarrow f_{W}(x_{t}) , r_{t}\leftarrow y_{t}-y^{\star} 4: if stopping criterion satisfied then 5: break 6: end if 7: \alpha\leftarrow\alpha_{0} 8: repeat 9: y^{\mathrm{prop}}\leftarrow y_{t}-\alpha r_{t} 10: x^{\mathrm{prop}}\leftarrow g_{V}(y^{\mathrm{prop}}) 11: \widetilde{x}\leftarrow\Pi_{\mathcal{C}}\!\big((1-\rho)x_{t}+\rho x^{\mathrm{prop}}\big) 12: p_{t}\leftarrow\widetilde{x}-x_{t} 13: if \Phi(\widetilde{x})\leq\Phi(x_{t})+c\,\nabla\Phi(x_{t})^{\top}p_{t} then 14: x_{t+1}\leftarrow\widetilde{x} 15: accept and continue 16: else 17: \alpha\leftarrow\beta\alpha 18: end if 19: until step accepted or backtracking budget exhausted 20: if no step accepted then 21: break 22: end if 23: end for 24: return x_{t} 3.1 D-IPG and learned reverse maps Our framework separates the learned object from the inference-time solver built on top of it. Deceptron denotes the learned bidirectional pair (f_{W},g_{V}) , where f_{W} is the forward surrogate and g_{V}:\mathbb{R}^{d_{\mathrm{out}}}\to\mathbb{R}^{d_{\mathrm{in}}} is a learned reverse map. D-IPG , short for Deceptron Inverse-Preconditioned Gradient, is the iterative optimizer induced by this module. The reverse map is not intended to be a globally exact inverse of f_{W} ; rather, it is trained to provide local inverse-oriented update information relative to the geometry induced by f_{W} . Thus the learned module carries amortized local inverse structure, while the solver remains an explicit optimization procedure with standard acceptance safeguards. At iteration t , let y_{t}=f_{W}(x_{t}),\qquad r_{t}=y_{t}-y^{\star}. (2) D-IPG first forms a residual-corrected proposal in measurement space, y^{\mathrm{prop}}_{t+1}=y_{t}-\alpha_{t}r_{t}, (3) then maps this