Operator Learning Using Weak Supervision from Walk-on-Spheres

Hrishikesh Viswanath, Hong Chul Nam, Xi Deng, Julius Berner, Anima Anandkumar, Aniket Bera · 2026

Read Operator Learning Using Weak Supervision from Walk-on-Spheres by Hrishikesh Viswanath, Hong Chul Nam, Xi Deng, Julius Berner, Anima Anandkumar, Aniket Bera (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01193.txt.

Introduction

Viswanath and five colleagues train neural PDE solvers without costly data sets or unstable higher-slope losses, using Walk-on-Spheres Monte Carlo guesses as weak coaching. Their WoS-NO scheme spreads walk costs across PDE cases, fitting a neural operator against cheap noisy answer guesses in a data-free physics goal. It carries over zero-shot to new settings and domains. It cuts error nearly nine times, speeds training over sixfold, and uses about a third of the GPU memory of standard physics training.

Catalog record

CREATORHrishikesh Viswanath, Hong Chul Nam, Xi Deng, Julius Berner, Anima Anandkumar, Aniket Bera
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64210
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.01193

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Operator Learning Using Weak Supervision from Walk-on-Spheres Hrishikesh Viswanath, Hong Chul Nam, Xi Deng, Julius Berner, Anima Anandkumar, Aniket Bera Abstract Training neural PDE solvers is often bottlenecked by expensive data generation or unstable physics-informed neural network (PINN) involving challenging optimization landscapes due to higher-order derivatives. To tackle this issue, we propose an alternative approach using Monte Carlo approaches to estimate the solution to the PDE as a stochastic process for weak supervision during training. Leveraging the Walk-on-Spheres method, we introduce a learning scheme called Walk-on-Spheres Neural Operator (WoS-NO) which uses weak supervision from WoS to train any given neural operator. We propose to amortize the cost of Monte Carlo walks across the distribution of PDE instances using stochastic representations from the WoS algorithm to generate cheap, noisy, estimates of the PDE solution during training. This is formulated into a data-free physics-informed objective where a neural operator is trained to regress against these weak supervisions, allowing the operator to learn a generalized solution map for an entire family of PDEs. This strategy does not require expensive pre-computed datasets, avoids computing higher-order derivatives for loss functions that are memory-intensive and unstable, and demonstrates zero-shot generalization to novel PDE parameters and domains. Experiments show that for the same number of training steps, our method exhibits up to 8.75 × \times improvement in L 2 L_{2} -error compared to standard physics-informed training schemes, up to 6.31 × \times improvement in training speed, and reductions of up to 2.97 × \times in GPU memory consumption. We present the code at https://github.com/neuraloperator/WoS-NO † † affiliationnotice: Equal contribution 1 Introduction MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error MSE 1.0\times 2.42\times 1.64\times 3.80\times MSE 1.0\times 1.49\times 1.43\times 3.26\times MSE 1.0\times 2.382\times 1.71\times 4.14\times Geo. Boundary Cond. WoS DeepRitz PINO WoS-NO (Ours) Relative Error Figure 1 : Given arbitrary, unseen input geometry and boundary conditions,

Read the complete text