M 3 : Reframing Training Measures for Discretized Physical Simulations

Yuan Mei, Xingyu Song, Xiaowen Song, Naoya Takeishi, [0.5em] The University of Tokyo · 2026

Read M 3 : Reframing Training Measures for Discretized Physical Simulations by Yuan Mei, Xingyu Song, Xiaowen Song, Naoya Takeishi, [0.5em] The University of Tokyo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08843.txt.

Introduction

Yuan Mei, Xingyu Song, Xiaowen Song, and Naoya Takeishi fix a hidden bias in training neural surrogates for physical simulations: the training points themselves are unevenly spread. Simulations are sampled on grids that cluster points in some regions, so the model over learns crowded areas and under learns sparse ones, warping physical fidelity. Their M-cubed framework rebalances supervision by partitioning space according to physical variation and spreading training weight across scales.

On three industrial scale datasets, predictions in the continuous domain improve markedly, with errors several times lower in large volumetric cases. Gains survive aggressive subsampling, with models trained on far fewer points beating rivals trained on denser data. Operator learning learns that where points sit matters as much as how many there are.

Catalog record

CREATORYuan Mei, Xingyu Song, Xiaowen Song, Naoya Takeishi, [0.5em] The University of Tokyo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08843

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

M 3 : Reframing Training Measures for Discretized Physical Simulations Yuan Mei, Xingyu Song, Xiaowen Song, Naoya Takeishi, [0.5em] The University of Tokyo Abstract Neural surrogate models for physical simulations are trained on discretized samples of continuous domains, where the induced empirical measure leads to uneven supervision, biasing optimization and causing spatial inconsistencies in physical fidelity. To mitigate this measure-induced bias, we propose M 3 (Multi-scale Morton Measure), a scalable framework that balances training measures by partitioning space according to physical variation and allocating supervision across multiple scales. Applied to three industrial-scale datasets with diverse discretizations, M 3 consistently improves predictions in the continuous physical domain, achieving up to 4.7 × \times lower error in large-scale volumetric cases. These gains persist under aggressive subsampling (160M → \rightarrow 16M → \rightarrow 1.6M points), where M 3 -trained models outperform those trained on higher-resolution data, reducing physics-weighted relative L 2 L_{2} error by 3–4 × \times and the corresponding MSE by up to 13 × \times . These results highlight data distribution as a key factor in operator learning and position M 3 as a scalable, data-efficient approach for physically consistent modeling. 1 Introduction Modern neural surrogate models have become an effective tool for approximating complex physical systems [ 16 , 13 ] . By learning mappings over continuous spatial domains, they enable fast predictions at arbitrary resolutions and query locations [ 1 , 2 ] . In practice, however, training relies on finite samples obtained from discretized simulation outputs, and thus the effective training distribution is implicitly defined by the discretization scheme employed in the simulation. It induces an empirical measure over the domain that inherits the discretization’s non-uniform spatial structure. As a result, even full-resolution pointwise training is inherently biased. Finely discretized regions receive disproportionately more optimization updates, while sparse regions contribute weaker training signals, leading to spatially non-uniform approximation errors across the domain. This issue is particularly pronounced in high-fidelity industrial datasets that contain 10^{6} – 10^{8} mesh elements per case [ 3 , 4 , 19 ] , where full-data training becomes impractical. Merely subsampling such training data inevitably inherits and amplifies the imbalance due to the non-uniform coverage in physical space. It may become a dominant source of error, and increasing model capacity may be insufficient to compensate for the systematically deficient or underrepresented physical signals. Evaluation can also create a misleading illusion when metrics are computed with uniform pointwise weighting. Due to the discretization bias, large errors in sparsely sampled regions can be overwhelmed by the accumulation of many small errors in dense regions. As a result, performance tends to be dominated by overrepresented areas, yielding overly optimistic estimates that may not reflect the model’s true behavior over the domain. Such metrics therefore provide an unreliable basis for comparison, making it difficult to draw clear conclusions about relative model performance. These observations motivate viewing subsampling not only as data compression, but also as a problem of physically meaningful empirical measure design. The key question is how to construct a training measure that reasonably captures cross-scale physical variation rather than discretization artifacts. Under a fixed budget, both the distribution support (which locations are supervised) and the allocation of supervision mass (how often they enter the loss) are critical. To address this, we propose M 3 ( Multi-scale Morton Measure ), a lightweight pipeline that constructs structured training distributions for large-scale point clouds. It builds a variation-aware spatial partition via Morton ordering, assigns cells to scale-aware strata, and permits flexible allocation of budget over the resulting support. This yields balanced spatial coverage across scales in the physical domain. Based on this formulation, our contributions are summarized as follows: • We identify that discretization-induced data structures systematically alter the effective training objective in operator learning, leading to biased optimization and unreliable performance assessment under standard pointwise metrics. • We propose M 3 , a scalable framework for large-scale simulation subsampling that constructs multi-scale empirical measures aligned with underlying physical structure, enabling data-efficient training under limited computational budgets and improving generalization across benchmarks. • We show that, in operator learning, increasing raw simulation data alone does not necessarily improve performance under spatially non-uniform discretizations. In contrast, models trained with physically structured measures achieve stronger performance with less data. 2 Related Work Neural PDE Surrogates and Architectures. Neural PDE surrogates model physical systems via operator learning, with representative approaches including FNOs [ 16 ] and DeepONets [ 18 ] , alongside mesh- and graph-based simulators [ 24 , 25 , 7 ] and attention-based architectures over mesh tokens [ 15 , 10 , 31 , 1 ] . Recent scalable variants further extend this paradigm through latent or compressed interfaces, including slice- or low-rank token exchange (e.g., Transolver [ 31 ] ), anchor-based representations (e.g., AB-UPT [ 1 , 2 ] ), and latent aggregation before readout (e.g., GAOT [ 29 ] ), improving computational efficiency and information exchange at scale. These approaches operate on sampled points over discretized domains and optimize for accuracy and scalability, but they do not control which locations contribute to the training loss or how frequently. Sampling and Subset Training. Industrial datasets often reach terabytes and contain 10^{6} – 10^{8} mesh points per case [ 3 , 4 , 19 ] , making full-resolution training impractical. As a result, most pipelines rely on subsampled vertices or token batches [ 31 , 10 , 2 , 33 ] . They commonly adopt a two-stage pipeline: raw data are downsampled to a manageable scale (e.g., 10\% ) offline, and training tokens are generated via a second-stage subsampling process. Each update corresponds to a Monte Carlo estimate under the induced sampling distribution, yielding a sampling-dependent supervision pattern over the discretized domain. Prior work improves performance by modifying the sampling strategy over discretization-induced candidate sets. Representative approaches include adaptive residual- or error-driven point selection for PINNs [ 30 , 28 ] , non-uniform minibatch construction methods such as DPP-based sampling [ 5 , 32 ] , and stratified or side-information-guided schemes [ 17 , 9 ] . Classical adaptive mesh refinement (AMR) [ 6 ] adjusts spatial resolution based on solution features, but operates on mesh discretization rather than stochastic minibatch optimization. Data-efficient Learning under Fixed Support. Beyond batch-level sampling, a range of statistical techniques, including importance weighting [ 12 , 27 ] , coresets [ 21 , 26 ] , and active learning [ 14 ] , improve data efficiency by reweighting samples or selecting informative subsets from an existing dataset. These methods approximate the full-data objective using a reduced or rebalanced set of samples. Consequently, their improvements are confined to observed data and do not extend to sparsely sampled or unseen regions under a fixed budget. Table 1: Comparison of data selection families. Methods are compared along key design axes: spatial control (explicit control over spatial coverage), hierarchical structure (explicit multi-level organization), multi-scale allocation (simultaneous allocation across scales), and scalability to full mesh size N . ✓/✓✓: supported, with ✓✓indicating a core design; \times / \times\times : not supported, with \times\times indicating impractical at scale. Family Spatial control Hierarchical Multi-scale allocation Scalable to large N Random sampling \times \times \times ✓✓ Importance sampling \checkmark \times \times ✓ Stratified

Read the complete text