PDE-SHARP: PDE S olver H ybrids through A nalysis and R efinement P asses

Shaghayegh Fazliani, Madeleine Udell · 2025

Read PDE-SHARP: PDE S olver H ybrids through A nalysis and R efinement P asses by Shaghayegh Fazliani, Madeleine Udell (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00183.txt.

Introduction

Shaghayegh Fazliani and Madeleine Udell aim to cut the cost of using language models to write solvers for partial differential equations, the equations that describe heat, flow, and waves. Standard setups test many solver drafts, and each test can be costly to run. Their framework, PDE-SHARP, swaps some of that heavy computing for cheaper model reasoning.

Three stages do the work: study the equation, draft a solver from that study, then refine drafts in judged rounds. PDE-SHARP needed fewer than thirteen checks on average, against more than thirty for rival methods. Accuracy rose about fourfold across the tested equations, for both general and reasoning-focused models.

Catalog record

CREATORShaghayegh Fazliani, Madeleine Udell
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE120 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00183

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PDE-SHARP: PDE S olver H ybrids through A nalysis and R efinement P asses Shaghayegh Fazliani, Madeleine Udell Abstract Current LLM-driven approaches using test-time computing to generate PDE solvers execute a large number of solver samples to identify high-accuracy solvers. These paradigms are especially costly for complex PDEs requiring substantial computational resources for numerical evaluation. We introduce PDE-SHARP, a framework to reduce computational costs by replacing expensive scientific computation by cheaper LLM inference that achieves superior solver accuracy with 60-75% fewer computational evaluations. PDE-SHARP employs three stages: (1) Analysis : mathematical chain-of-thought analysis including PDE classification, solution type detection, and stability analysis; (2) Genesis : solver generation based on mathematical insights from the previous stage; and (3) Synthesis : collaborative selection-hybridization tournaments in which LLM judges iteratively refine implementations through flexible performance feedback. To generate high-quality solvers, PDE-SHARP requires fewer than 13 solver evaluations on average compared to 30+ for baseline methods, improving accuracy uniformly across tested PDEs by 4 × 4\times on average, and demonstrates robust performance across LLM architectures, from general-purpose to specialized reasoning models. 1 Introduction Partial Differential Equations (PDEs) are fundamental to scientific modeling across physics, engineering, and computational sciences, yet writing robust numerical solvers requires specialized numerical analysis expertise for PDE-specific implementation and tuning, with limited flexibility as each solver targets specific PDE types. The success of deep learning has motivated the development of neural PDE solvers, with Physics-Informed Neural Networks (PINNs) ( Raissi et al. 2019 ; Karniadakis et al. 2021 ) and operator learning methods ( Li et al. 2020 ) emerging as promising alternatives that leverage neural networks to approximate PDE solutions. However, these approaches require extensive training data, lack interpretability, suffer from generalization limits across PDE families, and offer limited accuracy ( Rahaman et al. 2019 ; Wang et al. 2022 ) The result is an ecosystem of specialized PDE solvers that address particular failure modes without a systematic understanding of underlying limitations ( Cuomo et al. 2022 ; Krishnapriyan et al. 2021 ; Zhang et al. 2021 ; Wang et al. 2021a ) . Meanwhile, large language models (LLMs) have demonstrated remarkable aptitude for complex mathematical and scientific challenges ( Romera-Paredes et al. 2024 ; Tian et al. 2024 ) . Sophisticated code generation frameworks employ Chain-of-Thought (CoT) reasoning ( Welleck et al. 2024 ; Wei et al. 2023 ; Kojima et al. 2023 ) , Mixture-of-Agents (MoA) strategies ( Sharma 2024 ; Wang et al. 2024a ) , and advanced inference-time scaling techniques ( Snell et al. 2024 ) to achieve state-of-the-art performance across programming tasks. LLM-as-a-judge frameworks ( Jiang et al. 2025a ; Zheng et al. 2023 ) typically employ predetermined evaluation rubrics. However, PDE solver evaluation presents unique challenges requiring assessment of mathematical correctness, numerical stability, computational efficiency, and domain-specific accuracy, factors that demand context-dependent evaluation criteria rather than static rubrics, as optimal trade-offs and performance standards vary significantly across PDE families and application domains. The task of creating reliable solver codes for PDEs sits at the intersection of applied mathematics, numerical analysis, and code generation, making it an ideal testbed to evaluate LLMs’ mathematical and technical capabilities. Current approaches fall into two general categories. 1) Fine-tuning methods specialize models for mathematical reasoning ( Lu et al. 2024 ) and subsequent domain-specific adaptation to particular PDE families ( Soroco et al. 2025 ) . These require substantial computational resources for multi-stage training and offer limited generalizability across PDE types. 2) Inference-only frameworks using general-purpose LLMs and techniques such as automated debugging ( Chen et al. 2023 ) , self-refinement ( Madaan et al. 2023 ) , and test-time scaling ( Snell et al. 2024 ) . CodePDE ( Li et al. 2025 ) avoids fine-tuning but relies on brute-force sampling strategies, generating and executing 30+ solver candidates to identify optimal solutions. This paradigm becomes especially costly for complex PDEs requiring high-performance computing resources for numerical evaluation. To address these limitations, we introduce PDE-SHARP , an LLM-driven PDE solver generation framework that achieves superior accuracy with 60-75% fewer computational evaluations — through intelligent generation rather than exhaustive sampling — in three stages: (1) Analysis analyzes the PDE through structured questions to develop a numerically-stable solver plan; (2) Genesis generates solver candidates without immediate execution; (3) Synthesis uses LLM judges to iteratively select, execute, and refine solvers based on provided performance feedback in each round. With this approach, PDE-SHARP swaps inexpensive LLM inference for expensive scientific computation, only executing refined solvers each round. This exchange is worthwhile for computationally intensive PDEs for which GPU/HPC resources dominate costs. Figure 1: PDE-SHARP framework overview. The three core stages are Analysis, Genesis, and Synthesis. Optional components (Translator, Reporter) enhance usability as explained in section 3 . PDE-SHARP generates higher accuracy solvers with 60-75% fewer solver evaluations compared to tested baselines. Contributions. The experimental results highlight PDE-SHARP’s key contributions: • Computational Efficiency. PDE-SHARP reduces expensive solver evaluations by 60-75% (requiring fewer than 13 solver evaluations on average compared to 30+ in best-of- n baselines) while achieving superior solution accuracy, demonstrating considerable resource savings for complex simulations. • Mathematical Analysis. PDE-specific mathematical chain-of-thought reasoning with targeted stability analysis produces mathematically-informed solver strategies, leading to higher initial code quality compared to generic template-based generation. • Collaborative LLM Tournaments. PDE-SHARP’s synthesis phase improves on standard test-time computing approaches by 4 \times on average using fewer evaluations. • Enhanced Implementation Quality. Experiments indicate PDE-SHARP solvers achieve bug-free execution in 63-67% fewer debugging iterations (0.33 vs. 0.9-1.4 iterations per solver) and enjoy superior numerical convergence properties. • Robustness to LLM Choice. PDE-SHARP achieves more consistent performance across diverse LLM types (general-purpose, coding-specific, reasoning models) compared to the baselines, showing robustness to the underlying code generator LLM choice. • Flexible Feedback Integration. PDE-SHARP can improve solvers using several feedback mechanisms — solution-based metrics (relative error), physics-based metrics (PDE residual), and no feedback — to adapt to research scenarios from benchmark validation with known solutions to real-world cases with limited simulation data or physics-only assessments. 2 Background & Related Work Classical Solvers & Neural Methods. Traditional numerical methods for PDE solving, e.g. finite difference, finite element, and spectral methods, require considerable domain expertise for effective implementation ( Strang 2007 ; LeVeque 2007 ) . Modern scientific computing frameworks such as FEniCS ( Alnaes et al. 2015 ) , deal.II ( Arndt et al. 2021 ) for finite element, and PETSc ( Balay et al. 2025 ) have facilitated access to these methods for broad PDE classes. However, 1) considerable numerical analysis knowledge is still required for optimal performance; and 2) general approaches fail at exploiting PDE-specific mathematical structure to achieve superior performance. The key challenge is thus identifying which approach suits a particular PDE without extensive domain expertise. The success of deep learning has motivated extensive research into neural PDE solvers. PINNs variants ( Raissi et al. 2019 ; Wang et al. 2022 ) approximate PDE solutions through residual minimization. Physics-informed operator learning methods ( Li et al. 2020 ; Lu et al. 2021 ) learn solution operators rather than individual solutions, offering improved generalization. Feature engineering techniques such as random Fourier features ( Wang et al. 2021b ; Fazliani et al. 2025 ) , residual-based attention ( Anagnostopoulos et

Read the complete text