Approximate Taylor methods for ODEs

A. Baeza, S. Boscarino, P. Mulet, G. Russo, D. Zorío · 2025

Read Approximate Taylor methods for ODEs by A. Baeza, S. Boscarino, P. Mulet, G. Russo, D. Zorío (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17478.txt.

Introduction

Antonio Baeza and co-authors present, in a 2025 paper, approximate Taylor methods for solving ordinary differential equations. Classic Taylor schemes reach very high accuracy orders but demand derivatives of the equation's functions, which is laborious. Runge-Kutta methods avoid derivatives yet make arbitrary high orders awkward to build.

The new approach mimics Taylor expansions using only the functions themselves, like Runge-Kutta, at the price of more function evaluations per order. In exchange, schemes of any order become easy to produce, and the total cost can undercut exact-derivative Taylor methods. Tests show results as good as the exact procedure with less effort.

Catalog record

CREATORA. Baeza, S. Boscarino, P. Mulet, G. Russo, D. Zorío
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-17478

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Approximate Taylor methods for ODEs A. Baeza, S. Boscarino, P. Mulet, G. Russo, D. Zorío Abstract A new method for the numerical solution of ODEs is presented. This approach is based on an approximate formulation of the Taylor methods that has a much easier implementation than the original Taylor methods, since only the functions in the ODEs, and not their derivatives, are needed, just as in classical Runge-Kutta schemes. Compared to Runge-Kutta methods, the number of function evaluations to achieve a given order is higher, however with the present procedure it is much easier to produce arbitrary high-order schemes, which may be important in some applications. In many cases the new approach leads to an asymptotically lower computational cost when compared to the Taylor expansion based on exact derivatives. The numerical results that are obtained with our proposal are satisfactory and show that this approximate approach can attain results as good as the exact Taylor procedure with less implementation and computational effort. Journal: Computers & Fluids The version of record of this article, first published in Computers & Fluids, is available online at Publisher’s website: https://doi.org/10.1016/j.compfluid.2017.10.001 1 Introduction In this paper we develop a numerical scheme consisting in an approximate formulation of Taylor methods for ODEs, akin to the scheme proposed by Zorío et. al. in [ 6 ] for hyperbolic conservation laws. Taylor methods are based on differentiating the ODEs to obtain the high-order derivatives of the solution to be used in (truncated) Taylor series expansions for the next time step of the solution. The terms in the differentiation of a composition of functions may grow exponentially as the number of terms in the Taylor series does, thus leading to expressions that are difficult to obtain and costly to evaluate. The scheme proposed in this paper is much easier to implement due to its main strong point, which is that its implementation only depends on the functions in the ODEs and not on their high-order derivatives. Moreover, this scheme can be formulated to an arbitrary high order of accuracy with relative easiness and the computational cost increases quadratically as the order increases. Compared to relatively low-order Runge-Kutta methods, the number of function evaluations to achieve a given order is higher, however with the present procedure it is much easier to produce arbitrary high-order schemes, a feature that may be crucial for certain applications that require very high orders of accuracy and possibly extended precision arithmetic (see, e.g., [ 5 , 1 ] ). This paper is organized as follows: in Section 2 we review the Taylor methods for solving ODEs; in Section 3 we present the approximate Taylor methods and analyze their accuracy and stability; in Section 4 some numerical experiments are presented in order to show the performance of these schemes; finally, in Section 5 some conclusions are drawn. 2 Taylor methods Without loss of generality, we consider initial value problems for systems of m autonomous ODEs for the unknown u=u(t) : u^{\prime}=f(u),u(0)=u_{0}, (1) for nonautonomous systems can be cast as autonomous systems by considering t as a new unknown and by correspondingly inserting a new equation t^{\prime}=1 and initial condition t(0)=0 . We aim to obtain approximations v_{h,n}\approx u(t_{n}) of the solution u of ( 1 ) on t_{n}=nh , n=0,\dots , with spacing h>0 . We use the following notation for time derivatives of u (where we omit for simplicity the dependency on h ): \displaystyle u_{n}^{(l)} \displaystyle=\frac{d^{l}u(t_{n})}{dt^{l}}. Taylor methods aim to obtain an R -th order accurate numerical scheme, i.e., a scheme with a local truncation error of order R+1 , using the Taylor expansion of the solution u from time t_{n} to the next time t_{n+1} : u_{n+1}^{(0)}=u(t_{n+1})=\sum_{l=0}^{R}\frac{h^{l}}{l!}u_{n}^{(l)}+\mathcal{O}(h^{R+1}). Approximations v_{h,n}^{(l)}\approx u_{n}^{(l)} , 0\leq l\leq R , are substituted in the Taylor series, with v_{h,n}^{(0)}=v_{h,n} , v_{h,n}^{(1)}=f(v_{h,n}^{(0)}) and v_{h,n}^{(l)} , 2\leq l\leq R , computed by successive differentiation of f(u) with respect to t . Truncation of the resulting series gives the R-th order Taylor method v_{h,n+1}=v_{h,n+1}^{(0)}=\sum_{l=0}^{R}\frac{h^{l}}{l!}v_{h,n}^{(l)}. As an example, the Taylor method for ( 1 ) in the scalar case ( m=1 ) for third order accuracy (see, for instance, [ 4 ] for more details) is computed as follows: the fact that u solves ( 1 ) implies that \displaystyle u^{\prime\prime} \displaystyle=f(u)^{\prime}=f^{\prime}(u)u^{\prime} (2) \displaystyle u^{\prime\prime\prime} \displaystyle=f(u)^{\prime\prime}=f^{\prime\prime}(u)(u^{\prime})^{2}+f^{\prime}(u)u^{\prime\prime}, which yields approximations \displaystyle u^{\prime}_{n}\approx v_{h,n}^{(1)} \displaystyle=f(v_{h,n}^{(0)}) (3) \displaystyle u^{\prime\prime}_{n}\approx v_{h,n}^{(2)} \displaystyle=f^{\prime}(v_{h,n}^{(0)})v_{h,n}^{(1)} \displaystyle u^{\prime\prime\prime}_{n}\approx v_{h,n}^{(3)} \displaystyle=f^{\prime\prime}(v_{h,n}^{(0)})(v_{h,n}^{(1)})^{2}+f^{\prime}(v_{h,n}^{(0)})v_{h,n}^{(2)}. that result in the third order Taylor method \displaystyle v_{h,n+1} \displaystyle=v_{h,n}+hv_{h,n}^{(1)}+\frac{h^{2}}{2}v_{h,n}^{(2)}+\frac{h^{3}}{6}v_{h,n}^{(3)}. (4) The following result [ 3 ] , which is a generalization of the chain rule, describes a procedure to compute high-order derivatives of compositions of functions. Theorem 1 (Faà di Bruno’s formula) . Let f:\mathbb{R}^{m}\rightarrow\mathbb{R}, u:\mathbb{R}\rightarrow\mathbb{R}^{m} r times continuously differentiable. Then \frac{d^{r}f(u(t))}{dt^{r}}=\sum_{s\in\mathcal{P}_{r}}\left(\begin{array}[]{c}r\\ s\end{array}\right)f^{(|s|)}(u(t))D^{s}u(t), (5) where \mathcal{P}_{r}=\{s\in\mathbb{N}^{r}/\sum_{j=1}^{r}js_{j}=r\} , |s|=\sum_{j=1}^{r}s_{j} , \displaystyle\left(\begin{array}[]{c}r\\ s\end{array}\right)=\frac{r!}{s_{1}!\cdots s_{r}!} , D^{s}u(t) is an m\times|s| matrix whose ( \sum\limits_{l<j}s_{l}+i )-th column is given by \displaystyle(D^{s}u(t))_{\sum\limits_{l<j}s_{l}+i}=\frac{1}{j!}\frac{\partial^{j}u(x)}{\partial t^{j}},\\ \quad i=1,\dots,s_{j},\quad j=1,\dots,r, (6) and the action of the k -th derivative tensor of f on a m\times k matrix A is given by f^{(k)}(u)A=\sum_{i_{1},\dots,i_{k}=1}^{m}\frac{\partial^{k}f}{\partial u_{i_{1}}\dots\partial u_{i_{k}}}(u)A_{i_{1},1}\dots A_{i_{k},k}. (7) 2.1 Computational cost Faà di Bruno’s formula can be used to obtain efficient implementations of Taylor methods if the derivatives f^{(k)}(u) are available. These are typically obtained by symbolic calculations. Specifically, the implementation of a Taylor method of order R requires f_{i}^{(r)}(u) , i=1,\dots,m , for r=1,\dots,R-1 . It is not easy to give a simple expression for the number of terms in ( 5 ), but since s_{r}=(r,0,\dots,0)\in\mathcal{P}_{r} , the terms f_{i}^{(r)}(v_{h,n})\overbrace{\begin{bmatrix}v_{h,n}^{(1)}&\dots&v_{h,n}^{(1)}\end{bmatrix}}^{r},\quad i=1,\dots,m (8) corresponding to f_{i}^{(|s_{r}|)}(u(t))D^{s_{r}}u(t)=f_{i}^{(r)}(u(t))[\overbrace{u^{\prime}(t)\dots u^{\prime}(t)}^{r}] have to be computed. Assuming that no derivative of f_{i} vanishes and taking into account that the number of distinct r -th order derivatives is \binom{m+r-1}{r} , an efficient computation of ( 7 ), ( 8 ) would require about (r-1)m^{r} products to account for A_{i_{1},1}\dots A_{i_{r},r} , m^{r} sums and \binom{m+r-1}{r} computations of r -th order derivatives, r\geq 0 , and corresponding products. Assuming a uniform computational cost for these r -th order derivatives of c_{r} operations, a fairly conservative lower bound for the computational cost for obtaining v_{h,n}^{(r)} , r=2,\dots,R is \displaystyle m\sum_{r=1}^{R-1}\left((r-1)m^{r}+m^{r}+\binom{m+r-1}{r}(c_{r}+1)\right) \displaystyle=m\sum_{r=1}^{R-1}\left(rm^{r}+\binom{m+r-1}{r}(c_{r}+1)\right). The computation of the first order term f_{i} is c_{0} and the computation of the Taylor polynomial of order R for each component is 2R , so the overall cost can be bounded from below by \displaystyle C_{T}(R,m) \displaystyle=m\sum_{r=0}^{R-1}\left(rm^{r}+\binom{m+r-1}{r}(c_{r}+1)\right). (9) For m=1 , \displaystyle C_{T}(R,1) \displaystyle\approx R^{2}+\sum_{r=0}^{R-1}c_{r}. (10) For m>1 \displaystyle C_{T}(R,m) \displaystyle\geq\widetilde{C}_{T}(R,m)=(R-1)m^{R}+m\sum_{r=0}^{R-1}\binom{m+r-1}{r}(c_{r}+1). (11) 3 Approximate Taylor methods We now present an alternative to the Taylor methods described in Section 2 , which is much less expensive for large m,R and agnostic about the equation, in the sense that its only requirement is the knowledge of the function f defining the ODE. As proven below in Theorem 2 , this technique is based on the fact that the replacement of exact expressions of high-order derivatives of the function f that appear in Taylor methods, e.g., those in ( 2 ) for the third-order Taylor method, by approximations v_{h,n}^{(l)}\approx u_{n}^{(l)} , l=1,\dots,R , such that \displaystyle v_{h,n}^{(1)}=f(v_{h,n}^{(0)}),\quad v_{h,n}^{(l)}=u_{n}^{(l)}+\mathcal{O}(h^{R+1-l}),l=2,\dots,R, (12) when v_{h,n}^{(0)}=u(t_{n}) , yields an R-th order accurate scheme. In this work we compute the required approximations by simply using finite differences of sufficient order. Notice that the exact

Read the complete text