Numerical Methods for Chaotic ODE
Robert M. Corless · 2025
Read Numerical Methods for Chaotic ODE by Robert M. Corless (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06123.txt.
Introduction
Robert M Corless asks why computer simulations of chaotic systems can be trusted at all. Chaotic systems amplify tiny errors, so a computed path soon strays from the true one. His 2025 paper reviews backward error analysis, which asks a different question: what nearby problem did the computer solve exactly?
Three tools are compared: checking leftovers from the equations, studying modified equations, and shadowing, where a true path stays near the computed one. Each helps explain why simulations still capture true behavior. Numerical methods can also fake chaos or hide it, and the paper weighs those risks. One puzzle stays open: why the long-run statistics of computed orbits so often come out right.
Catalog record
| CREATOR | Robert M. Corless |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-06123
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Numerical Methods for Chaotic ODE Robert M. Corless Abstract This paper explores backward error analysis for numerical solutions of ordinary differential equations, particularly focusing on chaotic systems. Three approaches are examined: residual assessment, the method of modified equations, and shadowing. We investigate how these methods explain the success of numerical simulations in capturing the behavior of chaotic systems, even when facing issues like spurious chaos introduced by numerical methods or suppression of chaos by numerical methods. Finally, we point out an open problem, namely to explain why the statistics of long orbits are usually correct, even though we do not have a theoretical guarantee why this should be so. 1 Introduction Ordinary numerical methods work well for chaotic differential equations, even when they are not guaranteed by standard theory to do so, if some simple precautions are taken. The simplest precaution to take is to use a variable-stepsize method and solve the problem more than once, with different error tolerances. One will usually see—even if the computed trajectories are different from each other—that some statistics of the solution, for instance the dimension of the attracting set or the measures on the attracting set, are robust. It’s actually as simple as that. To explain why this is so, however, is not so simple. Indeed, parts of the explanation are not yet known. Before we begin, I give some definitions. The definition I give here of a “chaotic system” is nonstandard, but I claim it is equivalent to the standard one. Definition 1 : Let f:\mathbb{R}^{n}\to\mathbb{R}^{n} be smooth, let {\varepsilon}_{1}>0 , {\varepsilon}_{2}>0 , and v_{k}:\mathbb{R}\to\mathbb{R}^{n} for k=1 , 2 , be bounded for t>0 ; say \|v_{k}(t)\|_{\infty}\leq 1 . A dynamical system \dot{y}=f(y) (1) is chaotic if its solutions are bounded and if typical solutions of the persistently disturbed dynamical systems \displaystyle\dot{y}_{1} \displaystyle=f(y_{1})+{\varepsilon}_{1}v_{1}(t) (2) \displaystyle\dot{y}_{2} \displaystyle=f(y_{2})+{\varepsilon}_{2}v_{2}(t) (3) with y_{1}(0)=y_{2}(0) separate by O(1) after time T proportional to \ln(1/{\varepsilon}) where {\varepsilon} is the maximum of {\varepsilon}_{1} and {\varepsilon}_{2} . That is, y_{1}(0)=y_{2}(0) but already by t=T , a short time later by virtue of the logarithmic dependence on {\varepsilon} , y_{1}(t)-y_{2}(t)=O(1) . This definition sidesteps the usual difficulty with understanding how errors can grow exponentially while the solutions stay bounded; here we say that the solutions depart from one another after only a short time. The reason this agrees with the usual definition is that if the system has a positive largest Lyapunov exponent, say \lambda>0 , then the difference y_{1}(t)-y_{2}(t) will grow like \exp(\lambda t) . But by the standard Gröbner–Alexeev nonlinear variation of constants formula [ 20 ] , there exists a function G such that y_{1}(t)-y_{2}(t)={\varepsilon}\int_{0}^{t}G(t,\tau)(v_{1}(\tau)-v_{2}(\tau))\,d\tau\>. (4) This is O({\varepsilon}) near the beginning because v_{1} and v_{2} are O(1) ; but once t=T=\log(1/{\varepsilon})/\lambda this will no longer be O({\varepsilon}) but rather O(1) . One normally sees systems defined as being chaotic if the solutions with two different initial conditions depart from each other in this manner; but this is equivalent because in essence G=\partial{y}/\partial{y_{0}} , the derivative of the solution with respect to the initial condition. We do it this way because the notion of persistent disturbance maps very nicely onto what numerical solutions do. 1.1 An example: the Lorenz system I have claimed that numerical solution of chaotic dynamical systems is simple, if simple precautions are taken. To demonstrate that this is so, we give a short script in Julia, which we take almost straight from the tutorial at the Getting Started Page . In it, we solve the Lorenz equations [ 30 ] . We should first ascertain that the Lorenz system is chaotic for the parameter values we’ll use, but this is well-known. Indeed, we can see the largest Lyapunov exponent being computed at the Lyapunov exponent example on the Chebfun website and with T=25 and {\varepsilon}=10^{-9} so \ln(1/{\varepsilon})\approx 20.7 (more about that in a moment) the result is \lambda\approx 0.905>0 . Notice that that website uses exactly the definition I described above. It’s written down in a few places (for example in the Proceedings of the Organic Mathematics Workshop from 1995, but sadly that’s hard to find nowadays) but mostly people just use it because it’s obviously equivalent to the standard definition. Coming back to the example, I used the default method of the code described in [ 28 ] , but changed the tolerances. using DifferentialEquations using Plots function parameterized_lorenz!(du, u, p, t) x, y, z = u σ, ρ, β = p du[1] = dx = σ * (y - x) du[2] = dy = x * (ρ - z) - y du[3] = dz = x * y - β * z end u0 = [1.0, 0.0, 0.0] tspan = (0.0, 5.0e1) p = [10.0, 28.0, 8 / 3] prob = ODEProblem(parameterized_lorenz!, u0, tspan, p) sol = solve(prob, Tsit5(), reltol = 1e-8, abstol = 1e-8) plot(sol, idxs = (1, 2, 3)) savefig("LorenzTsit588.png") The plot appears in figure 1 . It looks little different than any other plot of the solution to the Lorenz system computed by any other standard method. There’s a reason for that, and it is not because all the computed solutions agree with each other. In fact they don’t all agree with each other, in detail, because the Lorenz system is chaotic for these parameter values, as I said and as we all know. In spite of that, the picture is familiar. To confirm that, you can run Julia yourself, and change the method or the tolerances to anything you like, and you will see that the picture basically does not change. But I will now demonstrate that the numerical values of the solution do indeed differ. Issuing the command ⬇ sol (50.0) asks Julia to give you the values of x , y , and z at t=50 , and we get ⬇ 3- element Vector { Float64 }: 2.0436117819130932 3.7394392065867637 9.953318846465097 . Doing the computation over again with the tolerances set instead to 10^{-9} gives instead when I asked for the new solution values ⬇ 3- element Vector { Float64 }: -3.413851213342435 -5.377552911950605 17.822220963462385 and we see not a single decimal digit agrees in any of the components with what was computed before. Indeed, you might get different results than the above if you run them on a different machine than the one I have run these on (a Microsoft Surface Pro) because even rounding errors can affect the results of a chaotic problem. So why do the plots look the same? Figure 1: The computed solution to the Lorenz system on the interval 0\leq t\leq 50 with parameters \sigma=10 , \rho=28 , and \beta=8/3 , as computed by the Julia solver “Tsit5” with tolerances 10^{-8} . With tolerances 10^{-9} the figure looks no different, to the casual eye. 2 The answer is so simple it seems like cheating The reason is that both times the code gave us the exact solution, not to \dot{Y}=F(Y) where F stands for the three-dimensional Lorenz system and Y=(x,y,z) is the vector of unknown functions, but rather \dot{Y}=F(Y)+{\varepsilon}v(t) , where v(t) is a vector O(1) in size and {\varepsilon} is a “small” scalar. That is, the numerical solution is the exact solution to a persistently disturbed Lorenz system! That is the main