An Entropy Dynamics Approach to Inferring Fractal-Order Complexity in the Electromagnetics of Solids Authors: Basanta R. Pahari, William Oates Published: 2024 ABSTRACT A fractal-order entropy dynamics model is developed to create a modified form of Maxwell’s time-dependent electromagnetic equations. The approach uses an information-theoretic method by combining Shannon’s entropy with fractional moment constraints in time and space. Optimization of the cost function leads to a time-dependent Bayesian posterior density that is used to homogenize the electromagnetic fields. Self-consistency between maximizing entropy, inference of Bayesian posterior densities, and a fractal-order version of Maxwell’s equations are developed. We first give a set of relationships for fractal derivative definitions and their relationship to divergence, curl, and Laplacian operators. The fractal-order entropy dynamic framework is then introduced to infer the Bayesian posterior and its application to modeling homogenized electromagnetic fields in solids. The results provide a methodology to help understand complexity from limited electromagnetic data using maximum entropy by formulating a fractal form of Maxwell’s electromagnetic equations. 1. Introduction Entropy dynamics has been used previously to formulate continuum and quantum scale balance equations [1,2]. It is a generalized Bayesian framework that can be used for updating priors given new information cast in the form of constraints to high-fidelity computations or experimental data. While the method is general, Boltzmann and Gaussian distributions are typically considered, which can be obtained by maximizing Shannon’s entropy together with a first-order and second-order moment constraint, respectively [3]. Here, we introduce fractional moments in space and time which allows for a continuum of constraints between the first and second order based on the fractional power-law order ranging from one to two. Other constraints associated with singularities and power-laws are also introduced and related to source terms in Maxwell’s electromagnetic equations. Importantly, relationships are developed that connect the non-integer moments with fractal-order operators based on data contained in the constraints. The results provide a more general representation of electromagnetic field behavior in complex media that cannot be easily approximated using integer-order operators and Gaussian probabilities. In recent years, fractal and fractional-order operators have garnered significant interest from different scientific communities. Various works on fractional calculus [4,5] and fractal diffusion in materials [6,7] have contributed to a better understanding of how fractal and fractional-order operators offer novel insights into complex material behavior [8,9,10,11,12,13,14,15]. One application of the fractional operator is a novel derivation of fractional-order conservation of mass [16]. In this derivation, the authors demonstrate that when a power-law function can approximate mass flux through porous media, the continuity equation becomes exact if the fractional derivative’s order matches the flux’s power-law and the operating point is about zero mass density. This approach contrasts with the traditional method of deriving conservation of mass, which employs a first-order integer Taylor series to represent flux changes in a control volume. The key reason for using fractional-order operators is that integer Taylor expansions require infinite terms to approximate fractional power-law functions. In contrast, the fractional Taylor series requires only the first-order term. Other studies have used Caputo and other fractional derivatives to couple and analyze nonlinear systems, such as the Jaulent–Miodek equations with an energy-dependent Schrödinger potential, through numerical and semi-analytic methods like the Adomian decomposition technique [17,18]. These approaches effectively tackle complex fractional differential equations, offering valuable insights into nonlinearity and intricate system dynamics, similar to the treatment of Maxwell’s equations presented in this work. Fractional and fractal-order operators are also effective at characterizing the viscoelastic behavior of polymers under different strain rate loading [19,20]. The fractal structure of the polymer network can influence the hyperelastic and viscoelastic constitutive behavior of polymers, and this effect can be better understood using fractional operators [21,22]. In certain instances, the fractal and fractional-order derivatives are equivalent despite the former being a local operator, while fractional-order derivatives are nonlocal [20]. The characteristic scales in space or time will also influence whether fractal or fractional-order operators better approximate state changes [4]. The choice of the appropriate local or nonlocal operator can be related to the form of the probability density. Fractal-order operators are well suited for stretched exponential probability densities, while the fractional Caputo operator is well suited to predict power-law probability densities. It has been argued that the Mittag-Leffler function unifies these different scales such that fractional operators can simulate a broad range of behaviors [23]. Here, we focus on fractal operators due to their local properties, which have many computational advantages in simulating materials as a homogenized continuum. Although fractional calculus has been considered for developing the general electromagnetic field equations [24], less work has focused on using information theory and Bayesian inference as a tool to quantify non-integer derivative orders as a method to formulate continuum-scale electromagnetic models of materials. Mandelbrot [25] defined fractal geometry as complex, self-similar structures that exhibit intricate patterns at every scale. Unlike traditional geometric shapes, fractals often have non-integer (fractional) dimensions that are characterized by recursive patterns, making them useful for modeling many natural phenomena, including complex materials exposed to electromagnetic fields. Given the pervasive nature of fractals in material structures, researchers have investigated how their heterogeneous characteristics affect electromagnetic fields [26,27,28,29]. Balakin et al. [27] analyzed and applied fractal vector calculus to Maxwell’s electromagnetic equations. Starzewski [29] extended this work to include the effect of anisotropic fractals on electromagnetic fields in complex materials. In the latter, product measures are used to accommodate fractal anisotropy and variational methods are employed to obtain the field equations. From a practical perspective, the fractal design of antennas and metamaterials has been considered to enhance multiband properties, compactness, high directivity, and a stronger understanding of scattering effects due to multiscale surface roughness [30,31]. The importance of stochastic analysis relative to deterministic electromagnetic models has been pointed out in the literature. The papers by Naus [32] and Baker-Jarvis and Surek [33] discuss the application of statistical inference and maximum entropy in understanding electromagnetic fields in the presence of uncertainty. Naus focuses on Gaussian processes and the central limit theorem to evaluate typical polarization and magnetization effects on a continuum scale. Baker-Jarvis and Surek’s approach starts with the assumption of Louisville’s equation as the time-dependent governing equation and applying a projection operator [33]. However, their work focuses on the application of integer-order calculus operators. They also use theoretical constraints in the maximum entropy method, as opposed to experimental observational constraints. In our approach, we do not make distinctions between theory or experimental observations. Either may be integrated into the proposed modeling framework. Furthermore, we generalize the constraints to accommodate extreme events (in terms of fractal-based power-laws) and show how these extreme events map to fractal operators upon statistical homogenization. The four fundamental equations governing electromagnetic fields in Maxwell’s equations are extraordinarily accurate in material systems where the charge density and current density are well understood [34,35,36]. The distribution of charges and their dynamical properties are typically inferred experimentally or computed for specific thermodynamic states and then homogenized using a variety of approximation procedures [32,33,37,38]. The inference process requires constitutive relationships governing the charge density in Gauss’ law and the current density in Ampere’s law for each particular material. In the case of an ideally amorphous solid or idealized crystalline material, Gaussian statistics prevail, and integer Taylor expansions provide excellent approximations of the charge and current density; see Nelson [37] for details. This is because of the quadratic function within the exponential of the Gaussian distribution, which is correlated with linear constitutive models. In complex materials containing heterogeneities such as point defects, line dislocations, domain walls, and/or grain boundaries, Gaussian probability distributions are less accurate due to the thicker tail nature of the defect distributions. This is further complicated when an electromagnetic solid’s representative volume element (RVE) is reduced to a point. It raises concerns about applying Gaussian statistics and integer-order operators in the equations governing the electromagnetic fields. We propose that fractal operators provide better approximations of electromagnetic fields in materials containing certain non-Gaussian distributions of defects within a representative volume element. Whereas material structure does not completely define material properties, there are well-known relationships between structure and properties. These relationships include anisotropy associated with crystal structure and texture in polycrystalline materials [39]. Less work, however, has focused on understanding the structure-property relationships for fractal structure and non-Gaussian distributions in electromagnetic solids. Falconer showed that integer diffusion in 2D can be achieved by homogenizing specific observations of the scalar field u(x,t) across the spatial domain x at a given time t=t0+Δt [40]. More precisely, if we consider u(X,t0), written as a function of the undeformed Lagrangian frame X [41], homogenized over a Gaussian density as (1)u(x,t)=14Dπt∫Ω0e−x−X·x−X4Dtu(X,t0)dX and by taking a first-order derivative with respect to t and the second-order derivative with respect to x on u(x,t), it is well known that we obtain the integer diffusion equation (2)∂u∂t=D∇2u. where D is the diffusion coefficient and ∇2=∂∂x·∂∂x is the Laplacian operator. The inference of continuum-scale material properties from Gaussian density homogenization can lead to uncertainties associated with the application of integer-order operators based on the above relations (also see pp. 270–273 [40]). In cases of rare events such as the onset of dislocations, microcracking, or nucleation of a phase transition, non-Gaussian densities of continuum-scale representative volume elements can provide insight into constructing more accurate space–time operators governing complex and nonlinear material behavior. Given these complexities in solid materials, we explore the application of an information-theoretic model to infer Bayesian posteriors that guide the formulation of continuum-scale versions of Maxwell’s equations using constraints from observations. In principle, these observations may be in the form of experimental measurements or high-fidelity atomistic or quantum simulations. Importantly, we show how fractional moments in space and time lead to thicker tail probabilities. We then show how fractal operators are self-consistent with the homogenization of local fields over these thicker tail probabilities at the continuum scale. In the limiting case of Gaussian posteriors, the classical integer derivative forms of Maxwell’s equations are consistent with the homogenized equations. The fractal form of Maxwell’s equations studied here is derived using information theory by maximizing Shannon entropy under a set of fractional moment constraints in space and time. Unlike prior work that integrates over the space of all possible material configurations, integrals over both space and time extend the ability to model diffusion to also include wave propagation. Here, the resulting time-dependent Bayesian posteriors obtained from maximum entropy provide a means to quantify how continuum-scale electromagnetic fields vary in space and time using fractal derivative operators. Previously, we have used this approach to characterize fractal-order constitutive behavior in polymers, such as viscoelasticity, excluded volume effects [19,20] and to estimate molecular dynamics diffusion behavior as a continuum [42], but this method has not been considered for electromagnetic field behavior in solids. This requires extensions to fractal Laplacian and curl operators and fractal wave propagation relations. The remainder of the paper is outlined as follows. In Section 2, we discuss Hausdorff measures, integration on non-integer-dimensional spaces, fractal derivatives, and the properties of this derivative that are essential for us to establish the combined fractal Maxwell’s equations and entropy dynamics framework. This is followed by the fractal form of Maxwell’s equations in Section 3. In Section 4, we describe how entropy dynamics can be used to infer the fractal form of Maxwell’s equations from sparse data. This section also includes homogenization of the electromagnetic fields using the entropy dynamic inferred Bayesian posterior densities. A simple example illustrating when fractal operators are important is given in Section 4.2, where the fractal conservation of charge is compared to the fractal form of Maxwell’s equations. We also include a discussion of units in Section 4.3, which are known to complicate physical interpretations of fractal operators. Discussion and concluding remarks are given in Section 5, where we summarize the key findings and the practical implications of the methodology on materials science, nanotechnology, and electromagnetic field modeling in heterogeneous media. 2. Fractal Measures and Operators 2.1. Hausdorff Measure and Integration on Non-Integer Dimensions Due to the complex nature of fractal or fractional spaces, it is important to define a suitable measure for such spaces. The Hausdorff measure extends the concept of Lebesgue-type measure, and it generalizes notions such as length, area, and volume to encompass more irregular sets that may lack a well-defined dimension, such as fractals [43]. With appropriate measures established, one can then develop other mathematical tools for fractional spaces. Stillinger derived integration rules for certain classes of functions on non-integer dimensional spaces using Hausdorff measures while also introducing the generalized Laplacian operator [44]. We build upon this analysis for applications in electromagnetic field problems. Consider a measure space (X,M,μ,d), consisting of a set X, a collection of Borel subsets M, and a metric d [45]. The measure μ is taken to be the Hausdorff measure (μH). For a given set E, this measure is defined by (3)μH(E)=limδ→0inf∑i=1∞(diam(Ui))d:E⊂⋃i=1∞Ui,diam(Ui)<δ where d is a non-negative real number and diam(Ui) denotes the diameter of the set Ui that forms an open cover of E. The Hausdorff dimension, which usually coincides with the fractal dimension, is then given by (4)dimH(E)=infd:μH(E)=0=supd:μH(E)=∞.The fractal integral measure dμH(x) is related to integer Lebesgue measure dμ(x) in the following way (5)dμH(x)=2πα/2Γα2xα−1dμ(x). For integer dimH, Lebesgue and Hausdorff measures are equivalent [40]. Now suppose X⊂Rn is closed, unbounded, and regular such that dimH is the same or unique overall X with respect to the measure given in (3). Then for a symmetric function f we have (6)∫f(r)dμH=σ(D)∫f(r)rD−1dr. where (7)σ(D)=2πD2Γ(D2). It is also shown by Palmer and Stavrinon [45] that for a spherically symmetric function f:Rn→R, (8)∫f(r)dμ1(x1)dμ2(x2)···dμn−1(xn−1)dμn(xn)=σ(D)∫f(r)rD−1dr where r2=∑ixi2 and D=∑iαi2. 2.2. Fractal Derivatives This section defines fractal derivatives, divergence, curl, and Laplacian operators and proves some of their basic properties that we apply to electromagnetics. The fractal derivative of order β>0 of a function f is (9)ddxβf(x)=limx0→xf(x0)−f(x)x0β−xβ. This derivative differs from the traditional integer derivative in the sense that the spatial parameter is scaled to the power of β. Such scaling is useful in modeling phenomena that exhibit a power-law relationship, as seen in materials following a fractal pattern. This is why it is referred to as the “fractal derivative”. The fractal derivative and the traditional integer derivative share the following relationship (10)ddxβf(x)=1β|x|β−1df(x)dx. The relationship above simplifies the implementation of this fractal derivative and demonstrates its nature as a local operator. Because of its local nature, fractal derivatives lead to numerically faster and more stable algorithms than other nonlocal fractional-order operators, such as the Caputo derivative. Figure 1 shows how the fractal derivatives of sin(x) and e−x2 change with changing fractal derivative order. One of the fundamental properties of derivatives is their linearity, which also holds true for fractal derivatives. The fractal gradient of a function of three variables f(x1,x2,x3) is defined as (11)∇βf=∂f∂x1βi+∂f∂x2βj+∂f∂x3βk=1β|x1|β−1∂f∂x1i+1β|x2|β−1∂f∂x2j+1β|x3|β−1∂f∂x3k. Divergence and curl operators play essential roles in fractal calculus. The fractal divergence and curl of a vector function F are (12)∇β·F=∂F1∂x1β+∂F2∂x2β+∂F3∂x3β and, ∇β×F=ijk∂∂x1β∂∂x2β∂∂x3βF1F2F3=∂F3∂x2β−∂F2∂x3βi+∂F1∂x3β−∂F3∂x1βj+∂F2∂x1β−∂F1∂x2βk. Since the fractal derivative is a linear operator, it can be shown that both fractal divergence and curl exhibit linearity, akin to integer calculus. We will use this linear property to derive the fractal Maxwell’s equations in Section 3. Moreover, the fractal curl of the fractal gradient is also zero, i.e., ∇β×∇βf=0. In addition, the fractal divergence of the fractal curl is also 0. In other words, ∇β·∇β×F=0. The last fractal operator we define in this section is the fractal Laplacian. The fractal Laplacian is (13)∇β2f=∂∂x1β∂f∂x1β+∂∂x2β∂f∂x2β+∂∂x3β∂f∂x3β. Analogous to its integer counterpart, the fractal divergence of a fractal gradient corresponds to the fractal Laplacian. This operator may also be written as ∇β·∇βf=∇β2f. The Taylor series expansion is widely studied and applied in engineering to approximate various quantities of interest in fields ranging from thermodynamics control systems and signal processing. The fractal analog to the integer Taylor series is (14)f(x)=∑k=0∞1k!ddxβkf(x=x0)(xβ−x0β)kThe two-term fractal Taylor series of a power-law function is exact [19]; in contrast, it takes the integer Taylor expansion an infinite number of terms to perfectly approximate a fractional power-law function. It is possible to extend Falconer’s approach in Equation (1) to model fractal diffusion processes by homogenizing the stretched exponential distribution. The time-dependent fractal diffusion equation can be derived from the following statistical homogenization relationship for N-dimensional stretched Gaussian probability densities (15)u(x,t)=AtNα∫Ω0e−xβ−Xβ·xβ−Xβ4Dtαu(X,t0)dX where Ω0 is the region of integration, A=14πDN, α is the fractal time order parameter and β is the spatial fractal-order parameter. Here both x and X are vectors of dimension N and xβ=(|x1|β,|x2|β,…,|xN|β) (similar for X). In fact, Equation (15) solves the following N dimensional fractal time diffusion (16)∂u∂tα=D∇β2u. Lastly, to derive the fractal Poisson equation resulting from Maxwell’s equations in Section 3, we consider a slightly different distance metric. The integer Poisson equation ∇2ϕ=−4πρ holds when ϕ(x)=∫ρ(y)rdy, where r=||x−y||. In the fractal domain, this radial metric needs to follow a power law, and thus, for s≥0, we let f=1rswherers=|x1|s+|x2|s+|x3|s.The fractal gradient of f is (17)∇βf=−s2βrs3rs−β, where rs−β=|x1|s−βi+|x2|s−βj+|x3|s−βk. The fractal Laplacian of f is (18)∇β2f=−s2β2s−β|x1|s−2β+|x2|s−2β+|x3|s−2βrs3−3s|x1|2s−β+|x2|2s−β+|x3|2s−β2rs5 Please note that if β=s2, then ∇β2f=0 except at the origin, and this property is essential to establishing the fractal Poisson equation. 3. Maxwell’s Equations The classical electromagnetic theory deals with electric and magnetic fields and their interactions through four fundamental partial differential equations known as Maxwell’s equations [46]. It is important to note that Maxwell’s equations do not uniquely determine electromagnetic fields, and other constitutive relations are needed to define the interaction within a material [47]. In this section, we present the fractal form of Maxwell’s equations. We then show how these equations can be inferred from maximizing entropy under certain fractional moment constraints in subsequent sections. Consider the following modifications of Maxwell’s equations using fractal operators (19)∇β·E=ρϵ0 (20)∇β×E=−∂B∂tα (21)∇β·B=0 (22)1μ0∇β×B=J+ϵ0∂E∂tα where E is the electric field, B is the magnetic flux, J is the current density, ρ is the charge density, ϵ0 is the vacuum permittivity, and μ0 is the vacuum permeability. Here, Equation (19) represents Gauss’s law for electric fields, Equation (20) represents Faraday’s law of electromagnetic induction, Equation (21) represents Gauss’s law of magnetism, and Equation (22) represents the differential form of Ampere’s law. We obtain this fractal form of Maxwell’s equations, in terms of a scalar electrostatic potential ϕ and a magnetic vector potential A by introducing (23)E=−∇βϕ−∂A∂tαB=∇β×A. Then Equation (20) is satisfied since (24)∇β×E=∇β×−∇βϕ−∂A∂tα=−∇β×∇βϕ−∇β×∂A∂tα=∂∂tα∇β×A=−∂B∂tα. The divergent free B field in Equation (21) holds because (25)∇β·B=∇β·∇β×A=0. By considering the relationship between space and time in Equation (15), and dependent upon the form of the probability densities, it becomes possible to use entropy dynamics (see Section 4) as a means to validate the remaining two equations in Maxwell’s theory. We first note that (26)∇β·E=∇β·−∇βϕ−∂A∂tα=−∇β2ϕ−∇β·∂A∂tα. Thus, to satisfy Equation (19) we must have (27)−ϵ0∇β2ϕ−ϵ0∇β·∂A∂tα=ρ. Let us assume the Coulomb gauge A=A′−∇βΞ and ϕ=ϕ′+∂Ξ∂tα such that A is fractal divergence free, i.e., ∇β·A=0. Then (28)∇β2Ξ=∇β·∇βΞ=∇β·A′−A=∇β·A′−∇β·A=∇β·A′. Now for the case when ∇β·A=0, Equation (27) reduces to (29)∇β2ϕ=−ρϵ0. This fractal form of Gauss’s law in Equation (29) is obtained using the potential ϕ(x) given by (30)ϕ(x)=14πϵ0∫ρ(x)||x−y||dy. For η>0, let rη=|x1|s+|x2|s+|x3|s+ηs, fη=1rη, and β=s2. As in the integer case, the function ϕ(x) has the form (31)ϕ(x)=∫ρ(y)rηdyH, where integration is conducted on the fractal domain. It can be shown that the fractal Laplacian of fη is (32)∇β2fη=−3ηsηs+|x1|s+|x2|s+|x3|s5/2. Using the fractal measure in Equation (5), we obtain (33)∫∫∫∇β2fηdVH=A∫∫∫∇β2fηx1α1−1x2α2−1x3α3−1dV, where A=8πα12+α22+α32Γα12Γα22Γα32. Since β=s2 and η→0, from Equation (18), ∇β2fη=0, except at the origin. Let ψ be a test function and S2 be the unit sphere, then (34)A∫∫∫∇β2fηx1α1−1x2α2−1x3α3−1dV=−limη→0∫∫∫S23Aηsx1α1−1x2α2−1x3α3−1ηs+|x1|s+|x2|s+|x3|s5/2ψ(x)dV One can then establish the Poisson equation by expanding ψ(x) around the origin and integrating. Integrating the above equation is difficult, and an explicit form in terms of elementary functions may not exist. Thus, one may have to resort to numerical integration to obtain an exact solution. Figure 2 is a plot of the numerically obtained integral in Equation (34) demonstrating its convergence as η→0. When s=2, β=1 and α1=α2=α3=1, the integer Poisson equation is retrieved and Equation (34) yields −4π as expected. Using the relationships in Equation (23) and letting μ0ϵ0=c−2 (c is the speed of light), we obtain the last of Maxwell’s equations, previously given by Equation (22), in the form (35)−∇β2A+1c2∂∂tα∇βϕ+1c2∂∂tα∂A∂tα=μ0J. We now split J into fractal divergence and curl-free components. Let J=JT+JL, where JT is transversal and JL solenoidal parts of J such that ∇β·JT=0 and ∇β×JL=0. Assuming the Coulomb gauge condition, Equation (35) can be split into two equations (36)1c2∂∂tα∂A∂tα=∇β2A+μ0JT Since Equation (36) consists of a fractal wave equation, we present a solution to this fractal wave equation to facilitate comparisons to the maximum entropy method given in Section 4. We then let (38)q(x,t)=Ceik·x−wt where x=(x1,x2,x3), w=|k|v and C is a normalization constant. It is well known that q is a solution of the integer wave equation 1v2∂2q∂t2=∇2q.To extend the solution of the integer wave equation to obtain the solution of the fractal wave equation, consider (39)u(x,t)=Ceik·xβ−wtα where, as before, x=(x1,x2,x3), w=|k|v, and for β>0, xβ is defined component-wise as xβ=(|x1|β,|x2|β,|x3|β). Then it follows that (40)∂∂tα∂u∂tα=−C|k|2v2eik·xβ−wtα and, for j=1,2,3 (41)∂∂xjβ∂u∂xjβ−Ckj2eik·xβ−wtα. Thus, the fractal Laplacian of u is (42)∇β2u=∑j=13∂∂xjβ∂u∂xjβ=−∑j=13Ckj2eik·xβ−wtα=−Ceik·xβ−wtα∑j=13kj2=−C|k|2eik·xβ−wtα. Comparing Equations (40) and (42), we arrive at the fractal wave equation (43)1v2∂∂tα∂u∂tα=∇β2u. In general, for one-dimensional scalar functions f(x) and g(t) such that (44)u(x,t)=Ceikf−ωg we obtain the one-dimensional fractal integer wave equation with source S (45)∂2u∂t2=D∂2u∂x2+S where the source function is (46)S=Ckvezvd2dx2f+kdfdx2−d2gdt2+kvdgdt2 and z=kf(x)−ωg(t). Note, if f(x)=x, g(t)=t then S=0. Now for the fractal wave equation given in Equation (43), the source S is (47)S=Ckvezvβ2x2β−11−β∂f∂x+x∂2f∂x2+kx∂f∂x2−1α2t2α−11−α∂g∂t+t∂2g∂t2+ktv∂g∂t2 and when f(x)=xβ, g(t)=tα, ω=kv and D=v2 we have S=0. This relation is generalized in Section 4.1 for three-dimensional problems. In the next section, we will arrive at the same wave equations using a completely different approach based on entropy maximization. The goal is to derive a probability density function that can be applied to stochastic homogenization of the electrostatic scalar potential (ϕ) and magnetic vector potential (A) from Maxwell’s equations for non-Gaussian stochastic processes. 4. Entropy Dynamics Approach Modeling real-world problems is inherently challenging, with one of the most common obstacles being the presence of incomplete data sets or limited knowledge. Furthermore, experimental data frequently include noise, posing difficulties in obtaining precise measurements, especially when dealing with multiscale phenomena. These factors drive the investigation of the maximum entropy method, which aims to answer the question: given a partial state of knowledge, how can we construct the least biased model? E.T. Jaynes, a pioneering figure in the maximum entropy approach, dedicated much of his research to developing statistical inference methods and establishing constructive criteria for deriving probability distributions based on partial knowledge [48]. This method enables one to derive the most unbiased estimate possible from a given data set by constructing the most general model available. By identifying the most unbiased posterior densities, we can apply them to the electromagnetic theory of the previous section to construct models from available data and appropriate constraints. The maximum entropy approach typically begins by defining a cost function that incorporates entropy and constraints derived from available data or observations. Normally, homogenization is conducted over all the possible states the systems may exhibit at any time instant. Here, we include the time dimension in the homogenization. This allows one to derive posteriors that may include conservative dynamics, i.e., wave equations, in addition to diffusive characteristics that do not conserve energy. This results in an entropy relation that is similar to action potentials that are used in Lagrangian electromagnetics and mechanics formulations [37]. The differences in conserved versus non-conserved energy relations will depend on the forms of the constraints that are reflected in the Lagrange multipliers and experimental observations. We start with the following expression for entropy (48)S=−∫p(x|X)lnp(x|X)q(x|X)dxdt where p(x|X) is a time-dependent conditional probability density of a particle originally located at X that has moved to x=x(X,t) at time t. A prior density is also included, q(x|X), which is assumed to be flat or uninformative. We maximize the entropy S with the following constraints (49)∫p(x|X)dxdt=1and∫p(x|X)fI(x,t)dxdt=σI where the first constraint ensures unity of the probability for all time t and fI(x,t) includes three additional constraints that are associated with the respective moments σI for I=1,2,3 that will be described later in this section. These moments must be determined from experimental observations or higher fidelity simulations. Using the Lagrange multiplier method, the associated cost function is (50)H=S−κ∫p(x|X)dxdt−1−λI∫p(x|X)fI(x,t)dxdt−σI. We find the extremum of H with respect to the probability density p(x|X). To do so, we take functional derivatives of H with respect to p(x|X) and set it to zero according to (51)δHδp=lnpq+1+κ+∑I=13λIfI(x,t)=0. Simplifying the above equation gives us (52)p(x|X)=q(x|X)e−1−κ−∑I=13λIfI(x,t). Since (53)∫pdxdt=∫qe−1−κ−∑I=13λIfI(x,t)dxdt=qe−1−κ∫e−∑I=13λIfI(x,t)dxdt we let Z=e1+κq be partition function. Then (54)p(x|X)=1Ze−∑I=13λIfI(x,t). This probability density function is the result of incorporating constraints in the form of functions fI. The crucial task lies in determining the appropriate constraints, which should be based on observations or relevant properties of the system and the quantities of interest. We propose two spatially dependent constraints and one time-dependent constraint that are used for comparisons to observable electromagnetic experimental data or high-fidelity simulations. The three constraints include f1=k·xβ, f2=ωtα, and f3=c3ln(∥x∥) with α,β>0. Then (55)p=1Ze−λ1k·xβ−λ2ωtα−λ3c3ln(∥x∥)=1Z∥x∥λ3c3e−λ1k·xβ−λ2ωtα. To integrate the posterior p, we use spherical coordinates and assume spherically symmetric behavior. Specifically, we express the vector x as x=(rsinθcosϕ,rsinθsinϕ,rcosθ).This gives ∥x∥=r, and the volume element becomes dx=r2sinθdrdθdϕ. Assuming spherical symmetry, we can write k·xβ=∥k∥rβ. Then (56)∫0∞∫R3pdxdt=∫0∞∫R31Z∥x∥λ3c3e−λ1k·xβ−λ2ωtαdxdt=∫0∞∫02π∫0π∫0∞1Zrλ3c3e−λ1∥k∥rβ−λ2ωtαr2sinθdrdθdϕdt=4π∫0∞∫0∞1Zrλ3c3e−λ1∥k∥rβ−λ2ωtαr2drdt=4πZλ1∥k∥λ3c3−3βλ2ω−1/ααβΓ1αΓ3−λ3c3β Note we used ∫0∞e−atbdt=a−1bbΓ1b. Since ∫pdxdt=1 we get (57)Z=4πλ1∥k∥λ3c3−3βλ2ω−1/ααβΓ1αΓ3−λ3c3β Using the constraint ∫p(x|X)f2dxdt=ω∫p(x|X)tαdxdt=σ2 and the fact that (58)∫0∞tγe−λ2ωtαdt=(λ2·ω)−γ+1ααΓγ+1α we get (59)σ2=∫p(x|X)ωtαdxdt=1Z∫R31rλ3c3e−λ1∥k∥rβr2dr∫0∞ωtαexp−λ2ωtαdt=1αλ2. Thus (60)λ2=1ασ2. Similarly, from constraint ∫p(x|X)f1dxdt=∫p(x|X)k·xβdxdt=σ1, we get (61)∫0∞∫R3p(x|X)k·xβdxdt=1Z∫0∞∫R31∥x∥λ3c3e−λ1k·xβ−λ2ωtαk·xβdxdt=4πZ∫0∞∫0∞1rλ3c3(k·xβ)exp−λ1∥k∥rβ−λ2ωtαr2drdt=4πZ∫0∞k·xβrλ3c3exp−λ1∥k∥rβr2dr∫0∞exp−λ2ωtαdt=1λ13−λ3c3β. Thus (62)λ1=zσ1. where z=3−λ3c3β. Using the third constraint f3=c3ln(∥x∥), we apply (63)∫0∞∫R3p(x|X)f3(x)dxdt=σ3.The last Lagrange multiplier λ3 can be solved based upon (64)∫0∞ln(r)r2−λ3c3e−λ1∥k∥rβdr=λx∥k∥−zβψ(z)−ln∥k∥λ1 where ψ(z) is the Digamma function, and z=3−λ3c3β. The final posterior p(x|X) is (65)p(x|X)=1Z∥x∥λ3c3exp−zσ1k·xβ−ωασ2tα. We note that when the singularity constraint ln(∥x∥) is removed (i.e., when λ3=0), the function p satisfies the 3D fractal wave equation given in Equation (43), where (66)D=ωβσ13∥k∥ασ22. A plot of the one-dimensional version of the final posterior p, without the singularity constraint, which solves the fractal diffusion equation in 1D, is shown in Figure 3. In the plot, the fractal derivative order parameters α and β were chosen to illustrate how the probability density changes when varying the spatial moment σ1, which can be extracted from available data. As expected, the probability density for data with higher moments tends to be much broader than for data that is more concentrated. The relationship on the time-dependent Bayesian posterior can be more broadly applied to any scalar, vector, or tensor field using stochastic homogenization as previously done in Equation (1). In the following subsection, we apply Equation (65) to homogenize the scalar electrostatic ϕ and magnetic vector potentials A and relate the maximum entropy constraints to physical relations in the fractal form of Maxwell’s equations. 4.1. Homogenized Electromagnetic Potentials Here, we illustrate how homogenized electromagnetic fields provide a method to construct a fractal version of Maxwell’s equations using various forms of the posterior given by Equation (65). The fractional-order constraints introduced in the previous section guide the fractal-order space–time operators and source terms based on available data. Upon presenting the self-consistent relationships, we highlight how maximum entropy methods may be used in practice to identify different forms of electromagnetic equations given sparse amounts of data. We start with the homogenization of the electrostatic potential ϕ and magnetic vector potential A over the posterior density according to (67)ϕ(x,t)=∫Ω0p(x|X)ϕ(X,t0)dX. and (68)A(x,t)=∫Ω0p(x|X)A(X,t0)dX. The simplest case considers wave dynamics of A in Equation (68) for the limiting situation where the natural logarithm constraint (f3) is neglected. In this case, λ3=c3=0 such that there are no singularities in the posterior given by Equation (65). In this case, it is easily shown that the fractal wave equation is self-consistent with the homogenized magnetic vector potential in Equation (68) and given by (69)∂∂tα∂A∂tα=D∇β2A which is equivalent to the free space form of Equation (36) when D=ωβσ13∥k∥ασ22=c2 and JT=0. Extending the wave equation for A to include the source term based on a non-zero transverse current density (JT≠0) may occur dependent upon errors in matching the fractal derivative order exactly with the posterior density or the additional presence of the singularity in Equation (65). Below, we show the form of a source term that would be an additional term in Equation (69) when the fractal operator orders, α and β, do not match the power-law relations in the posterior density. Adding the singularity in the maximum entropy formulation, i.e., λ3≠0 and c3≠0, results in a highly complex source and is left for future numerical analysis. Generally speaking, the procedure to identify the non-zero source requires applying the same fractal time and space derivatives to Equation (68) and identifying the additional source term(s) that balance the wave equation. To illustrate the relationship between the wave equation for A and the homogenization from the posterior density, the source for the non-singular constraint is given as follows. For a probability distribution that does not contain the singularity, the posterior has the form p=Ce−f(x)−ωg(t), which satisfies the wave equation with D from Equation (66) along with the following source. Again, this form is based on the assumption that the fractal-order operators do not exactly match the power-law characteristics in the posterior. We also note that this scalar term given as follows is contained within the integral Equation (68) and would be multiplied by the magnetic vector A and integrated to explicitly relate it to JT. This requires numerical analysis, as discussed previously, concerning numerically integrating Equation (34). In such cases, the scalar source term has the form (70)S(x,t)=−ωt1−2αZα2α−1∂g∂t−t∂2g∂t2+ωt∂g∂t2+ω2σ12L1+1−βL2−L39Z∥k∥α2σ22x12βx22βx32βCe−f−ωg where (71)L1=∑k=13xk2∂2f∂xk2∏j≠kxj2β,L2=∑k=13xk∂f∂xk∏j≠kxj2β, andL3=∑k=13xk2∂f∂xk2∏j≠kxj2β.As expected, this source vanishes when the observations follow a power law with the form f=k·xβ and g(t)=tα. The more general form containing the singularity is more complex and will most likely require additional numerical analysis. We now derive the case for Gauss’s law Equation (29), which contains no explicit time-dependence. In this case, the second constraint is neglected where λ2=0. Physically, this can be interpreted by σ2, which constitutes a measure of the period of time-varying oscillations of charged particles. If σ2→∞, no oscillations exist and λ2→0 as seen from Equation (60). In this case, the posterior Equation (65) contains no time-dependence but does include the singularity. For clarity, the posterior for the electrostatic potential is then (72)pϕ(x|X)=1Z∥x∥λ3c3exp−zσ1k·xβ. We now apply pϕ(x|X)=p(x|X) to the electrostatic homogenization in Equation (67) and obtain an explicit relationship for the fractal Laplacian, ∇β2pϕ=S(x). We determine the source S(x) to be associated with certain characteristics of the posterior. We first note that this source is associated with the charge density ρ(x) given in Equation (29). Now consider the simpler case where λ3=0. In this case, a source term depends on the fractional variance given by σ1. In the case where this fractional variance is very large, it is expected that ρ(x)→0. Physically, this means the stochastic homogenization of charges balances exactly and no internal electric fields are acting on the charges. This assessment is based on an ideal infinite medium and thus excludes the possibility of charges on a boundary. When internal charges are unequally distributed, the imbalance in charge leads to σ2≠0, a non-zero charge density ρ(x), and non-zero internal fields. The source term based on the fractal Laplacian of pϕ, excluding the singularity, is (73)S(x)=9D∥k∥2Zβ2σ12exp−3βσ1k·xβ. The singularities in the posterior where λ3 and c3 create additional effects governing the balance of charge density and complexities in the internal electric fields. These power-law singularities may describe a refined force field from charged interactions between particles, which vary as a function of the surrounding particle displacements. Given that this is a homogenized relationship based on the posterior, it gives an estimate of many-body interactions from all the surrounding charges. An assessment of its importance requires numerical analysis to compute the charge density from the source S(x). 4.2. Self-Consistent Fractal Charge Conservation and Field Relations Given the complexities of quantifying non-Gaussian Bayesian posterior densities and relating them to the fractal electromagnetic equations, we give an example illustrating where fractal operators become important in quantifying electromagnetic interactions in complex materials. We start with the conservation of charge and illustrate when fractal operators are superior in predicting charge flux and electromagnetic fields through a fractal representative volume element (RVE). We then compare the fractal conservation of charge with the fractal form of Maxwell’s equations to illustrate self-consistency in the electromagnetic field equations. Similar to the derivation of fractional conservation of mass in porous or fractal media [16], we start by assuming the flux of total charge J=JT+JL varies nonlinearly through an RVE. Given that fractal geometry follows a power-law function, we assume the flux of charge follows a power-law relationship due to fractal geometric constraints. The analysis is different from the nonlocal fractional conservation of mass given by Wheatcraft and Meerschaert [16]. The fractal operator is more robust in approximating power-law functions due to the invariance of the operating point chosen in the fractal Taylor series (see p. 6 [19]). However, the basis functions in fractional or fractal Taylor expansions are different and, therefore may affect the accuracy of predictions of data. Lastly note that we also generalize the charge conservation to include fractal operators, not only in space but also in time. The problem is illustrated in Figure 4 where a RVE of charge is assumed to have a nonlinear flux over the volume ΔV=Δx1Δx2Δx3. In such cases, we assume the current density follows a power-law function over space. For example, we denote the component of the current density (J1) in the x1 direction to vary in space according to (74)J1=J¯+J˜Δx1ν where Δx1ν=|x1+Δx1|ν−|x1|ν. J¯ and J˜ are phenomenological constants and ν is the exponent. Using the first-order fractal Taylor expansion of order β to estimate Equation (74), we have (75)J1(x1+Δx1,x2,x3)=J1(x1,x2,x3)+∂J1∂x1βx1,x2,x3Δx1β where it can be shown using the fractal operator definitions in Section 2.2 that this perfectly matches Equation (74) with one fractal derivative if β=ν. We can generalize this relationship to 3D to obtain the summation of flux gradients in the x1,x2 and x3 directions. We first denote ΔJ1=J1(x1+Δx1,x2,x3)−J1(x1,x2,x3) (and similar for ΔJ2,ΔJ3) to write out the complete fractal Taylor expansion in 3D as (76)Δx2βΔx3βΔJ1+Δx1βΔx3βΔJ2+Δx1βΔx2βΔJ3=∂Ji∂xiβx1,x2,x3ΔVβ where a summation is implied on the index i. For the fractional conservation of mass [16], it was assumed that the changes in mass flux over an RVE balance with an internal change in mass are dependent upon the integer time derivative of mass density. Since it is assumed that charges vary nonlinearly in space due to their fractal characteristics of the underlying material structure, we also assume that their time rate of change also varies nonlinearly according to a power-law function. This relation is described in terms of the total charge (77)Q(x,t)=Q¯(x)+Q˜(x)Δtγ where Δtγ=tγ−t0γ where t0 is some initial time. Q¯ and Q˜ are phenomenological parameters and γ is the exponent on time increments. Since we focus on the Eulerian (constant volume) frame, we take the partial fractal time derivative of the total charge (78)Q(x,t+Δt)=Q(x,t)+∂Q(x,t)∂tαtΔtα of order α. If γ=α, the fractal Taylor expansion over time perfectly matches the relationship given by Equation (77). We can now balance the fractal flux across the RVE in Equation (76) with the fractal time rate of change in total charge as (79)∂Q∂tα=−∂Ji∂xiβΔVβ and note the sign difference accounts for positive charge accumulation in the RVE is in the opposite direction of the outward pointing unit normal. This could also be re-written by normalizing the total charge Q with the fractal volume element ΔVβ to obtain the charge density over the fractal RVE to give (80)∂ρ∂tα+∂Ji∂xiβ=0 where ρ=limΔV→0QΔVβ. Given the fractal conservation of charge in Equation (80), we highlight its self-consistency with the fractal version of Maxwell’s equations. Starting with Ampere’s law in Equation (22), we take the fractal divergence to obtain (81)∇β·1μ0∇β×B=∇β·J+ϵ0∇β·∂E∂tα and due to the linearity of the fractal operators, ∇β·1μ0∇β×B=0, we have (82)∇β·J+ϵ0∇β·∂E∂tα=0. Since the order of the fractal time and space operators is invariant, we can relate the fractal divergence of the electric field to the fractal Gauss’ law that was given by Equation (19). We then arrive at a self-consistent relationship with the fractal conservation of charge in Equation (80). This illustrates that if fractal geometry imposes constraints on the flux of charge in the form of power-law nonlinearities in both space and time, fractal operators are more accurate than integer operators in predicting changes in the charge distribution, which also influences the fractal form of the electromagnetic field equations. 4.3. Fractional Unit Scaling Questions arise in interpreting the fractal-order electromagnetic field equations due to the non-intuitive fractional-order units that result from these space–time operators. Similar issues arise in nonlocal fractional-order operators. The interpretation of these operators and units has been discussed in the literature [24,49,50,51,52,53]. For example, Tarasov [24] normalizes material coordinates such that all units associated with length are unitless. Questions remain when applying such equations to experiments and inferring material parameters that include length. Gómez-Aguilar [49] introduced a pre-factor into the fractal operator that cancels the fractional unit in the fractal operator. They apply this operator to resistor-capacitor circuits. We consider their method here for the electromagnetic field equations as one alternative to avoid questions surrounding interpretations of fractional space and time units. Following [49], the fractal operator is modified by the pre-factor using (83)∂∂tα→1σt1−α∂∂tα (84)∂∂xiβ→1σx1−β∂∂xiβ where σt and σx are parameters with units of time [s] and length [m], respectively. We first apply this pre-factor to the electromagnetic field relations previously given by Equation (23) followed by Maxwell’s equations in terms of ϕ and A as previously given by Equations (29) and (36), respectively. We include this modification here to avoid overcomplicating the prior equations with two additional parameters. We first illustrate the scaling on the electric field and magnetic flux density by applying (85)Ei=−∂ϕ∂xiβ−∂Ai∂tα→−1σx1−β∂ϕ∂xiβ−1σt1−α∂Ai∂tα (86)Bi=eijk∂Ak∂xjβ→1σx1−βeijk∂Ak∂xjβ. By inspection, if the units of the parameters σt and σx are time [s] and length [m], respectively, the electric field units are voltage/length [V/m] and the magnetic flux units are Tesla [T]. It can also be shown that the units remain consistent in Maxwell’s equations when written in terms of ϕ and A. For completeness, we show (87)∂2ϕ∂xiβ=−ρϵ0→1σx2(1−β)∂2ϕ∂xiβ=−ρϵ0 (88)1c2∂∂tα∂Ai∂tα=∂∂xiβ∂Ai∂xiβ+μ0JT→1c2σt2(1−α)∂∂tα∂Ai∂tα=1σx2(1−β)∂∂xiβ∂Ai∂xiβ+μ0JT which again illustrates how the introduction of the parameters σt and σx with units of [s] and [m] give integer units in each equation. It should be noted, however, that the values of these scaling parameters must be carefully inferred from experiments or high-fidelity simulations so that they do not violate physical limits such as the speed of light. We comment further on this and other invariance relationships between the Euclidean and fractal domains in the following section. 5. Discussion An entropy dynamics framework has been developed and applied to Maxwell’s time-dependent electromagnetic equations. Fractional functions were introduced as constraints and balanced against a form of Shannon entropy that included integration over both space and time. The optimization of the cost led to a posterior that included effects associated with wave propagation of electromagnetic fields and divergent characteristics of electrostatics and magnetostatics. For example, we illustrate that when fractional constraints coincide with observations, the electromagnetic balance equations are self-consistent with fractal operators in both space and time. The additional sources in the fractal electromagnetic equations were shown to be associated with power-law singularities associated with multiscale interactions of charged particles as described in the posterior density. The theoretical relations provide a method to relate fractal operators with non-Gaussian posterior densities given observations that match the proposed fractional moment constraints over space and time. These three constraints, first defined by Equation (49) and later by Equation (55), must be informed by measurements or higher fidelity simulations. The first constraint σ1 provides a relative distance measure between material particles. From a molecular dynamics framework, these relative particle distances can be computed directly from atomistic simulations to quantify the statistical moment of a collection of atoms. The second constraint, σ2, represents the time period of oscillations between material particles. Similar to equilibrium particle distances in the first constraint, the distribution of the period of oscillations can be computed from atomistic simulations or experimentally, such as through NMR measurements [54]. Lastly, the third constraint denoted by σ3 is more complicated as it estimates longer-range spatial singularities from particle interactions. These effects give a refined force field between charged particles based upon the homogenization of long-range interactions over complex atomic distributions that may exhibit fractal characteristics. Current research is focused on conducting atomistic scale simulations for comparisons to the homogenized fields and fractal forms of Maxwell’s equations to build continuum surrogate models that accommodate complexities that are otherwise not well approximated using Gaussian densities. The information-theoretic methods described here can inform materials scientists and design engineers about complex material systems and structures. For example, temporal and spatial data may result in non-Gaussian statistical distributions, making it challenging to simulate and predict nonlinear behavior with integer-order operators. Fractal-order operators can improve homogenized estimates of extreme events associated with the onset of nonlinearities originating at defects which become important in understanding material and device reliability. This provides a homogenized estimate of extreme events in materials, which can be useful in complementing large-scale molecular dynamic simulations that exhibit uncertainty in their repeatability due to chaotic particle dynamics [55]. The statistical quantification of particle interactions in terms of moments provides a direct feedback loop to the fractal electromagnetic equations to help understand deviations from linearity in the electromagnetic fields based on the underlying fractal material structure. This also has implications for device design in nanotechnology. For example, physical reservoir computers (PRC) have gained attention due to their novel ability to process information for artificial intelligence applications in controlling robotic and aerospace systems and structures [56,57,58]. While promising, high-performance PRCs require specific amounts of nonlinearity to process information efficiently. The proposed information-theoretic framework may facilitate the structure-property design problem to create ideal nonlinearities for embedded sensors within a physical reservoir structure to sense and assess the environment for more efficient feedback control. An additional advantage of using the entropy dynamics framework is related to the constraints based on experimental observation, high-fidelity molecular dynamics, or quantum simulations. We highlighted in Section 4.2 how the conservation of charge and the associated electromagnetic fields can be more accurately estimated with fractal operators if power-law constitutive relationships exist. However, we have not addressed how transformations between the fractal domain and Euclidean domain affect invariance relationships (e.g., translational and rotational). Non-trivial relationships between Eulerian (deformed) and Lagrangian (undeformed) configurations have been rigorously evaluated to understand invariance conditions in the Euclidean domain, see [37], for example. To the author’s knowledge, this remains an open question on the fractal domain. However, given the constraints from observation within the entropy dynamics framework, limits on the fractal order should facilitate understanding the invariance relations. Nonetheless, transformations between the Euclidean and fractal domains should be further investigated to ensure that conservation properties are preserved.