Analytical Gradient-Based Optimization of CALPHAD Model Parameters

Courtney Kunselman a, Brandon Bocklund b, Richard Otis c, Raymundo Arróyave a,d,e · 2025

Read Analytical Gradient-Based Optimization of CALPHAD Model Parameters by Courtney Kunselman a, Brandon Bocklund b, Richard Otis c, Raymundo Arróyave a,d,e (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01585.txt.

Introduction

Courtney Kunselman and co-authors speed up materials model fitting in a 2025 paper. CALPHAD models predict phase diagrams for alloys, but fitting their many parameters is a hard, high dimensional task. Standard fitting skips gradients and crawls as models grow. Their framework computes exact gradients of the model's outputs with respect to its parameters, using a recently formalized derivative method.

Those gradients hold even when the model hides complex internal degrees of freedom. Gradient based search can then climb efficiently where blind search wanders. Alloy designers who fit models weekly could cut calibration from days to hours. The method is general, so other thermodynamic models can adopt it.

Catalog record

CREATORCourtney Kunselman a, Brandon Bocklund b, Richard Otis c, Raymundo Arróyave a,d,e
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01585

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Analytical Gradient-Based Optimization of CALPHAD Model Parameters Courtney Kunselman a, Brandon Bocklund b, Richard Otis c, Raymundo Arróyave a,d,e Abstract The calibration of CALPHAD (CALculation of PHAse Diagrams) models involves the solution of a very challenging high-dimensional multiobjective optimization problem. Traditional approaches to parameter fitting predominantly rely on gradient-free methods, which while robust, are computationally inefficient and often scale poorly with model complexity. In this work, we introduce and demonstrate a generalizable framework for analytic gradient-based optimization of the parameters of the CALPHAD model enabled by the recently formalized Jansson derivative technique. This method allows for efficient evaluation of gradients of thermodynamic properties at equilibrium with respect to model parameters, even in the presence of arbitrarily complex internal degrees of freedom. Leveraging these semi-analytic gradients, we employ the conjugate gradient (CG) method to optimize thermodynamic model parameters for four binary alloy systems: Cu-Mg, Fe-Ni, Cr-Ni, and Cr-Fe. Across all systems, CG achieves comparable or superior optimality relative to Bayesian ensemble Markov Chain Monte Carlo (MCMC) with improvements in computational efficiency ranging from one to three orders of magnitude. Our results establish a new paradigm for CALPHAD assessments in which high fidelity data-rich model calibration becomes tractable using deterministic gradient-informed algorithms. 1 Introduction Emerging challenges in materials design increasingly demand accurate and efficient exploration of phase stability in complex, multicomponent systems. The CALPHAD (CALculation of PHAse Diagrams) method addresses this need by constructing thermodynamic models based on physically informed surrogate descriptions of the Gibbs energy for each phase. These models enable reliable predictions of phase equilibria and transformations across a wide range of compositions and temperatures. The Gibbs energy models – the key to the CALPHAD approach – consist of both fundamental thermodynamic physical descriptions and expert-specified parametric forms informed by empirical and computational data. Thus, the overall utility of these models heavily relies on the modeler’s ability to choose both an appropriate parametric form and corresponding parameter values which agree well with available data and reasonably interpolate in regions of conditions space with no available benchmark. Various model forms have been rigorously developed to capture contributions to the Gibbs energy of a phase based on its chemical and physical properties. Common examples applicable to many alloy systems include modified power series expansions for temperature dependence, polynomial basis expansions aimed at reducing correlations between coefficients for composition dependence, and compound energy formalism (CEF) sublattice models for ordering. For these widely applied parametric forms, model selection becomes an art of balancing model simplicity against descriptive power in the context of available data. That is, power and polynomial expansions must be truncated to avoid unnecessary complexity and overfitting while still maintaining extrapolative value, and available data limit the parameters which can be fit (e.g. heat capacity data cannot be used to fit the constant term of a temperature power series expansion). Similarly, CEF models with multiple sublattices can describe complex physical phenomena, but they are more computationally expensive to minimize due to the introduction of additional degrees of freedom and require the fitting of compound energies for which experimental data can be limited or unattainable. Historically, the model selection process has mostly relied on expert knowledge of matching model forms with material properties and/or brute-force trial and error performed on a subset of potential models, coupled with a parameter-fitting step lukas2007computational . However, recent developments in statistical tools bocklund2019espei , honarmandi2019bayesian are making the model selection process more approachable for the non-expert. Once the Gibbs energy models for each phase are determined, the degrees of freedom of these models must be calibrated against available data. Empirical measurements of equilibrium activity, thermodynamic properties related to derivatives of the Gibbs energy, and phase boundaries provide touchstones on the convex hull of the energy landscape while computational data establish reference points in experimentally-prohibited regions of configuration space. Parameter fitting thus becomes a multiobjective optimization problem where the objective function is often constructed through a maximum likelihood approach, in which model prediction errors are assumed to be normally distributed at mean zero with observation-specific standard deviations and weights. Because the objective function is often defined as the output of many energy minimization calculations and the dimension of parameter spaces can get large, accurate, efficient evaluations of the gradients of predicted model errors with respect to parameters have proved difficult to obtain. Consequently, the most popular approach to parameter fitting, weighted nonlinear least squares, implemented in CATCalc shobu2009catcalc , MTDATA davies2002mtdata , Pandat cao2009pandat , Thermo-Calc jansson1984evaluation and OpenCalphad sundman2015opencalphad , employs gradient-free techniques to iteratively solve the normal equations. Due to their inherent gradient-free design, black-box approaches are also becoming more popular in commercial and open source thermodynamic assessment modules, as evidenced by the use of NOMAD in FactSage’s Calphad Optimzer reisuser and ESPEI’s use of Bayesian ensemble Markov Chain Monte Carlo (MCMC) bocklund2019espei . Although gradient-free methods provide the flexibility to sidestep the difficulty of robustly differentiating the outputs of equilibrium calculations, gradient-informed optimization schemes could greatly reduce the computational cost of parameter optimization. To this end, Zhang et al. recently demonstrated the use of gradient descent to optimize the Ag-Pd and La-C systems zhang2025new . However, their approach appears to have involved specially designed analytic loss functions (i.e. the loss functions did not depend on the outputs of equilibrium calculations), which can only be constructed for systems in which all energy models can be written as functions of composition. In a recent publication kunselman2024analytically , the current authors rigorously proved the Jansson derivative technique, an adjoint-like method for computing semianalytic derivatives with respect to external conditions at equilibrium that does not require additional function evaluations or matrix inversions, and speculated that this method could be used to calculate gradients with respect to model parameters at equilibrium for models of arbitrary complexity. In this work, we demonstrate the use of Jansson derivatives to enable gradient-informed parameter optimization of CALPHAD models via the conjugate gradient (CG) algorithm. We apply this approach to several binary systems, including Cu-Mg, Fe-Ni, Cr-Ni, and Cr-Fe. The performance of CG is evaluated in terms of efficiency and accuracy and benchmarked against the current standard employed by ESPEI: Bayesian ensemble Markov Chain Monte Carlo (MCMC). Although CG provides a promising foundation for gradient-based optimization in CALPHAD assessments, we recognize it as only a first step. Accordingly, we discuss future directions, emphasizing the potential of stochastic and global optimization strategies to further enhance model calibration. 2 Theory 2.1 Parameter Optimization by Maximum Likelihood Estimation A common approach to fitting parametric models involves building a joint probability distribution over parameter space in the context of observed data. In Maximum Likelihood Estimation (MLE), this joint probability distribution describes the likelihood of observing a data sample (X_{1},X_{2},\ldots,X_{n}) given a parameter vector \bm{\theta} and is aptly referred to as the likelihood function. When the sample random variables are assumed to be independent and identically distributed, the likelihood function takes the form L(\bm{\theta})=f(X_{1},X_{2},\ldots,X_{n}|\bm{\theta})=\prod_{i=1}^{n}f_{i}(X_{i}|\bm{\theta}) (1) where f is the joint conditional probability density function given \bm{\theta} of the drawing sample (X_{1},X_{2},\ldots,X_{n}) and f_{i} is the univariate conditional function for observation X_{i} . The MLE estimator, or the most optimal set of parameters, is then found by maximizing L(\bm{\theta}) . In practice, the log-likelihood is often maximized in order to avoid

Read the complete text