Benchmarking Hartree-Fock and DFT for Molecular Hyperpolarizability: Implications for Evolutionary Design

Dominic Mashak, S. A. Alexander Department of Physics, Southwestern University, Georgetown, TX 78626, USA · 2025

Read Benchmarking Hartree-Fock and DFT for Molecular Hyperpolarizability: Implications for Evolutionary Design by Dominic Mashak, S. A. Alexander Department of Physics, Southwestern University, Georgetown, TX 78626, USA (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17767.txt.

Introduction

Dominic Mashak and S. A. Alexander test cheap quantum chemistry methods for predicting how molecules respond to electric fields, a property that matters for materials that change light in useful ways. Design searches need a scoring method that is fast yet ranks candidate molecules correctly.

They compare Hartree-Fock and several density functional methods across many basis sets against measured data for five organic molecules. Even the cheapest pairing ranks molecules perfectly, though its values are off by a large share. Every tested pairing preserves the ranking, so search algorithms can trust cheap scores to guide design.

Catalog record

CREATORDominic Mashak, S. A. Alexander Department of Physics, Southwestern University, Georgetown, TX 78626, USA
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17767

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Benchmarking Hartree-Fock and DFT for Molecular Hyperpolarizability: Implications for Evolutionary Design Dominic Mashak, S. A. Alexander Department of Physics, Southwestern University, Georgetown, TX 78626, USA Abstract Abstract Evolutionary algorithms for molecular design require computationally efficient yet accurate fitness functions. We systematically benchmark Hartree-Fock and density functional theory for predicting molecular first hyperpolarizability ( \beta ), evaluating five functionals (HF, PBE0, B3LYP, CAM-B3LYP, M06-2X) across six basis sets against experimental data from five organic push-pull chromophores. For this dataset, HF/3-21G achieves 45.5% mean absolute percentage error with perfect pairwise ranking in 7.4 minutes per molecule. All 30 tested combinations of functional and basis sets maintain perfect pairwise agreement, validating their use as evolutionary fitness functions despite moderate absolute errors. Larger basis sets yield a lower percentage error compared to the experimental values than the difference with the functional. The preservation of pairwise rankings across all combinations of functionals and basis sets provides crucial guidance for evolutionary optimization of nonlinear optical materials. 1 Introduction Evolutionary algorithms for designing organic molecules with large second-order nonlinear optical responses require fitness functions that balance accuracy with computational efficiency [ 2 , 3 ] . While experimental hyperpolarizability ( \beta ) measurements provide definitive values, they are impractical for screening the thousands of candidates evaluated during evolutionary optimization. DFT offers a potential balance between cost and accuracy [ 4 , 5 ] , but the choice of functional and basis set remains unclear for evolutionary applications. Critical questions include: Which configurations of functional and basis set provide adequate pairwise ordering for selection pressure? What accuracy-efficiency trade-offs exist? How large must basis sets be? ∗ [email protected] † [email protected] Systematic benchmarking for evolutionary design remains limited. Previous studies focused on maximizing absolute accuracy with sophisticated methods [ 6 , 7 ] , providing limited guidance for high-throughput applications where computational budget constraints are critical. We evaluate 30 method combinations (5 functionals × 6 basis sets) against experimental hyperpolarizability data from five push-pull chromophores spanning \beta values from 4,000 to 75,000 a.u. We characterize accuracy-cost trade-offs and assess pairwise ordering preservation, which is crucial for evolutionary algorithms but often not considered in previous quantum chemical benchmarking. 2 Methods 2.1 Molecule Set We selected five prototypical push-pull chromophores with experimentally measured static hyperpolarizabilities from Kanis et al. [ 1 ] : (1) para-nitroaniline (pNA, \beta_{exp}=3,994 a.u.), (2) Disperse Red 1 analog (DR1, \beta_{exp}=25,466 a.u.), and (3-5) three nitrostilbene-aminostilbene conjugates ( \beta_{exp}=30,096 , 52,089, and 75,240 a.u.). These molecules represent canonical donor- \pi -acceptor architectures [ 8 , 9 ] . 2.2 Quantum Chemical Calculations We evaluated five functionals: Hartree-Fock (HF), PBE0 (25% HF exchange) [ 12 , 13 ] , B3LYP (20% HF exchange) [ 14 , 15 ] , CAM-B3LYP (range-separated hybrid) [ 16 ] , and M06-2X (54% HF exchange) [ 17 ] . Each was paired with six basis sets: STO-3G, 3-21G, 6-31G, 6-311G, 6-31G(d,p), and 6-311G(d). All calculations used PySCF [ 18 ] on an Intel i7-12700K with 32 GB RAM. Hyperpolarizability calculations applied the finite field method with field strength h=0.001 a.u., numerically differentiating molecular dipole moments to obtain static hyperpolarizability tensor components [ 10 , 11 ] . 2.3 Performance Metrics 2.3.1 Mean Absolute Percentage Error (MAPE) \text{MAPE}=\frac{100}{n}\sum_{i=1}^{n}\left|\frac{\beta_{\text{calc},i}-\beta_{\text{exp},i}}{\beta_{\text{exp},i}}\right| (1) 2.3.2 Pairwise Rank Agreement Pairwise ordering is how different methods will order different molecules, smallest to largest hyperpolarizability, even though their relative values will differ. For evolutionary algorithms, pairwise ordering determines selection pressure. We measure the fraction of molecule pairs (i,j) for which method and experiment agree on ordering: \frac{1}{\binom{n}{2}}\sum_{i<j}\mathbb{I}[\text{sgn}(\beta_{\text{calc},i}-\beta_{\text{calc},j})=\text{sgn}(\beta_{\text{exp},i}-\beta_{\text{exp},j})] (2) Perfect pairwise agreement (100%) ensures evolutionary selection operates correctly for every comparison. 2.3.3 Computational Cost and Pareto Optimality We measure wall-clock time and identify Pareto-optimal methods. By plotting the wall time and accuracy of each combination, we can identify the Pareto frontier for these calculations. This allows us to determine the most optimal combination of functional and basis set. 3 Results 3.1 Overview of Method Performance Table 1 presents top-performing methods. All achieve perfect pairwise rank agreement (10/10 pairs), with basis set size dominating accuracy: the top methods employ 6-311G, 6-311G(d), or 3-21G. Table 1: Top 10 method combinations ranked by MAPE. All achieve perfect pairwise agreement (10/10 pairs). Method MAPE Time Pareto (%) (min) Optimal HF/3-21G 45.5 7.4 Yes CAM-B3LYP/3-21G 47.8 28.1 M06-2X/3-21G 48.4 35.0 HF/6-31G 48.4 12.9 PBE0/3-21G 50.0 22.7 B3LYP/3-21G 50.1 14.9 HF/6-31G(d,p) 50.4 22.0 CAM-B3LYP/6-31G 50.9 46.2 M06-2X/6-31G 51.4 36.9 HF/6-311G 52.1 17.5 Yes More sophisticated functionals like CAM-B3LYP and M06-2X do not significantly outperform HF when computational cost is considered. 3.2 Functional Comparison Figure 1 compares error distributions across functionals. HF exhibits the lowest median error (51.7% ± 23.5%). Hybrid functionals cluster tightly: PBE0 (55.2%), B3LYP (55.6%), CAM-B3LYP (54.1%), and M06-2X (54.0%), all within 1.5 percentage points. Figure 1 : Distribution of percentage errors across all basis sets for each functional. Box boundaries indicate quartiles, orange lines show medians, and green dashed lines indicate means. HF’s apparent superiority likely reflects characteristics specific to these simple push-pull chromophores rather than fundamental theoretical advantages. The Kanis dataset consists of canonical donor- \pi -acceptor systems where charge transfer follows well-defined conjugation paths [ 19 , 20 ] . For such molecules, the response to applied fields may be adequately captured by orbital deformation without requiring dynamic electron correlation that sophisticated functionals are designed to capture. Alternatively, systematic errors in HF calculations may accidentally compensate for approximations inherent in the experimental measurements or the finite field method. The experimental values themselves carry uncertainties from solvent effects, vibrational contributions, and measurement techniques that are difficult to quantify [ 21 ] . 3.3 Basis Set Effects Figure 2 a shows computational cost increases approximately linearly with basis set size, consistent with theoretical scaling expectations [ 22 , 23 ] . (a) (b) Figure 2 : (a) Mean wall time increases systematically with basis set size. (b) The Pareto frontier identifies optimal methods (red dots). Only HF/STO-3G and HF/3-21G achieve Pareto optimality. Minimal STO-3G achieves 62.0% MAPE, while split-valence 3-21G improves to 48.4%, a 14% MAPE gain for 30% more time. Further expansion shows diminishing returns: 6-31G (51.4%), 6-311G (54.8%), 6-31G(d,p) (52.7%), and 6-311G(d) (55.5%) cluster within 4 points despite doubled cost. The jump from minimal to split-valence provides the best accuracy gain per unit computation, making 3-21G a pragmatic choice for evolution, consistent with basis set convergence studies [ 24 ] . 3.4 Pareto-Optimal Methods Figure 2(b) maps all 30 methods in accuracy-speed space. Only HF/STO-3G and HF/3-21G achieve Pareto optimality; no other method offers better accuracy without increased cost. HF/STO-3G achieves 60.5% MAPE in 2.7 minutes, fastest but least accurate. HF/3-21G achieves 45.5% MAPE in 7.4 minutes, offering better balance for most applications. 3.5 Perfect Pairwise Ranking Preservation All 30 methods achieve perfect pairwise rank agreement (10/10 pairs), the most important finding for evolutionary applications. In genetic algorithms, selection depends on relative fitness comparisons rather than absolute values [ 25 , 26 ] . As long as the fitness function correctly identifies the superior molecule in each combination of functional and basis set, evolution proceeds toward optimal solutions even with systematic bias. Figure 3 plots calculated versus experimental hyperpolarizabilities. All show strong linear correlations (R {}^{2}>0.99 ) with near-unity slopes, confirming minimal systematic bias.

Read the complete text