Tensor Completion for Surrogate Modeling of Material Property Prediction
Shaan Pakala, Dawon Ahn, Evangelos Papalexakis · 2025
Read Tensor Completion for Surrogate Modeling of Material Property Prediction by Shaan Pakala, Dawon Ahn, Evangelos Papalexakis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18137.txt.
Introduction
Shaan Pakala, Dawon Ahn, and Evangelos Papalexakis use tensor methods to predict material traits in this two thousand twenty-five paper. Designing a material means choosing a mix of elements and settings. The combinations explode, and testing each one is slow. A surrogate model that guesses traits can prune the search. The authors frame the data as a tensor, a multi-way table with many missing entries.
Tensor completion fills those gaps by exploiting the table's structure. Across several property tasks, their method cut prediction error by ten to twenty percent against standard machine learning models. The gain comes from respecting how the variables interact. Materials scientists who screen candidates in silico are the readers. Faster screening means lab time goes to the best bets.
Catalog record
| CREATOR | Shaan Pakala, Dawon Ahn, Evangelos Papalexakis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 8 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18137
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tensor Completion for Surrogate Modeling of Material Property Prediction Shaan Pakala, Dawon Ahn, Evangelos Papalexakis Abstract When designing materials to optimize certain properties, there are often many possible configurations of designs that need to be explored. For example, the materials’ composition of elements will affect properties such as strength or conductivity, which are necessary to know when developing new materials. Exploring all combinations of elements to find optimal materials becomes very time consuming, especially when there are more design variables. For this reason, there is growing interest in using machine learning (ML) to predict a material’s properties. In this work, we model the optimization of certain material properties as a tensor completion problem, to leverage the structure of our datasets and navigate the vast number of combinations of material configurations. Across a variety of material property prediction tasks, our experiments show tensor completion methods achieving decreased error in 2 of our 4 material property prediction tasks, compared with baseline ML models such as GradientBoosting and Multilayer Perceptron (MLP), maintaining similar training speed. 1 Introduction Material property prediction is a crucial aspect of designing new materials, in order to design a material with optimal properties. This includes designing strong materials ( Gongora et al. 2024 ) , magnetic materials ( Wang et al. 2020 ) , and semiconductor materials ( Haghshenas et al. 2024 ) . Machine learning (ML) is becoming a very prominent technique for this problem, and we see both composition-based (using the chemical formula) and structure-based (using the structure) material property prediction ( Gongora et al. 2024 ; Hu et al. 2024 ; Li et al. 2024 ) . Among the material properties being predicted, there is a lot of attention around predicting band gap, which directly affects the conductivity of materials ( Alsalman, Alqahtani, and Alharbi 2023 ; Hu et al. 2024 ) . This is very useful in fields such as semiconductor development, where knowing the conductivity is crucial. There is also work on predicting the formation energy ( Jha et al. 2019 ; Xie and Grossman 2018 ; Jha et al. 2022 ) . We also see prediction of magnetism, which is important for designing materials with ideal magnetic properties ( Li, Shan, and Shek 2022 ) . Unfortunately, issues tend to arise with a lack of training data ( Xin et al. 2021 ) , as is typical in any ML problem, especially when deep learning is introduced. In this work, we use tensor completion algorithms, designed for sparse datasets, to infer a material’s properties ( Sidiropoulos et al. 2016 ) . We model material property prediction tasks as tensors. This allows us to use tensor completion for composition-based material property prediction, where we use the chemical formula to predict material properties. By leveraging tensor completion algorithms, we take advantage of the structure of our datasets to infer material property values. 2 Methods Here we outline our methods for dataset generation and tensor completion for materials’ property prediction. 2.1 Tensor Dataset Generation To generate tensors used for our experiments, each tensor mode corresponds to either a unique element in the material, or the amount of each unique element in the material. An example fourth order tensor is shown below. The highlighted value represents the chemical formula AuBr 5 . Figure 1: Example fourth order tensor representing materials’ elements and elements’ ratios. The highlighted entry could correspond to the chemical formula AuBr 5 , since it corresponds to indices Au & Br for the elements, and indices 1 & 5 for the number of atoms in the material. 2.2 Tensor Completion for Materials Design By using tensor completion, we leverage the inherent structure in our multidimensional datasets to predict the results of the entire space of combinations, using few training values. Tensor Decomposition Tensor decomposition is a key technique to extract information from tensor data. For example, CPD (Canonical Polyadic Decomposition) ( Harshman 1970 ) is a common approach, factoring the tensor into the sum of rank 1 tensors. Tensor decomposition is crucial for tensor completion, which fills in a tensor’s missing values. Tensor Completion Models In our experiments, we use a variety of tensor completion models. These include CPD ( Harshman 1970 ) , CPD-S ( Pakala et al. 2024 ; Ahn, Jang, and Kang 2021 ) , and NeAT ( Ahn et al. 2024 ) . Performance Evaluation We randomly sample train values, using the rest to calculate Mean Absolute Error (MAE). For true value y and predicted \hat{y} , MAE=\frac{1}{n}\sum_{i=1}^{n}|y_{i}-\hat{y}_{i}| . 3 Experimental Evaluation Here we experimentally evaluate the viability of using tensor completion on the following tasks that we have defined: Task 1: Total magnetization prediction, using chemical formula. 100,000 training, 50,000 test values. 1 1 1 Original data from ( Martin Siron et al. 2024 ) . Task 2: Formation energy prediction, using chemical formula. 45,000 training, 4213 test values. 2 2 2 Original data from ( Li et al. 2024 ) . Task 3: Band gap prediction, using chemical formula. 45,000 training, 4213 test values. 2 2 2 Original data from ( Li et al. 2024 ) . Task 4: Band gap prediction, using chemical formula. 1500 training, 759 test values. 3 3 3 Original data from ( Hu et al. 2024 ) . 3.1 Tensor Model Comparison* * * footnotetext: There was misleading results due to highly redundant datasets, these results have now been updated. Table 1 contains the old results with redundant data, Table 2 contains the new results with the redundancies removed. For each tensor completion model, we display the average MAE over 5 iterations. We also compare non-tensor models: GradientBoosting ( Pedregosa et al. 2011 ) , XGBoost ( Chen and Guestrin 2016 ) , and an MLP ( Paszke et al. 2019 ) . Task 1 Task 2 Task 3 Task 4 CPD 1.397 0.570 0.650 0.430 CPD-S 1.428 0.627 0.631 0.390 NeAT 1.323 0.564 0.608 0.420 Non-Tensor Models GradientBoosting 0.898 0.307 0.820 0.560 XGBoost 1.084 0.671 0.686 0.462 MLP 1.242 0.586 0.746 0.574 Table 1: Comparison of ML models, both tensor and non-tensor methods, using the MAE over 5 iterations. Task 1 Task 2 Task 3 Task 4 CPD 1.179 0.344 0.467 0.428 CPD-S 1.254 0.369 0.487 0.396 NeAT 0.907 0.277 0.456 0.426 Non-Tensor Models HGB 1.018 0.280 0.774 0.560 XGB 1.212 0.643 0.618 0.454 MLP 1.403 0.677 0.709 0.567 Table 2: Same as Table 1 , but we removed the redundancy in our datasets. Comparison of ML models, both tensor and non-tensor methods, using the MAE over 5 iterations. The table shows tensor completion regularly outperforms the benchmark non-tensor models across a variety of tasks. 3.2 Individual Samples’ Comparison To observe how useful our methods are in practice, we look at 5 randomly sampled values and predictions for each task. Figure 2: Random samples’ predicted and actual values. Overall CPD-S offers reliability. Even with limited training samples in Task 4, CPD-S is still able to distinguish between low and high band gap values. 3.3 Efficiency Analysis Here we observe the performance and training time for different models with respect to the number of training values. (a) MAE (b) Training Time Figure 3: MAE and train time for models, with respect to number