When Does Multi-Task Learning Fail? Quantifying Data Imbalance and Task Independence in Metal Alloy Property Prediction Journal: Computational Materials Science

Sungwoo Kang · 2025

Read When Does Multi-Task Learning Fail? Quantifying Data Imbalance and Task Independence in Metal Alloy Property Prediction Journal: Computational Materials Science by Sungwoo Kang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22740.txt.

Introduction

Sungwoo Kang challenges a comfortable assumption in materials machine learning: that related traits help each other when learned together. Using a dataset of 54,028 metal alloys with extreme imbalance between tasks, Kang finds a striking split. Multi-task learning badly hurt regression on electrical resistivity and hardness, yet raised recall for amorphous-forming ability, the glass-forming talent of an alloy.

The divergence traces to mismatched math shapes: resistivity follows a simple curve in its inputs while hardness involves complex interactions, so their training gradients fight. Projecting away fighting gradients restored single-task performance, and combining label smoothing with gradient balancing balanced best overall. Kang recommends independent models for precise detail work, multi-task models for high-throughput screening, and a property-grouping view of when sharing helps.

Catalog record

CREATORSungwoo Kang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-22740

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When Does Multi-Task Learning Fail? Quantifying Data Imbalance and Task Independence in Metal Alloy Property Prediction Journal: Computational Materials Science Sungwoo Kang Abstract Multi-task learning (MTL) has emerged as a promising approach in materials informatics, with the assumption that related material properties share underlying physical principles that can be leveraged to improve prediction accuracy. In this study, we critically examine this assumption by applying MTL to simultaneously predict three properties of metal alloys: electrical resistivity, Vickers hardness, and amorphous-forming ability. Using a union dataset of 54,028 samples from the AI-Hub Korea platform, we compare three approaches: independent single-task models, standard MTL with hard parameter sharing, and structured MTL with learned task relation graphs. Contrary to expectations, our results reveal a striking dichotomy: MTL significantly degrades regression performance (resistivity R 2 R^{2} : 0.897 → \rightarrow 0.844, p < 0.01 p<0.01 ; hardness R 2 R^{2} : 0.832 → \rightarrow 0.694, p < 0.01 p<0.01 ) while significantly improving classification performance (amorphous F1: 0.703 → \rightarrow 0.744, p < 0.05 p<0.05 ; recall improved by 17%). Analysis of the learned task relation graphs reveals near-zero inter-task weights ( ∼ \sim 0.006), indicating that these alloy properties are fundamentally independent rather than coupled. We attribute the regression degradation to negative transfer caused by severe data imbalance (52,388 resistivity samples vs. 800 hardness samples), where the dominant task overwhelms minority tasks during joint optimization. These findings provide empirical guidelines for practitioners: use independent models for precise property regression, but leverage MTL for classification tasks where improved recall is critical for candidate screening. Our work highlights the importance of validating MTL assumptions before deployment in materials discovery pipelines. 1 Introduction The accelerated discovery of advanced materials with tailored properties is a central goal of modern materials science. Machine learning (ML) has emerged as a powerful tool in this endeavor, enabling rapid prediction of material properties from composition and structure descriptors [ 11 , 1 ] . Among ML approaches, multi-task learning (MTL) has garnered significant attention for its promise to improve prediction accuracy by jointly learning multiple related properties [ 2 ] . The appeal of MTL in materials science rests on a fundamental assumption: that different material properties share underlying physical mechanisms, and thus learning to predict one property can provide useful inductive bias for predicting others [ 2 ] . For metal alloys, this assumption appears intuitive—electrical resistivity, mechanical hardness, and glass-forming ability are all influenced by atomic-level factors such as electronegativity differences, atomic size mismatch, and mixing enthalpy [ 18 ] . This has motivated numerous studies applying transfer learning [ 15 , 3 ] and multi-task learning [ 6 ] to materials property prediction. However, the question of when MTL actually helps—and when it may harm performance—has received insufficient attention in the materials informatics literature. The machine learning community has documented the phenomenon of “negative transfer,” where jointly learning unrelated or conflicting tasks degrades performance compared to independent learning [ 13 , 12 ] . This is particularly concerning when datasets are severely imbalanced across tasks, as the optimization may be dominated by the largest task at the expense of smaller ones [ 4 ] . In this work, we conduct a systematic investigation of MTL for multi-property prediction in metal alloys, with a focus on understanding when and why MTL succeeds or fails. We make the following contributions: 1. We construct a comprehensive benchmark using the AI-Hub Korea metal alloy dataset, containing 54,028 unique samples with three target properties: electrical resistivity (52,388 samples), Vickers hardness (800 samples), and amorphous-forming ability (840 samples). 2. We implement and compare three modeling approaches: independent single-task neural networks, standard MTL with hard parameter sharing, and structured MTL with learned task relation graphs. 3. We provide unexpected but important findings: MTL significantly degrades regression performance while significantly improving classification performance. This challenges the common assumption that MTL universally benefits materials property prediction. 4. We analyze the root causes of this dichotomy through learned task relations (which reveal task independence) and gradient analysis (which reveals task interference from data imbalance). 5. We provide practical guidelines for materials scientists on when to apply MTL versus independent models. The remainder of this paper is organized as follows. Section 2 reviews related work on MTL in materials science and the phenomenon of negative transfer. Section 3 describes our dataset, model architectures, and experimental setup. Section 4 presents comprehensive results with statistical analysis. Section 5 analyzes why MTL fails for regression but succeeds for classification, and provides practical recommendations. Section 6 summarizes our findings and outlines future directions. 2 Related Work 2.1 Multi-Task Learning in Materials Science Multi-task learning has been increasingly applied to materials property prediction, motivated by the hypothesis that related properties share underlying physical principles. Xie and Grossman [ 15 ] demonstrated that graph neural networks can learn transferable representations for inorganic crystals, showing that pretraining on formation energy improves band gap prediction. Chen et al. [ 3 ] developed AtomSets, a hierarchical transfer learning framework that leverages pre-trained representations on large datasets to improve predictions on smaller target datasets. For molecular property prediction, Ramsundar et al. [ 10 ] showed that MTL on hundreds of biological assays can improve prediction of drug-target interactions. More recently, Wen et al. [ 14 ] extended this to reaction property prediction, demonstrating benefits when tasks share chemical mechanisms. However, most of these studies focus on scenarios where tasks are inherently related (e.g., multiple biological assays for the same target, or properties governed by similar physics). The question of whether arbitrary material properties benefit from joint learning has been less thoroughly examined. 2.2 Negative Transfer and Task Interference The machine learning community has extensively studied the phenomenon of negative transfer, where knowledge transfer between tasks degrades rather than improves performance [ 13 ] . Standley et al. [ 12 ] systematically analyzed task relationships in computer vision and found that many seemingly related tasks exhibit negative transfer when trained jointly. Several factors contribute to negative transfer: 1. Task dissimilarity : When optimal representations for different tasks conflict, shared parameters are forced into suboptimal compromises [ 5 ] . 2. Data imbalance : When tasks have vastly different sample sizes, gradient updates are dominated by the larger task, starving smaller tasks of learning signal [ 4 ] . 3. Gradient interference : Conflicting gradient directions across tasks can cause optimization instabilities [ 16 ] . Chen et al. [ 4 ] proposed GradNorm to dynamically balance gradient magnitudes across tasks, partially mitigating imbalance effects. Kendall et al. [ 7 ] introduced uncertainty-based task weighting. However, these methods address symptoms rather than the fundamental question of task compatibility. 2.3 Task Relation Learning Rather than assuming task relationships a priori, recent work has explored learning task relations directly from data. Zamir et al. [ 17 ] computed a “taskonomy” revealing which visual tasks transfer well to others. For molecular property prediction, several studies have learned task graphs indicating which properties provide useful auxiliary information for others [ 8 ] . In materials science, explicit task relation learning remains underexplored. Most MTL studies either assume all properties are related (fully shared representations) or manually specify which properties should be grouped. Our work addresses this

Read the complete text