MetamatBench : Integrating Heterogeneous Data, Computational Tools, and Visual Interface for Metamaterial Discovery

Jianpeng Chen 1 , Wangzhi Zhan 1 , Haohui Wang 1 , Zian Jia 2,5 , Jingru Gan 3 , Junkai Zhang 3 , Jingyuan Qi 1 , Tingwei Chen 1 , Lifu Huang 4 , Muhao Chen 4 , Ling Li 5 , Wei Wang 3 , Dawei Zhou 1 · 2025

Read MetamatBench : Integrating Heterogeneous Data, Computational Tools, and Visual Interface for Metamaterial Discovery by Jianpeng Chen 1 , Wangzhi Zhan 1 , Haohui Wang 1 , Zian Jia 2,5 , Jingru Gan 3 , Junkai Zhang 3 , Jingyuan Qi 1 , Tingwei Chen 1 , Lifu Huang 4 , Muhao Chen 4 , Ling Li 5 , Wei Wang 3 , Dawei Zhou 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20299.txt.

Introduction

Jianpeng Chen and co-authors introduced MetamatBench in 2025, a shared system for finding new metamaterials. These are built materials whose fine structure gives them traits that plain materials lack. Machine learning could help the search, but data, models, and user tools have been split apart.

The system works on three levels. It joins and cleans five data sets of many kinds. It adapts seventeen learning methods and scores them with twelve new measures, plus checks based on physics tests. A visual screen then lets users work with the tools and see results. The goal is to let experts and models work together on new material designs.

Catalog record

CREATORJianpeng Chen 1 , Wangzhi Zhan 1 , Haohui Wang 1 , Zian Jia 2,5 , Jingru Gan 3 , Junkai Zhang 3 , Jingyuan Qi 1 , Tingwei Chen 1 , Lifu Huang 4 , Muhao Chen 4 , Ling Li 5 , Wei Wang 3 , Dawei Zhou 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20299

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MetamatBench : Integrating Heterogeneous Data, Computational Tools, and Visual Interface for Metamaterial Discovery Jianpeng Chen 1 , Wangzhi Zhan 1 , Haohui Wang 1 , Zian Jia 2,5 , Jingru Gan 3 , Junkai Zhang 3 , Jingyuan Qi 1 , Tingwei Chen 1 , Lifu Huang 4 , Muhao Chen 4 , Ling Li 5 , Wei Wang 3 , Dawei Zhou 1 Abstract . Metamaterials, engineered materials with architected structures across multiple length scales, offer unprecedented and tunable mechanical properties that surpass those of conventional materials. However, leveraging advanced machine learning (ML) for metamaterial discovery is hindered by three fundamental challenges: (C1) Data Heterogeneity Challenge arises from heterogeneous data sources, heterogeneous composition scales, and heterogeneous structure categories; (C2) Model Complexity Challenge stems from the intricate geometric constraints of ML models, which complicate their adaptation to metamaterial structures; and (C3) Human-AI Collaboration Challenge comes from the “dual black-box” nature of sophisticated ML models and the need for intuitive user interfaces. To tackle these challenges, we introduce a unified framework, named MetamatBench , that operates on three levels. (1) At the data level , we integrate and standardize 5 heterogeneous, multi-modal metamaterial datasets. (2) The ML level provides a comprehensive toolkit that adapts 17 state-of-the-art ML methods for metamaterial discovery. It also includes a comprehensive evaluation suite with 12 novel performance metrics with finite element-based assessments to ensure accurate and reliable model validation. (3) The user level features a visual-interactive interface that bridges the gap between complex ML techniques and non-ML researchers, advancing property prediction and inverse design of metamaterials for research and applications. MetamatBench offers a unified platform deployed at http://zhoulab-1.cs.vt.edu:5550 that enables machine learning researchers and practitioners to develop and evaluate new methodologies in metamaterial discovery. For accessibility and reproducibility, we open-source our benchmark and the codebase at https://github.com/cjpcool/Metamaterial-Benchmark . ( , ) ( , ) Figure 1. An overview of metamaterials. Metamaterials are microstructured materials with effective material properties beyond their compositions. The multiscale architecture of metamaterial enables high mechanical efficiency and unusual properties, showing great potential in applications like biomedical devices, transportation systems, robotics, etc . 1. Introduction Metamaterials are an emerging class of materials that achieve unusual material properties through designed architecture at multiple length scales. They have been extensively studied in the past decades for their superior, tunable, and programmable material properties, demonstrating huge potential in diverse applications ( Paul, 2010 ; Engheta and Ziolkowski, 2006 ) . As illustrated in Figure 1 (left), while conventional material properties are dominated by their atomic structure ( Yao et al., 2018 ; Otto et al., 2012 ) , architected metamaterials emphasize the structure of a material, with scales ranging from the nano- and micro-scales up to macro-scale. Metamaterials, e.g. , truss-based metamaterials, studies often focus on designing the geometric structure of a unit cell. Micro-lattice materials have shown high stiffness, damage tolerance, reconfigurable and programmable properties, and even negative material indices (such as negative Poisson’s ratio and negative thermal conductivity) ( Jia et al., 2020 ) . Such high performance with unusual properties drives the wide application of metamaterials in various engineering fields (lightweight metamaterial empowers space transport systems, metamaterials with large void space enhance marine application, low thermal conductivity metamaterials are applied to thermal protection systems, etc .), as shown in Figure 1 (right). Because of their truss-based geometric characteristics, metamaterials are typically modeled as 3D graphs composed of nodes and edges to study how their 3D structures influence mechanical properties. Existing works ( Grega et al., 2024 ; Meyer et al., 2022 ; Zheng et al., 2023a ) generally employ graph neural networks (GNNs) ( Kipf and Welling, 2016a ; Kipf and Welling, 2016b ; Chen et al., 2025 ) to capture the structural information for mechanical property prediction ( Indurkar et al., 2022 ; Meyer et al., 2022 ) or metamaterial inverse design ( Zheng et al., 2023a ; Lumpe and Stankovic, 2021 ) . In parallel, advanced studies in geometric machine learning (ML) have extensively explored techniques to integrate rich 3D structural information in molecules ( Feinberg et al., 2018 ; Schütt et al., 2017 ; Liu et al., 2022 ; Gasteiger et al., 2021 ; Liao et al., 2024 ; Satorras et al., 2021a ; Atz et al., 2021 ; Batatia et al., 2022 ; Wang et al., 2024c ; Chen et al., 2024 ) and crystals researches ( Xie et al., 2022 ; Luo et al., 2024a ; Jiao et al., 2023 ; Xie and Grossman, 2018 ; Zeni et al., 2025 ) . Although many studies have benchmarked these methods on atomic crystal and molecular scales ( Dunn et al., 2020 ; Du et al., 2023 ; Liu et al., 2024 ; Barroso-Luque et al., 2024 ) , it remains unclear how advanced geometric ML approaches perform in the multiscale metamaterial domain. Consequently, there is a critical need to establish a standardized benchmark and evaluation platform that bridges the gap between current metamaterial modeling techniques and advanced geometric ML approaches, ensuring comprehensive integration and assessment of 3D structural information in metamaterial discovery. In this paper, we identify three key challenges in constructing a metamaterial benchmark. C1: Data heterogeneity. This challenge arises from (1) diverse data sources, e.g. , structural geometry, mechanical properties, and experimental measurements, (2) complex structure categories, e.g. , trusses, shells, foams, etc ., and (3) rich properties e.g. , stiffness and modulus. C2: Model complexity. The second challenge stems from the complexity of ML models and their potential incompatibility with multiscale metamaterials. Specifically, these ML models typically have a complex taxonomy with various backbones and geometric constraints. Additionally, they generally target atomic graphs and chemical properties, which are typically incompatible with metamaterials. These complexities pose challenges to evaluating and benchmarking advanced ML models on metamaterial applications. How to integrate and evaluate these complex ML models is a problem of pressing needs. C3: Human-AI collaboration. A goal of this work is to empower metamaterial researchers to easily leverage advanced ML models to accelerate progress in related fields. Achieving this requires fostering effective human-AI collaboration across diverse research domains. On one hand, sophisticated ML models often function as black box for researchers who may lack expert knowledge about advanced ML models. Instead, a visual-interactive interface may help researchers interact with the AI system. On the other hand, human users are also black box for the AI system. It is hard for the AI system to anticipate how researchers use it. To address this “dual black-box” challenge, a human-AI collaborative interface is essential to facilitate metamaterial research. In this paper, we propose MetamatBench as shown in Figure 3 , which contributes to the data level, ML level, and user level, establishing a robust, comprehensive, and user-friendly benchmark system. Within MetamatBench , the data level combines heterogeneous and multi-modal data sources into a unified framework to tackle the first challenge. The intermediate ML level consists of a model toolbox and an evaluation toolbox. The model toolbox focuses on two fundamental tasks, and assembles a wide range of ML models with various geometric characteristics for a comprehensive comparison. The evaluation toolbox employs a multi-perspective evaluation framework with several novel metrics to ensure robust evaluations. The topmost user level emphasizes human-AI collaboration,

Read the complete text