L 2 M 3 OF: A Large Language Multimodal Model for Metal-Organic Frameworks
Jiyu Cui, Fang Wu, Haokai Zhao, Minggao Feng, Xenophon Evangelopoulos, Andrew I. Cooper, Yejin Choi · 2025
Read L 2 M 3 OF: A Large Language Multimodal Model for Metal-Organic Frameworks by Jiyu Cui, Fang Wu, Haokai Zhao, Minggao Feng, Xenophon Evangelopoulos, Andrew I. Cooper, Yejin Choi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20976.txt.
Introduction
Jiyu Cui leads six co-authors on a large language multimodal model for metal organic frameworks, porous crystals prized for carbon capture and gas storage. Their design space is vast, with countless three dimensional atomic arrangements governed by strict coordination rules that plain text describes poorly.
The model is built to read multifaceted representations beyond language, so structure and property information can guide generation and prediction together. Language reasoning is paired with geometric and chemical encodings suited to framework rules. The aim is faster discovery of frameworks tuned for capture, storage, and separation tasks that matter for energy and climate.
Catalog record
| CREATOR | Jiyu Cui, Fang Wu, Haokai Zhao, Minggao Feng, Xenophon Evangelopoulos, Andrew I. Cooper, Yejin Choi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20976
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
L 2 M 3 OF: A Large Language Multimodal Model for Metal-Organic Frameworks Jiyu Cui, Fang Wu, Haokai Zhao, Minggao Feng, Xenophon Evangelopoulos, Andrew I. Cooper, Yejin Choi Abstract Large language models (LLMs) have demonstrated remarkable reasoning capabilities across diverse natural language tasks. However, comparable breakthroughs in scientific discovery are more limited, because understanding complex physical phenomena demands multifaceted representations far beyond language alone. A compelling example is the design of functional materials such as metal-organic frameworks (MOFs) — critical for a range of impactful applications like carbon capture and hydrogen storage. Navigating their vast and intricate design space in language-based representations interpretable by LLMs is challenging due to the numerous possible three-dimensional atomic arrangements and strict reticular rules of coordination geometry and topology. Despite promising early results in LLM-assisted discovery for simpler materials systems, MOF design remains heavily reliant on tacit human expertise rarely codified in textual information alone. To overcome this barrier, we introduce L 2 M 3 OF, the first multimodal LLM for MOFs. L 2 M 3 OF integrates crystal representation learning with language understanding to process structural, textual, and knowledge modalities jointly. L 2 M 3 OF employs a pre-trained crystal encoder with a lightweight projection layer to compress structural information into a token space, enabling efficient alignment with language instructions. To facilitate training and evaluation, we curate a structure–property–knowledge database of crystalline materials and benchmark L 2 M 3 OF against state-of-the-art (SOTA) closed-source LLMs such as GPT-5, Gemini-2.5-Pro, and DeepSeek-R1. Experiments show that L 2 M 3 OF outperforms leading text-based closed-source LLMs in property prediction and knowledge generation tasks, despite using far fewer parameters. These results highlight the importance of multimodal approaches for porous crystalline material understanding and establish L 2 M 3 OF as a foundation for next-generation AI systems in materials discovery. 1 Introduction Metal-organic frameworks represent a versatile class of porous crystalline materials with high tunability and broad physical properties that promise transformative applications in direct carbon capture ( Rohde et al. 2024 ) , clean hydrogen storage ( Chen et al. 2020 ) , water harvesting ( Alawadhi et al. 2024 ) , and controlled drug delivery ( Wu & Yang 2017 ) . MOF functional design involves intricate reticular synthesis procedures by linking metal atoms and organic molecules into repeating patterns, akin to ‘LEGO building’ at the nanoscale. Scaling-up their design is nevertheless non-trivial, even with machine learning, both due to the large number of possible building-block combinations that give rise to an enormous design space, and because of the expertise-driven nature of the design which heavily relies on domain knowledge ( Yaghi et al. 2003 ) . Large language models have recently emerged as powerful AI assistants for chemists, demonstrating strong reasoning capabilities in language-related chemistry tasks, such as chemical knowledge integration and tool orchestration, offering promising potential in accelerating the exploration of large design spaces ( Mirza et al. 2025 ) . The discovery of new functional materials such as MOFs however, is fundamentally more challenging because unimodal textual representations typically fail to capture complex, high-dimensional reticular phenomena that give rise to different functionalities. Unlike molecules ( Zhu et al. 2024 ) or proteins ( Wu et al. 2023 ) , which can be expressed as textual sequences of a relatively small range of elements, MOFs inhabit three-dimensional, periodic structures that resist straightforward representation. In addition to being compositionally much broader, the structure-function problem for MOFs is inherently more complex because the 3-dimensional atomic ‘sequence’ does not encode function alone; rather, it emerges from a combination of factors, including local bonding environments, long-range crystallographic symmetry, pore connectivity, and other topological features ( Luo et al. 2024 ) . Despite the emerging line of research on LLMs for accelerated materials design ( Kang et al. 2025 ; Duan et al. 2025 ) spanning a broad range of downstream tasks, including property prediction ( Niyongabo Rubungo et al. 2025 ) and de-novo structure generation ( Wang et al. 2025a ) , existing approaches remain restricted to text-centric or file-based representations, such as crystallographic information files (CIFs) and text-based property descriptions ( Tang et al. 2025 ) . While effective for sequential reasoning, such encodings fail to capture three-dimensional symmetries, periodicity, and long-range structural correlations that underpin crystalline behavior, often underperforming when compared with geometry- or symmetry-aware models ( Alampara et al. 2025b ) . A collection of existing LLMs and their modeling capacity for crystalline materials is presented in Table 1 . The challenge here extends beyond structural representation; it lies in the ‘machine understanding’ of materials’ functionality. Multimodal integration in learning strategies, that is, leveraging atomic information as well as literature knowledge to interlink structure with function, is therefore key to enable a holistic understanding of materials’ applicability. Whereas molecular modeling has seen initial success in coupling LLMs with graph neural networks or generative models ( Jablonka et al. 2024 ) , analogous strategies for crystalline systems remain rare, owing to system and design complexity, as well as the lack of standardized datasets and benchmarks tailored to crystalline materials, rendering rigorous evaluation and reproducibility quite challenging. This work proposes L 2 M 3 OF, the first multimodal LLM for MOF design that combines multimodal MOFs representations ( Park et al. 2023 ) with curated domain-knowledge from MOFs literature. L 2 M 3 OF is versatile and inherently designed to be lightweight to allow for an efficient alignment with language instructions, demonstrating SOTA performance on diverse design-critical tasks including property prediction and material application recommendation, rendering it an indispensable AI-assistant for chemists and materials scientists. To train and test L 2 M 3 OF, we curate the first-ever structure-property-knowledge MOFs database , namely MOF-SPK, featuring structural, property and domain-knowledge information for more than 100,000 MOFs materials. L 2 M 3 OF outperforms leading commercially-available LLMs such as DeepSeek, GPT-4o, and Gemini-2.5-Pro, demonstrating SOTA capabilities not only in capturing essential representational aspects of complex MOFs systems, but also a holistic understanding of their broader functional role and potential applicability. Fig. 1 illustrates the core architectural features of L 2 M 3 OF. Model CrystalType LLM Model Input Downstream Tasks Text Multimodal Structure Property Knowledge Q&A LLM-Prop ( Niyongabo Rubungo et al. 2025 ) Inorganic T5 \checkmark \checkmark CrystLLM ( Antunes et al. 2024 ) Inorganic Llama-2 \checkmark \checkmark CrysText ( Mohanty et al. 2024 ) Inorganic Llama-3.1 \checkmark \checkmark Mat2Seq ( Yan et al. 2025 ) Inorganic GPT \checkmark \checkmark MatText ( Alampara et al. 2025a ) Inorganic Llama-2 \checkmark \checkmark CrystalICL ( Wang et al. 2025b ) Inorganic Llama-2 \checkmark \checkmark CSLLM ( Song et al. 2025 ) Inorganic Llama-3 \checkmark \checkmark deCIFer ( Johansen et al. 2025 ) Inorganic Transformer \checkmark \checkmark MatterGPT ( Wang et al. 2025a ) Inorganic GPT \checkmark \checkmark Text2Struc ( Baibakova 2025 ) Inorganic CodeGen \checkmark \checkmark Matterchat ( Tang et al. 2025 ) Inorganic Mistral \checkmark \checkmark \checkmark \checkmark Chemeleon ( Park et al. 2025 ) Inorganic BERT \checkmark \checkmark \checkmark MOFGPT ( Badrinarayanan et al. 2025 ) MOFs GPT \checkmark \checkmark \checkmark ChatMOF ( Kang & Kim 2024 ) MOFs GPT \checkmark \checkmark \checkmark L 2 M 2 OF MOFs Qwen2.5 \checkmark \checkmark \checkmark \checkmark \checkmark L 2 M