Zero-Shot Open-Schema Entity Structure Discovery
Xueqiang Xu, Jinfeng Xiao, James Barry, Mohab Elkaref, Jiaru Zou, Pengcheng Jiang, Yunyi Zhang, Max Giammona, Geeth de Mel, Jiawei Han · 2025
Read Zero-Shot Open-Schema Entity Structure Discovery by Xueqiang Xu, Jinfeng Xiao, James Barry, Mohab Elkaref, Jiaru Zou, Pengcheng Jiang, Yunyi Zhang, Max Giammona, Geeth de Mel, Jiawei Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04458.txt.
Introduction
Xueqiang Xu and nine co-authors present ZOES, a method for pulling named things and their details out of text, in a 2025 paper. Such extraction feeds knowledge graphs, but current tools lean on fixed templates or labelled examples.
ZOES needs neither. It works in three passes: first it enriches a rough guess about an item and its details, then refines the guess, then merges the results into one clean structure. The idea is that the item and its details support each other, so improving one improves the other. Tests in three different subject areas showed that language models using ZOES pulled out fuller structures than the same models working alone. The method should carry over to new fields without fresh labelling.
Catalog record
| CREATOR | Xueqiang Xu, Jinfeng Xiao, James Barry, Mohab Elkaref, Jiaru Zou, Pengcheng Jiang, Yunyi Zhang, Max Giammona, Geeth de Mel, Jiawei Han |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-04458
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Zero-Shot Open-Schema Entity Structure Discovery Xueqiang Xu, Jinfeng Xiao, James Barry, Mohab Elkaref, Jiaru Zou, Pengcheng Jiang, Yunyi Zhang, Max Giammona, Geeth de Mel, Jiawei Han Abstract Entity structure extraction, which aims to extract entities and their associated attribute–value structures from text, is an essential task for text understanding and knowledge graph construction. Existing methods based on large language models (LLMs) typically rely heavily on predefined entity attribute schemas or annotated datasets, often leading to incomplete extraction results. To address these challenges, we introduce Zero-Shot Open-schema Entity Structure Discovery ( zoes ), a novel approach to entity structure extraction that does not require any schema or annotated samples. zoes operates via a principled mechanism of enrichment, refinement, and unification, based on the insight that an entity and its associated structure are mutually reinforcing. Experiments demonstrate that zoes consistently enhances LLMs’ ability to extract more complete entity structures across three different domains, showcasing both the effectiveness and generalizability of the method. These findings suggest that such an enrichment, refinement, and unification mechanism may serve as a principled approach to improving the quality of LLM-based entity structure discovery in various scenarios. 1 Introduction Figure 1: An example of the entity structure discovery task with applications. The figure depicts CEs of two discovered cells with their attributes and values organized as in the source passage from ( Zhu et al. 2023 ) . Automatic mining of structured entity information is critical for knowledge discovery and management ( Zhong et al. 2023a ; Arsenyan et al. 2024 ) . Prior works on entity information extraction—including relation extraction ( Ding et al. 2024 ; Zhou et al. 2024 ; Zhang et al. 2025 ) , entity typing ( Onoe and Durrett 2020 ; Tong et al. 2025 ) , and named entity recognition ( Li et al. 2020 ; Keraghel et al. 2024 ) —have primarily focused on extracting isolated aspects of entity knowledge. However, modeling only a single aspect of entity information may be insufficient for real-world applications ( Jiao et al. 2023 ; Dagdelen et al. 2024 ) . For example, in the battery science domain, a battery’s performance is determined by complex conditions Zhou et al. 2023 . As shown in Figure 1 , even for the same battery, its “Coulombic Efficiency” (CE) value varies across different cycles. A single triplet (e.g., \langle Cell Without the Additive, CE at First Cycle, 80.6% \rangle ) conveys limited information about the battery’s performance. In contrast, unifying performance across different conditions into a structured representation provides a clearer and more comprehensive view. Therefore, there is a need for a unified representation of entity information—one that integrates multiple aspects rather than focusing on a single one ( Lu et al. 2023 ) . Recently, closed-schema entity structure extraction has been proposed to unify various aspects of entity information under predefined type schemas, where each entity type is associated with a fixed set of attributes ( Zhong et al. 2023b ; Wu et al. 2024 ) . The goal is to extract structured entities represented as the entity along with a set of \langle\text{attribute},\text{value}\rangle pairs. By combining with the entity name to form \langle\text{entity},\text{attribute},\text{value}\rangle triplet, it can capture a specific property of the entity, as illustrated in Figure 1 . However, like other closed-schema information extraction tasks ( Li et al. 2021 ; Zhou et al. 2023 ) , entity type schemas confine the extraction on a limited set of attributes, which fail to capture diverse and unseen attributes in fast-evolving real-world scenarios Pai et al. 2024 . To enable entity structure extraction to capture more diverse and dynamic information, we extend traditional closed-schema entity structure extraction to an open information extraction setting ( Mausam 2016 ) , which we term Open-Schema Entity Structure Discovery (OpenESD). In OpenESD, we want to identify entities within user interests and their \langle\text{attribute},\text{value}\rangle structures without any predefined attribute sets as a schema. OpenESD can benefit many downstream tasks such as information retrieval ( Kang et al. 2024 ) and question answering ( Edge et al. 2025 ; Gutiérrez et al. 2025 ; Jiang et al. 2025 ) . With an open-schema setting, OpenESD goes beyond straightforward extraction: it demands discovering ( Jiao et al. 2023 ) , organizing ( Wu et al. 2024 ) , and inferring ( Ding et al. 2024 ) the most appropriate attributes and values for each entity. Large language models (LLMs) with extensive parametric knowledge have demonstrated promising performance in open information extraction ( Jiao et al. 2022 ; Lu et al. 2023 ) , offering a promising solution for OpenESD. However, fully harnessing this capability remains challenging. (i) Extraction Coverage : An LLM tends to capture coarse-grained facts that are more frequent in its parametric knowledge while missing rare, fine-grained information from the context. (ii) Extraction Granularity : When the context contains rich details, LLMs may fail to identify the appropriate level of granularity for representing the extracted information, resulting in incomplete or ambiguous structures. For example, as illustrated in Figure 1 , if the extracted “CE” attributes fail to capture contextual conditions, multiple “CE” values may be incorrectly mapped to the same attribute, leading to inaccurate results. To enhance LLMs’ capability on OpenESD, we introducing zoes , a z ero-shot o pen-schema e ntity s tructure discovery framework. By employing a principled mechanism of enrichment, refinement, and unification, zoes effectively extracts structured entity information without supervision. Specifically, zoes starts with the LLM’s zero-shot \langle\text{attribute},\text{value}\rangle triplets results, then gradually discovers new triplets to enrich it. Next, zoes leverages mutual dependencies among triplet elements to identify and refine inferior triplets. Finally, the refined triplets are aggregated into entity structures as coherent representations of the entities based on user interest. We evaluate zoes using different backbone models on one long-tail domain: Battery Science and two general domains: Economics and Politics . The results demonstrate that zoes can consistently outperform baselines with different backbone models in all domains. zoes achieves an absolute improvement of +10.64\% in the F1 score. These results demonstrate the effectiveness and generalizability of our method for OpenESD. Our contributions are summarized as follows. 1. We introduce open-schema entity structure discovery, a task to automatically identify entities within user interest along with their contextual \langle\text{attribute},\text{value}\rangle structures without any predefined schema, which can benefit several knowledge intensive tasks. 2. We propose zoes , a zero-shot open-schema entity structure discovery method. By the enrich-refine-unify strategy, zoes substantially improves LLMs’ performance on OpenESD. 3. We construct labeled datasets on three very different domains and comprehensively evaluate zoes and baselines to further study LLMs’ capabilities on OpenESD. 2 Related Work 2.1 Open Information Extraction Open Information Extraction (OpenIE) aims to extract structured information from unstructured text without relying on predefined schemas ( Zhou et al. 2022 ; Pai et al. 2024 ) . Early OpenIE relied on rule-based methods ( Del Corro and Gemulla 2013 ; Mausam 2016 ) , sequence labeling ( Ro et al. 2020 ; Vasilkovsky et al. 2022 ; Yu et al. 2021 ) , or sequence-to-sequence models ( Kolluru et al. 2022 ) to extract relational triplets from individual sentences. However, sentence-level relation extractions cannot capture cross-sentence relational information ( Dunn et al. 2022