Explicit vs. Implicit Biographies: Evaluating and Adapting LLM Information Extraction on Wikidata-Derived Texts

Alessandra Stramiglio, Andrea Schimmenti, Valentina Pasqual, Marieke van Erp, Francesco Sovrano Fabio Vitali · 2025

Read Explicit vs. Implicit Biographies: Evaluating and Adapting LLM Information Extraction on Wikidata-Derived Texts by Alessandra Stramiglio, Andrea Schimmenti, Valentina Pasqual, Marieke van Erp, Francesco Sovrano Fabio Vitali (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14943.txt.

Introduction

Alessandra Stramiglio leads a team of six authors testing how well language models extract facts from biographies that state things indirectly, in a 2025 natural language processing paper. Information extraction systems traditionally rely on explicit statements. Human readers infer far more: a sentence about attending church every Sunday quietly signals a person's religion.

The team built two synthetic datasets of ten thousand texts each, one stating biographic facts explicitly and one implying them, all derived from Wikidata. They measured extraction performance for three pre-trained models and checked whether fine-tuning on implicit examples improves general reasoning about hints. The study probes the internal reasoning of the models, asking where indirect language breaks them. Findings matter for any system that mines real-world text, where facts are often implied rather than declared.

Catalog record

CREATORAlessandra Stramiglio, Andrea Schimmenti, Valentina Pasqual, Marieke van Erp, Francesco Sovrano Fabio Vitali
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-14943

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explicit vs. Implicit Biographies: Evaluating and Adapting LLM Information Extraction on Wikidata-Derived Texts Alessandra Stramiglio, Andrea Schimmenti, Valentina Pasqual, Marieke van Erp, Francesco Sovrano Fabio Vitali Abstract Text Implicitness has always been challenging in Natural Language Processing (NLP), with traditional methods relying on explicit statements to identify entities and their relationships. From the sentence "Zuhdi attends church every Sunday", the relationship between Zuhdi and Christianity is evident for a human reader, but it presents a challenge when it must be inferred automatically. Large language models (LLMs) have proven effective in NLP downstream tasks such as text comprehension and information extraction (IE). This study examines how textual implicitness affects IE tasks in pre-trained LLMs: LLaMA 2.3, DeepSeekV1, and Phi1.5. We generate two synthetic datasets of 10k implicit and explicit verbalization of biographic information to measure the impact on LLM performance and analyze whether fine-tuning implicit data improves their ability to generalize in implicit reasoning tasks. This research presents an experiment on the internal reasoning processes of LLMs in IE, particularly in dealing with implicit and explicit contexts. The results demonstrate that fine-tuning LLM models with LoRA (low-rank adaptation) improves their performance in extracting information from implicit texts, contributing to better model interpretability and reliability. The implementation of our study can be found at ImplicitKnowledge 1 Introduction Information Extraction (IE) seeks to identify, classify, and represent entities from unstructured textual sources. Large Language Models (LLMs) significantly improved Natural Language Processing (NLP) performance in IE, demonstrating remarkable capabilities in tasks such as text comprehension, classification, Named Entity Recognition (NER) and Relationship Extraction (RE) Niklaus et al. 2018 ; Fu et al. 2023 . Conventional approaches (e.g., rule-based, deep learning) predominantly rely on explicit statements to extract entities, relations, and events Alt et al. 2020 . However, real-world texts also convey information implicitly, requiring inferential processing to derive the intended meaning. Implicit meaning arises when information is conveyed indirectly through linguistic and cognitive mechanisms rather than explicitly stated where contextual reasoning and pragmatic inference are required to perform correct interpretations Yule 1996 ; Evans 2012 ; Fischer 2017 . The sentence "Zuhdi attends church every Sunday " suggests Zuhdi is likely Christian, as this inference is drawn from a religious frame, requiring additional knowledge to make sense of what is not explicit. Similarly, the statement "Sarah received her degree from Oxford University on June 15, 2010 , and celebrated her 20th birthday the same day " implies she was born on June 15, 1990, establishing a temporal entailment that is not explicitly stated. Biographical texts present a challenging case for information extraction due to their reliance on the implicit use of language. Although these texts do not require specialized domain knowledge for comprehension, they present a moderate level of complexity Tint et al. 2024 . Such complexity arises from the relationships between entities, temporal dependencies, and occupational references, which are often inferred through contextual cues rather than explicitly stated. This study investigates the impact of textual implicitness on LLM-based IE tasks, tackling two main research questions (RQs): • RQ1: How do implicit and explicit verbalizations affect LLM performance in information extraction tasks? • RQ2: How does exposure to implicit data during fine-tuning affect an LLM’s ability to generalize to implicit reasoning tasks? Since LLMs often exhibit difficulty in extracting information from implicit contexts Tint et al. 2024 , we explore whether fine-tuning can mitigate this difficulty. Specifically, we investigate the impact of fine-tuning on well-known models from the community such as LLama3.2 AI 2024 , DeepSeekV1 DeepSeek-AI et al. 2025 , and Phi1-5 Li et al. 2023 . This is particularly relevant for scenarios where critical information is conveyed implicitly rather than explicitly. Our findings contribute to improving model reliability and expanding potential applications. We focus on two datasets, one explicit and one implicit, containing natural language descriptions of people’s biographies. The texts were synthetically generated starting from a Wikidata triple dataset. By fine-tuning models on implicit patterns which mimic real-world scenarios, we assess their ability to extract information from implicit texts. This contribution is summarized as follows: Section 2 lays the background of this work, Section 3 presents the adopted methodology to provide an answer to RQ1 and RQ2. Our results are presented and discussed in Section 4 . Finally, 5 outlines our final remarks and future works. 2 Background and Related Work IE focuses on structuring data, e.g. in the form of a triple , where two arguments are connected through a relation. Usually, this takes the form of a triple composed of a subject , a predicate and an object , as <s, p, o> Niklaus et al. 2018 . This task is usually defined as Relationship Extraction (RE). One inner distinction is the difference between Closed and Open RE. Closed RE focuses on finding arguments given one or more constraints (e.g., <s, p, ?o> - where the object is the only unknown value), while Open RE looks for any potential triple in a text (e.g. <?s, ?p, ?o>) instead. Traditional RE models primarily identify triples where elements (subjects, predicates, and objects) have explicit textual mentions. These models are trained to recognize explicit linguistic markers (such as verbs functioning as predicates) but often struggle with implicit relationships that require common sense knowledge or deeper natural language understanding Pei et al. 2023 . Pre-trained Language Models (PTLMs) and LLMs represent the state-of-the-art for unsupervised Open IE tasks Fu et al. 2023 , as they can process implicit information more effectively than previous approaches. The role of implicit and explicit knowledge has been extensively studied in cognitive science. According to Dienes and Perner’s theory, implicitness arises when information is conveyed indirectly through the functional use or conceptual structure of explicit representations, rather than being directly represented Dienes and Perner 1999 . In RE, being able to identify relationships with different levels of explicitness presents a significant challenge. LLMs have shown that while these models can effectively process explicit information, they still struggle with implicit knowledge that requires commonsense reasoning Ilievski 2024 . The dimensions of implicit relationships can vary significantly based on: • The level of inference required (from simple logical deduction to complex contextual reasoning) • The type of background knowledge needed (from common facts to domain expertise) • The cultural and temporal context necessary for understanding The degree of implicitness in information also directly impacts the certainty with which models can retrieve and reason about that information. While explicit statements can be processed with high confidence, implicit information introduces varying levels of uncertainty that models must learn to handle appropriately. Datasets for RE usually prioritize explicitly stated information. For instance, RED Huguet Cabot et al. 2023 , a widely used RE dataset, focuses on extracting triples that directly match sentences found in the text. RED provides entity types and relationships without enforcing additional structural constraints, such as predefined categories for entities or specific restrictions on how relationships should be formed - the domain and range of the predicate (see Table 1 ) 1 1 1 The dataset entry was extracted from https://huggingface.co/datasets/Babelscape/REDFM . Subject Predicate Object Émilie Andéol sport judo Source text: "Émilie Andéol […]is a French judoka competing in the women’s +78 kg division." Table 1: Example of a RED

Read the complete text