Summarization for Generative Relation Extraction in the Microbiome Domain

Oumaima El Khettari \up 1, Solen Quiniou \up 1, Samuel Chaffron \up 1 · 2025

Read Summarization for Generative Relation Extraction in the Microbiome Domain by Oumaima El Khettari \up 1, Solen Quiniou \up 1, Samuel Chaffron \up 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08647.txt.

Introduction

Oumaima El Khettari, Solen Quiniou, and Samuel Chaffron test whether summarizing a text first helps machines pull relations from it, in a research paper from 2025. Their field is the gut microbiome, where interactions among microbes matter and labeled data are scarce. Relation extraction names the links between entities in a passage.

Their pipeline uses a large language model to summarize the passage, which trims noise before a second model extracts the relations. Early results on a dedicated corpus show the summary step lifts the generative method's scores. Classic BERT-based extractors still beat the generative route for now. The authors frame the work as ongoing proof that generative tools can serve niche, low-resource fields.

Catalog record

CREATOROumaima El Khettari \up 1, Solen Quiniou \up 1, Samuel Chaffron \up 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-08647

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Summarization for Generative Relation Extraction in the Microbiome Domain Oumaima El Khettari \up 1, Solen Quiniou \up 1, Samuel Chaffron \up 1 Abstract Résumé Résumé automatique pour l’extraction générative de relations dans le domaine du microbiome Nous explorons une approche générative pour l’extraction de relations, adaptée à l’étude des interactions dans le microbiote intestinal, un domaine biomédical complexe et faiblement doté en données annotées. Notre méthode s’appuie sur le résumé automatique par des grands modèles de langage, pour affiner le contexte, avant d’extraire les relations via une génération guidée par instruction. Les premiers résultats sur un corpus dédié montrent que le résumé automatique améliore les performances de l’approche générative en réduisant le bruit et en orientant le modèle. Cependant, les méthodes d’extraction de relations à l’aide de modèles de type BERT restent plus performantes. Ce travail en cours met en évidence le potentiel des approches génératives pour l’étude de domaines spécialisés en contexte de faibles ressources. We explore a generative relation extraction (RE) pipeline tailored to the study of interactions in the intestinal microbiome, a complex and low-resource biomedical domain. Our method leverages summarization with large language models (LLMs) to refine context before extracting relations via instruction-tuned generation. Preliminary results on a dedicated corpus show that summarization improves generative RE performance by reducing noise and guiding the model. However, BERT-based RE approaches still outperform generative models. This ongoing work demonstrates the potential of generative methods to support the study of specialized domains in low-resources setting. Mots-clés : Extraction de relations générative, Ajustement par instruction, Domaine à faible ressources, Microbiome. Keywords : Generative Relation Extraction, Instruction-tuning, Low-Resource Domain, Microbiome. 1 Introduction The biomedical field is witnessing a rapid expansion in the study of specialized subdomains under the scope of NLP He et al., 2023 , such as the microbiome interactions Hogan et al., 2024 . The study of the gut microbiome is of high importance Heintz-Buschart & Wilmes, 2018 , as it is a key modulator of human health, influencing gastrointestinal diseases like Inflammatory Bowel Disease, metabolic and neurological conditions such as Parkinson’s disease and depression Shreiner et al., 2015 ; Góralczyk-Bińkowska et al., 2022 ; Borrego-Ruiz & Borrego, 2025 . Its role in immune regulation, nutrient metabolism, and the gut-brain axis has made it a focal point for biomedical research. However, the microbiome remains insufficiently characterized, especially at the species interaction level, due to the vast diversity of microbes Zhang et al., 2025 , variation in microbial communities from one individual to another, and the scattered, often implicit, nature of knowledge in scientific publications. The areas involving this subdomain are often underrepresented in large-scale annotated corpora, making them inherently low-resource for tasks such as information extraction. Among these, relation extraction (RE) is essential for structuring biomedical knowledge and supporting downstream applications like knowledge graph construction and hypothesis generation. Traditional RE methods typically rely on supervised learning with manually annotated data, which is often scarce or unavailable in emerging subdomains. However, the recent rise of LLMs, pre-trained on extensive corpora, has opened new avenues for addressing low-resource scenarios. These models can be adapted to information extraction task to be performed in a generative manner Zhu et al., 2023 ; Xu et al., 2024 . In a low resource setting, the generative paradigm can offer flexibility in dealing with unseen relation types and complex, context-rich inputs. In this work, we explore how such models can be leveraged to improve RE in a low-resource biomedical domain, particularly through a generative approach using summarization and instruction tuning. The contributions of this work are as follows: • We conduct a comprehensive comparison of zero-shot, instruction-tuned, and encoder-based approaches for document-level biomedical relation extraction, highlighting their strengths and limitations ; • We show that combining summarization with instruction tuning significantly improves generative model performance, especially for smaller models in low-resource settings ; • We provide insights into model behavior, focusing on hallucinations, output consistency, and adherence to predefined labels in generative models. 2 Related Work RE is a fundamental task in biomedical NLP, that consists in identifying and classifying semantic relations between entities of interest. Since this task is modeled as a classification problem, the dominant approaches have used supervised classification models, such as convolutional neural networks Liu et al., 2016 ; Gu et al., 2017 , recurrent neural networks Jettakul et al., 2019 ; Mandya et al., 2018 , and Transformer-based encoders Lee et al., 2020 ; Gu et al., 2021 ; Beltagy et al., 2019 . More recently, the emergence of LLMs has shifted the paradigm from discriminative to generative approaches in RE Wadhwa et al., 2023 . For example, Asada & Fukuda, 2024 investigated RE, using GPT models, from standard biomedical RE datasets, including EU-ADR Van Mulligen et al., 2012 , GAD Bravo et al., 2015 , and ChemProt Islamaj Doğan et al., 2019 . While their use shows promise, they underperform compared to domain-specific models like BioBERT Lee et al., 2020 and PubMedBERT Gu et al., 2021 . Another study proposed a novel RE method enhanced by LLMs, incorporating techniques such as in-context few-shot learning and chain-of-thought reasoning to improve performance Zhang et al., 2024a . More specifically, the study of protein-protein interactions as been treated as a binary task Rehana et al., 2024 ; Chang et al., 2025 . Rehana et al., 2024 compared Masked Language Models with different 2 GPT models using different techniques, and concludes that BERT models perform better on complex datasets, while GPT models can be just as effective on simpler ones. Chang et al., 2025 investigated the effect of prompt engineering on the same task and showed that domain-specific prompts significantly enhance the performance of two GPT models. However, a key limitation of these generative approaches is that they are usually evaluated on standard biomedical RE datasets that are either binary or with a limited number of relation types. Brokman et al., 2025 applied their method to several biomedical datasets, including BioRED Luo et al., 2022 , a manually annotated corpus with eight relation types and four entity types. This makes BioRED one of the datasets most comparable to our use case in terms of entity and relation diversity. On this dataset, reported F1-scores remained below 10% with GPT-4 and reached 23.2% with OpenAI o1. It is important to note, however, that their evaluation is end-to-end, including both named entity recognition and RE, rather than focusing only on relation classification. Furthermore, BioRED does not focus on a specific low-resource subfield. LLMs have significantly advanced text summarization, moving beyond extractive methods Erkan & Radev, 2004 ; Mihalcea & Tarau, 2004 ; Nallapati et al., 2017 to enable fluent and context-aware generation Lewis et al., 2020 ; Gupta & Gupta, 2019 . Modern summarization systems can synthesize information across sentences, rephrase content, and adapt to various domains, including scientific and medical texts Goyal et al., 2022 ; Zhang et al., 2024b . Recent directions further explore personalized Pu et al., 2023 , human-in-the-loop Chen et al., 2023 , and real-time summarization, reflecting a shift toward more interactive and user-adaptive systems. These advances highlight the role of LLMs in redefining summarization as a dynamic and domain-sensitive task. Summarization and RE share similar challenges, as both require identifying and condensing

Read the complete text