LA-MARRVEL: A Knowledge-Grounded and Language-Aware LLM Reranker for AI-MARRVEL in Rare Disease Diagnosis
Jaeyeon Lee, 1,2 Hyun-Hwan Jeong, 1,2* Zhandong Liu 1,2,3,* 1 Department of Pediatrics, Baylor College of Medicine, Houston, Texas, 77030 2 Jan and Dan Duncan Neurological Research Institute, Texas Children’s Hospital, Houston, Texas, 77030 3 Quantitative and Computational Biosciences program, Baylo · 2025
Read LA-MARRVEL: A Knowledge-Grounded and Language-Aware LLM Reranker for AI-MARRVEL in Rare Disease Diagnosis by Jaeyeon Lee, 1,2 Hyun-Hwan Jeong, 1,2* Zhandong Liu 1,2,3,* 1 Department of Pediatrics, Baylor College of Medicine, Houston, Texas, 77030 2 Jan and Dan Duncan Neurological Research Institute, Texas Children’s Hospital, Houston, Texas, 77030 3 Quantitative and Computational Biosciences program, Baylo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02263.txt.
Introduction
Jaeyeon Lee, Lin Yao, Hyun-Hwan Jeong, and Zhandong Liu speed up the hunt for the gene behind a rare disease. Clinicians must match a patient's symptoms against genes carrying suspicious variants, across sprawling and inconsistent evidence sources, which makes interpretation slow. Their system, LA-MARRVEL, adds a language-model reranking layer on top of an existing prioritisation pipeline rather than replacing it.
The framework improved top-rank accuracy by twelve to fifteen percentage points over established approaches across three real-world patient cohorts, including cases where the true gene had initially been ranked low. The biggest contributor was prompt construction: giving the model rich, structured phenotype descriptions beat using disease labels alone. For each candidate gene the system also writes an auditable explanation aligned with clinical guidelines, weighing how well symptoms fit, the inheritance pattern, and the variant evidence.
Catalog record
| CREATOR | Jaeyeon Lee, 1,2 Hyun-Hwan Jeong, 1,2* Zhandong Liu 1,2,3,* 1 Department of Pediatrics, Baylor College of Medicine, Houston, Texas, 77030 2 Jan and Dan Duncan Neurological Research Institute, Texas Children’s Hospital, Houston, Texas, 77030 3 Quantitative and Computational Biosciences program, Baylo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-02263
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LA-MARRVEL: A Knowledge-Grounded and Language-Aware LLM Reranker for AI-MARRVEL in Rare Disease Diagnosis Jaeyeon Lee, 1,2 Hyun-Hwan Jeong, 1,2* Zhandong Liu 1,2,3,* 1 Department of Pediatrics, Baylor College of Medicine, Houston, Texas, 77030 2 Jan and Dan Duncan Neurological Research Institute, Texas Children’s Hospital, Houston, Texas, 77030 3 Quantitative and Computational Biosciences program, Baylor College of Medicine, Houston, Texas, 77030 * Co-corresponding authors: [email protected], [email protected] Abstract Abstract Diagnosing rare diseases often requires connecting variant-bearing genes to evidence that is written as unstructured clinical prose, which the current established pipelines still leave for clinicians to reconcile manually. To this end, we introduce LA-MARRVEL, a knowledge-grounded and language-aware reranking layer that operates on top of AI-MARRVEL: it supplies expert-engineered context, queries a large language model multiple times, and aggregates the resulting partial rankings with a ranked voting method to produce a stable, explainable gene ranking. Evaluated on three real-world cohorts (BG, DDD, UDN), LA-MARRVEL consistently improves Recall@K over AI-MARRVEL and established phenotype-driven tools such as Exomiser and LIRICAL, with especially large gains on cases where the first-stage ranker placed the causal gene lower. Each ranked gene is accompanied by LLM-generated reasoning that integrates phenotypic, inheritance, and variant-level evidence, thereby making the output more interpretable and facilitating clinical review. Introduction Rare diseases affect millions of people 8 , yet each single condition is uncommon and often hard to diagnose. Many patients wait 4.7 years for an answer 6 . Modern DNA and RNA tests can identify genes that may explain a person’s symptoms, but they typically return a long list of candidates 21 , 19 . Clinicians then have to verify across papers, databases, and case reports to decide which genes truly match the patient. This step is labor-intensive and time-consuming, and it is easy to overlook critical details embedded within plain language 3 . Large language models (LLMs) can read and explain complex medical texts. For example, the recent models show higher than 95% accuracy for a USMLE (United States Medical Licensing Examination)-style benchmark 14 , 25 . However, we previously showed that LLMs may exhibit bias toward well-studied genes and sensitivity to the ordering of candidate genes, which can compromise the reliability of gene-ranking results 20 . These limitations suggest that, for clinical decision-support tasks, LLMs require grounding and stability: linking outputs to citable knowledge (grounding) and producing consistent responses across repeated runs (stability). Without these properties, even strong language skills are not enough for safe clinical use 28 , 2 . A major reason for this challenge is that medical knowledge is largely written as free text; a large proportion of clinical data is found in this unstructured form 18 . Even when symptoms and inheritance are encoded using ontologies, converting them into simple tabular formats for traditional machine learning still demands extensive normalization and feature engineering 7 or loses important context. The computational gene-prioritization tools for rare-disease diagnosis are typically used as a high-recall first stage to filter/rank an initial list of candidate genes, identifying many plausible targets but still leaving a few false positives 13 . Turning a long gene list into a short, trustworthy set of likely genes requires careful reading of unstructured text and cross-checking sources —the kind of labor-intensive task that diverts valuable time and attention from busy clinical practices 4 , 5 . To bridge these gaps, we introduce LA-MARRVEL, a language-aware reranking system that sits on top of a knowledge-driven high-recall pipeline. Rather than supplanting established bioinformatics tools, our goal is to further prioritize candidate genes, yielding a more concise, accurate, and defensible list. LA-MARRVEL brings together three pieces. First, we provide expert-engineered context: curated phenotype and disease information that gives the model the right facts at the right time. Second, we use a ranked voting method (Tideman’s method) 24 to combine multiple responses into a single, consensus gene order. The ranked voting method decreases randomness and favors choices supported by repeated evidence. Lastly, we integrate this layer with the AI-MARRVEL pipeline 17 , which already produces strong first-stage ranks and gene annotations. ( ) We evaluate LA-MARRVEL on three real-world patient cohorts —Baylor Genetics (BG), Deciphering Developmental Disorders (DDD), and the Undiagnosed Diseases Network (UDN). These datasets come from independent cohorts which are representative of cases commonly encountered in clinical practice. We compare our approach to widely used diagnostic tools (e.g., Exomiser 13 and LIRICAL 23 ) and to general-purpose LLMs. Across the three cohorts, we demonstrated LA-MARRVEL improves top-rank accuracy without compromising recall, resulting in more reliable prioritization of the causal gene and consequently reducing the downstream review burden. A notable advantage of LA-MARRVEL is its transparency. For each ranked gene, the system provides plain-language explanations of how the patient’s phenotypes correspond to the gene’s known disease features and how the observed variants accord with the expected mode of inheritance. As the explanation is derived from expert knowledge and produced using a consensus-based methodology, LA-MARRVEL helps clinicians can more confidently evaluate and rely on the analytic result. Consequently, clinician effort can be redirected from preliminary data triage toward substantive clinical decision. Results LLMs Require a First-Stage Ranker for Effective Prioritization We evaluated all methods using Recall@K (i.e., the fraction of cases in which the causal gene appears within the top- k ranked candidates) and found that directly prompting state-of-the-art LLMs to name causal genes performs poorly compared with any of the established gene-prioritization algorithms. In our evaluation ( ), prompt-only LLMs ( Claude and Claude-Thinking , both without AI-MARRVEL) recover only ~12–15% of cases at Recall@1, far below Exomiser (~50%), LIRICAL (~31%), and LA-MARRVEL (~78%). The gap persists at wider review windows: at Top-5/Top-10, LLM-only recall remains ~37–55% versus ~75–85% for classical tools and ~95–98% for LA-MARRVEL; even at Top-100 they plateau around ~70–76% compared with ~96–99% for the other methods. These results indicate that LLMs are not reliable stand-alone retrieval engines for rare-disease gene discovery when they are given the exhaustive list of all variant-bearing genes for each patient (benign and pathogenic alike). Faced with a long tail of gene–phenotype links and a noisy, unfiltered candidate set, they miss true genes at clinically useful top- k cutoffs; free-form generation adds off-list distractors and hallucinated rationales; and reasoning alone (“Thinking”) yields only modest gains. By contrast, pairing an LLM with a high-recall first-stage ranker (AI-MARRVEL) focuses the model on a comprehensive, evidence-grounded candidate set, enabling phenotype-aware judgment where it excels. Consequently, LA-MARRVEL’s rank-then-rerank design is essential for achieving high precision at the top ranks while maintaining near-ceiling recall. LA-MARRVEL Outperforms Gene-Prioritization Algorithms Across Three Independent Datasets Having established that LLMs benefit from a high-recall first-stage ranker, we benchmarked LA-MARRVEL against widely used phenotype-driven gene-prioritization methods (Exomiser and LIRICAL) and an internal baseline (AI-MARRVEL) on three independent cohorts — BG, DDD, and UDN — using the same Recall@K metric ( ). Across all datasets and all K values ( K=1 –10), LA-MARRVEL consistently achieved the highest recall . At the clinically salient low- K thresholds, LA-MARRVEL showed the largest gains: at Top-1 and Top-3 it improved by roughly 5–10 percentage points over AI-MARRVEL , 20–30 points over Exomiser , and 30–45 points over LIRICAL . The advantage is especially pronounced on UDN, where LA-MARRVEL reaches ~90% by Top-3 while the next-best method