MMCTOP: A Multimodal Textualization and Mixture-of-Experts Framework for Clinical Trial Outcome Prediction
Carolina Aparício, Qi Shi, Bo Wen, Tesfaye Yadete, Qiwei Han · 2025
Read MMCTOP: A Multimodal Textualization and Mixture-of-Experts Framework for Clinical Trial Outcome Prediction by Carolina Aparício, Qi Shi, Bo Wen, Tesfaye Yadete, Qiwei Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-21897.txt.
Introduction
Carolina Aparício, Qiwei Han, and their co-authors predict whether clinical trials will succeed, using a framework that fuses the very different kinds of data a trial generates. A trial's outcome depends on the drug's molecular structure, the protocol design and entry text, and the disease's place in ontologies. Combining such mixed signals is the hard part.
Their system, MMCTOP, first converts the structured inputs into controlled natural language, a step called schema-guided textualization, and checks the conversion kept the input faithfully. Encoders then produce embeddings for each modality. A transformer backbone with a sparse mixture-of-experts, conditioned on the drug and disease, fuses them, turning on only a few experts per input. On benchmarks the system improved precision, F1 score, and ranking over unimodal and multimodal baselines. Ablations credit both the textualization and the selective routing. Temperature scaling calibrates the probabilities.
Catalog record
| CREATOR | Carolina Aparício, Qi Shi, Bo Wen, Tesfaye Yadete, Qiwei Han |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-21897
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MMCTOP: A Multimodal Textualization and Mixture-of-Experts Framework for Clinical Trial Outcome Prediction Carolina Aparício, Qi Shi, Bo Wen, Tesfaye Yadete, Qiwei Han Abstract Addressing the challenge of multimodal data fusion in high-dimensional biomedical informatics, we propose MMCTOP, a M ulti M odal C linical- T rial O utcome P rediction framework that integrates heterogeneous biomedical signals spanning (i) molecular structure representations, (ii) protocol metadata and long-form eligibility narratives, and (iii) disease ontologies. MMCTOP couples schema-guided textualization and input-fidelity validation with modality-aware representation learning, in which domain-specific encoders generate aligned embeddings that are fused by a transformer backbone augmented with a drug–disease–conditioned sparse Mixture-of-Experts (SMoE). This design explicitly supports specialization across therapeutic and design subspaces while maintaining scalable computation through top- k routing. MMCTOP achieves consistent improvements in precision, F1, and AUC over unimodal and multimodal baselines on benchmark datasets, and ablations show that schema-guided textualization and selective expert routing contribute materially to performance and stability. We additionally apply temperature scaling to obtain calibrated probabilities, ensuring reliable risk estimation for downstream decision support. Overall, MMCTOP advances multimodal trial modeling by combining controlled narrative normalization, context-conditioned expert fusion, and operational safeguards aimed at auditability and reproducibility in biomedical informatics. I Introduction Clinical trials are the cornerstone of biomedical innovation, providing the mechanism through which new drugs and treatments are rigorously vetted for safety and efficacy before reaching patients. Yet the process remains plagued by inefficiencies, escalating costs, and low success rates; each failed study is a double loss, consuming scarce resources and delaying access to effective therapies [ 41 , 40 ] . The stakes are enormous: the global pharmaceutical industry, valued at $390 billion in 2000, has grown to exceed $1.5 trillion by 2024 [ 45 ] , intensifying pressure to streamline clinical development. Regulators, including the U.S. Food and Drug Administration (FDA), continue to emphasize improving the predictability and efficiency of clinical research to accelerate patient access [ 55 , 48 ] . Typically, clinical trial development proceeds through a structured, multi-phase pathway. Phase I trials evaluate pharmacokinetics, tolerability, and initial safety in small cohorts; Phase II trials assess preliminary efficacy alongside continued safety monitoring; and Phase III trials conduct large-scale, controlled evaluations against standard-of-care or placebo with heightened statistical rigor [ 48 ] . Although early-phase studies may show promising signals, a substantial fraction of programs fail in Phases II or III, where both financial and temporal stakes are highest. Late-stage failures are particularly costly: out-of-pocket expenditures for a single Phase III trial commonly range from $11.5 to $52.9 million, with additional downstream costs arising from extended timelines and delayed market entry [ 41 , 40 ] . The ability to anticipate trial outcomes, both within individual phases and across the full development trajectory, is therefore critical for portfolio de-risking, resource reallocation, and evidence-based decision-making in biomedical R&D [ 35 ] . In particular, clinical trial planning and evaluation increasingly depend on multimodal biomedical evidence. Structured representations, such as disease ontologies and diagnostic codes, provide standardized descriptions of indications and comorbidities; unstructured protocol narratives and eligibility criteria specify populations, endpoints, and operational constraints; and molecular representations encode mechanism-of-action, chemical feasibility, and pharmacological properties [ 36 , 30 ] . The integration of these heterogeneous data sources not only underpins recent advances in biomedical and health informatics, but also introduces a set of recurring challenges: (i) high-dimensional and heterogeneous inputs at scale , (ii) representation mismatch across graphs, hierarchies, tabular attributes, and long-form text, and (iii) privacy and security risks associated with fusing sensitive clinical descriptors and derived representations. Addressing these challenges requires end-to-end pipelines that are not only accurate, but also can reconcile heterogeneous modality encoders and representations within a coherent fusion framework rather than assuming a single universal input form. Early predictive models relied on hand-crafted features derived from narrow modalities such as pharmacokinetics or toxicity [ 35 , 15 , 47 ] , and later incorporated trial-design elements (e.g., cohort size, comparators, endpoints) and broader biomedical context [ 28 , 59 , 46 ] . While these models demonstrated feasibility, they often overfit to specific diseases or trial phases and struggled to generalize across indications, data modalities, and clinical settings [ 62 , 22 ] . These limitations stem in part from reliance on rigid fusion pipelines and tightly coupled encoders, which complicate extensibility when integrating new modalities or adapting to evolving biomedical knowledge. Advances in deep learning have broadened the methodological toolkit. Graph neural networks (GNNs) model drug–disease–target interactions through heterogeneous biomedical graphs [ 16 ] ; transfer learning adapts large-scale language models pretrained on biomedical corpora (e.g., BioBERT) for understanding protocol documents and clinical literature [ 25 ] ; and ensemble learning aggregates diverse predictors to improve robustness across treatment areas [ 39 ] . Despite this progress, multimodal integration remains an open challenge. Molecules are most naturally represented as graphs or SMILES sequences, diseases as ontological hierarchies, and trial protocols as long unstructured narratives; reconciling these representations within a unified predictive system introduces mismatches across structure, semantics, and granularity that complicate fusion, hinder onboarding of new modalities, and weaken cross-phase generalization [ 30 , 43 ] . Large Language Models (LLMs) offer a complementary paradigm for addressing some of these challenges by supporting textualization and normalization of heterogeneous biomedical inputs into structured natural-language artifacts [ 26 ] . In practice, however, robust clinical trial modeling continues to benefit from modality-appropriate encoders: molecular signals are most effectively captured by chemical language or structure models, while eligibility criteria and protocol narratives are better represented using biomedical language models. Accordingly, LLM-based textualization is best understood as an upstream engineering and governance layer that standardizes inputs, enforces schema conformance, and enables cross-field consistency checks, rather than as a replacement for domain-specific representation learning. Recent frameworks such as HINT and LIFTED illustrate the promise of integrating multimodal biomedical signals using hierarchical interaction modeling and expert routing [ 13 , 61 ] . Nevertheless, practical gaps remain in constructing auditable, schema-conformant, and clinically grounded pipelines that explicitly separate input normalization from representation learning, while supporting scalable and context-aware fusion across heterogeneous modalities. Importantly, clinical trial success is jointly constrained by biological plausibility and operational design . Molecular properties determine whether a compound can realistically modulate its intended target and disease pathway, while protocol structure governs patient selection, endpoints, and execution feasibility. MMCTOP explicitly bridges this divide by integrating bioinformatics-level molecular representation learning with clinical informatics signals from trial protocols and eligibility narratives, enabling outcome prediction that reflects both pharmacological feasibility and trial design realism. To address these challenges, we propose MMCTOP , a M ulti M odal C linical- T rial O utcome P rediction framework that standardizes heterogeneous trial signals via schema-guided textualization and grounding, encodes each modality using domain-specific transformers, and models cross-modality interactions using a transformer backbone augmented with a sparse Mixture-of-Experts (SMoE) mechanism. This design enables conditional specialization across drug–disease and protocol contexts while maintaining modularity through aligned embeddings and cached representations. More specifically, MMCTOP introduces three core design components: (i) a schema-guided textualization and normalization process that converts molecular structures, trial protocols, and disease ontologies into standardized narratives and slot-ordered fields with explicit validation constraints; (ii) automated input fidelity controls based on schema conformance and