Can Large Language Models Match the Conclusions of Systematic Reviews?

Christopher Polzak*, Alejandro Lozano*, Min Woo Sun*, James Burgess, Yuhui Zhang, Kevin Wu, Serena Yeung-Levy · 2025

Read Can Large Language Models Match the Conclusions of Systematic Reviews? by Christopher Polzak*, Alejandro Lozano*, Min Woo Sun*, James Burgess, Yuhui Zhang, Kevin Wu, Serena Yeung-Levy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22787.txt.

Introduction

Christopher Polzak and six co-authors test whether language models can match expert reviews of medical evidence, in this 2025 paper. Systematic reviews, where experts weigh all studies on a question, anchor clinical choices and policy. With papers piling up, many hope AI can draft such reviews. Whether models judge evidence like experts was poorly measured.

Their benchmark, MedEvidence, pairs 100 published reviews with the very studies behind them. They ran 24 models, from small to huge, through the set. Surprises followed: step-by-step reasoning did not reliably help, bigger models did not always win, and medical fine-tuning hurt accuracy. Scores fell as documents grew longer, models sounded overconfident, and none showed the skepticism experts apply to weak studies. The authors release the benchmark and warn that review automation is not ready.

Catalog record

CREATORChristopher Polzak*, Alejandro Lozano*, Min Woo Sun*, James Burgess, Yuhui Zhang, Kevin Wu, Serena Yeung-Levy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22787

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can Large Language Models Match the Conclusions of Systematic Reviews? Christopher Polzak*, Alejandro Lozano*, Min Woo Sun*, James Burgess, Yuhui Zhang, Kevin Wu, Serena Yeung-Levy Abstract Systematic reviews (SR), in which experts summarize and analyze evidence across individual studies to provide insights on a specialized topic, are a cornerstone for evidence-based clinical decision-making, research, and policy. Given the exponential growth of scientific articles, there is growing interest in using large language models (LLMs) to automate SR generation. However, the ability of LLMs to critically assess evidence and reason across multiple documents to provide recommendations at the same proficiency as domain experts remains poorly characterized. We therefore ask: Can LLMs match the conclusions of systematic reviews written by clinical experts when given access to the same studies? To explore this question, we present MedEvidence, a benchmark pairing findings from 100 SRs with the studies they are based on. We benchmark 24 LLMs on MedEvidence, including reasoning, non-reasoning, medical specialist, and models across varying sizes (from 7B-700B). Through our systematic evaluation, we find that reasoning does not necessarily improve performance, larger models do not consistently yield greater gains, and knowledge-based fine-tuning degrades accuracy on MedEvidence. Instead, most models exhibit similar behavior: performance tends to degrade as token length increases, their responses show overconfidence, and, contrary to human experts, all models show a lack of scientific skepticism toward low-quality findings. These results suggest that more work is still required before LLMs can reliably match the observations from expert-conducted SRs, even though these systems are already deployed and being used by clinicians. We release our codebase 1 1 1 https://github.com/zy-f/med-evidence and benchmark 2 2 2 https://huggingface.co/datasets/clcp/med-evidence ∗ Equal contributions: {clcp, lozanoe, minwoos}@stanford.edu to the broader research community to further investigate LLM-based SR systems. 1 Introduction Figure 1 : Core skills evaluated by MedEvidence including: medical domain expertise across 10 different specialties, synthesizing conflicting evidence, and applying scientific skepticism when studies exhibit a high risk of bias (e.g. due to small sample sizes or insufficient supporting evidence). As the number of published articles grows exponentially [ 1 ] , manually synthesizing findings from multiple sources has become highly time-consuming. Thus, there is growing interest in developing automatic tools to process, synthesize, and extract insights from scientific literature [ 2 , 3 ] . In particular, large language model (LLM)-based systems could offer a promising solution for supporting and automating tasks such as conducting systematic reviews (SRs), which typically take an average of 67 weeks of intensive human effort [ 4 , 5 ] . For example, several LLM-assisted tools such as Deep Research [ 6 , 7 ] , Elicit [ 8 ] , and Open Evidence [ 9 ] , have already been deployed and can be incorporated into the SR process to improve efficiency [ 4 ] . The momentum behind these technologies is further exemplified by the U.S. Food and Drug Administration’s launch of an LLM-assisted scientific review pilot on May 2025 [ 10 ] . However, despite multiple deployments and efforts assessing scientific synthesis generation, the behavior of LLMs across key variables that influence generation remains poorly understood. In particular, their ability to synthesize findings from multiple studies—each varying in study type, population size, and risk of bias—and to navigate conflicting evidence (as medical findings may contradict one another) is not well-characterized. Understanding these behaviors is essential, as medical knowledge is continually reshaped by new clinical trials, cohort studies, and expert opinions. Thus, like medical professionals do, LLMs must be capable of integrating the latest findings (e.g. via retrieval augmentation) [ 11 ] , weighing the strength of varying evidence, and applying appropriate skepticism when needed to produce reliable, up-to-date recommendations (as shown in Figure 1 ). While prior work has successfully evaluated LLMs on their internal "static" medical knowledge [ 12 , 13 ] , assessing LLMs’ capability to reason across multiple sources and draw expert-level conclusions remains a significant challenge. Specifically, previous efforts have often evaluated LLMs’ ability to generate summaries on a given topic. This approach requires a thorough review of every detail in the generated content and lacks easily verifiable ground truth; therefore, medical experts are typically needed to assess output accuracy [ 14 , 15 , 16 , 17 , 18 ] , making evaluation time-consuming and hard to scale. To address this, we remove the complexity of evaluating long-format summaries and retrieving relevant papers to pose an even simpler, but fundamental question: Can LLMs replicate the individual conclusions of expert-written SRs when provided with the same source studies? We explore this question in a controlled setting by collecting open-access SRs along with their associated reference articles. We then extract individual findings and reformat them into a closed question-answering (QA) task to simplify evaluation. To this end, we introduce the following contributions: • MedEvidence Benchmark We introduce MedEvidence, a human-curated benchmark of 284 questions curated from the conclusions of 100 open-access SRs across 10 medical specialties. Each question evaluates comparative treatment effectiveness on clinical outcomes. All questions are manually transformed into closed-form question answering to enable large-scale evaluation. In addition, human annotators extract evidence quality (based on the SR’s analysis), determine whether full-text access is necessary, and collect the relevant sources needed to replicate the SR findings. • Large-scale evaluation on MedEvidence We leverage MedEvidence to perform an in-depth analysis of 24 LLMs spanning general-domain, medical-finetuned, and reasoning models. By utilizing MedEvidence’s metadata, we dissect and examine success and failure modes, helping to identify targeted directions for future work. 2 Related work Table 1 : Comparison of factuality and evidence reasoning benchmarks with medical focus. We compare MedEvidence to prior datasets across attributes relevant to systematic review-style reasoning. MedEvidence is the only dataset to satisfy all criteria. Dataset Size Topic Curation Expert-Grounded Answer Automated Evaluation Multiple Sources Evidence Quality Source-Level Concordance Reason et al. 4 Medicine Human ✓ ✗ ✓ ✗ ✗ Schopow et al. 1 Medicine Human ✓ ✗ ✓ ✗ ✗ MedREQAL 2786 Medicine LLM ✓ ✓ ✗ ✓ ✗ HealthFC 750 Consumer Health Human ✓ ✓ ✗ ✓ ✗ ConflictingQA 238 Multi-Domain LLM ✗ ✗ ✓ ✗ ✓ MedEvidence 284 Medicine Human ✓ ✓ ✓ ✓ ✓ An overview of related works and the key distinct contributions of our current work are summarized in Table 1 . LLM-based medical systematic review Numerous studies have explored the potential of LLMs to automate various aspects of scientific literature review, including literature search, query augmentation, screening, data extraction, bias assessment, narrative synthesis, and answering simple clinical inquiries [ 19 , 20 ] . However, larger-scale evaluations of LLM-based SR or meta-analyses generation remain relatively underexplored. Reason et al. [ 14 ] examined the ability of LLMs to extract numerical data from abstracts and generate executable code to perform meta-analyses. While their results are promising, the study is limited to just four individual case studies. Schopow et al. [ 15 ] and Qureshi et al. [ 16 ] investigate LLM usage across a range of systematic review stages, including meta-review and narrative evidence synthesis, but also present findings on a very small-case study scale ( N<10 ) and rely on comparison to humans. Overall, these investigations have been limited in scope and require substantial amounts of review

Read the complete text