Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale

Avi-ad Avraam Buskila Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat-Gan, Israel [[email protected]] · 2026

Read Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale by Avi-ad Avraam Buskila Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat-Gan, Israel [[email protected]] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23801.txt.

Description

Buskila runs a controlled comparison of domain fine-tuning versus retrieval-augmented generation for medical multiple-choice answering at the 4-billion-parameter scale. Holding size, prompts, decoding, retrieval, and evaluation fixed, he tests both a general and a domain-tuned model with and without retrieved passages. Fine-tuning gains about 7 points over the general baseline, while retrieval adds no significant gain in either model, so knowledge in weights beats knowledge in context here.

Catalog record

CREATORAvi-ad Avraam Buskila Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat-Gan, Israel [[email protected]]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15026
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23801

Browse the full library · About the Tower of Babel