Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale
Avi-ad Avraam Buskila Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat-Gan, Israel [[email protected]] · 2026
Read Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale by Avi-ad Avraam Buskila Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat-Gan, Israel [[email protected]] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23801.txt.
Description
Buskila runs a controlled comparison of domain fine-tuning versus retrieval-augmented generation for medical multiple-choice answering at the 4-billion-parameter scale. Holding size, prompts, decoding, retrieval, and evaluation fixed, he tests both a general and a domain-tuned model with and without retrieved passages. Fine-tuning gains about 7 points over the general baseline, while retrieval adds no significant gain in either model, so knowledge in weights beats knowledge in context here.
Catalog record
| CREATOR | Avi-ad Avraam Buskila Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat-Gan, Israel [[email protected]] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15026 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.23801