Beyond Fine-Tuning: In-Context Learning and Chain-of-Thought for Reasoned Distractor Generation

Elaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, [1mm] School of Computing, Macquarie University, Australia · 2026

Read Beyond Fine-Tuning: In-Context Learning and Chain-of-Thought for Reasoned Distractor Generation by Elaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, [1mm] School of Computing, Macquarie University, Australia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17574.txt.

Description

Alhazmi, Sheng, and Zhang explore how language models can generate distractors, plausible wrong options on multiple-choice questions. A distractor must fit the context and mislead test-takers through implicit reasoning, yet they depend on experts. A recent method pairs fine-tuned encoder-decoder models with contrastive learning, but misses how experts reason when picking distractors. The authors test in-context learning with unsupervised semantic retrieval for examples, and design a framework that generates distractors and rationales. Six benchmarks show it at work across varied lengths and domains.

Catalog record

CREATORElaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, [1mm] School of Computing, Macquarie University, Australia
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81067
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17574

Browse the full library · About the Tower of Babel