Which Tokens Need Context? A Reference-Based Analysis of Translation Responsibility Using Fertility and Entropy

Ramakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal · 2026

Read Which Tokens Need Context? A Reference-Based Analysis of Translation Responsibility Using Fertility and Entropy by Ramakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29489.txt.

Description

Appicharla, Gain, Pal, and Ekbal ask which words in a translation truly need the surrounding sentences. Human translators lean on context for pronouns and helper verbs, while names and concrete nouns mostly stand alone. Existing ways to study this rely on special test sets or on opening up one model's internals, so they stay narrow or model-bound.

The team builds a post-hoc framework, meaning it analyses finished translations without touching any model. Two measures come from word alignments: fertility, how many target words each source word produces, and entropy, how stable those patterns stay across contexts. They study three language pairs under four context conditions, using human reference translations. Context shifts generative responsibility from source words to context words without changing overall fertility. The largest fertility drops appear in function words, while content words stay stable. Context, they conclude, resolves ambiguity rather than adding new information.

Catalog record

CREATORRamakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29489

Browse the full library · About the Tower of Babel