Transformer-Based Language Models Across Domain Verticals: Architectures, Applications and Critical Assessment Journal: Preprint

Guruprakash J, Krithika L.B · 2026

Read Transformer-Based Language Models Across Domain Verticals: Architectures, Applications and Critical Assessment Journal: Preprint by Guruprakash J, Krithika L.B (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24331.txt.

Description

Guruprakash and Krithika survey transformer language models across the fields now built on them. Their 2026 review tries to separate lasting ideas from release noise. It works at two levels. In mechanism, it sorts the transformer families into a taxonomy: encoder-only, decoder-only, encoder-decoder, long-context, permutation-based, and generator-discriminator variants. The post-2023 shifts that changed practice are added, from instruction tuning and human-feedback learning to preference tuning, mixture-of-experts scaling, and retrieval.

Uses in healthcare, finance, law, education, customer service, creative writing, and scientific work are each linked to the skills making a transformer the right tool there. A critical review compares designs along four axes that matter for deployment decisions. It measures the trade-off between parameter scale and practical cost. The synthesis targets practitioners choosing among flagship families, who need judgement grounded in evidence, not announcement cycles.

Catalog record

CREATORGuruprakash J, Krithika L.B
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24331

Browse the full library · About the Tower of Babel