Code-Switching Curriculum Learning for Multilingual Transfer in LLMs

Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee · 2024

Read Code-Switching Curriculum Learning for Multilingual Transfer in LLMs by Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02460.txt.

Description

A 2024 arXiv research paper by Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee. Large language models (LLMs) now exhibit near human-level performance in various tasks, but their performance drops drastically after a handful of high-resource languages due to the imbalance in pre-training data. Inspired by the human process of second language acquisition, particularly code-switching—the practice of language alternation in a conversation—we propose code-switching curriculum learning ( CSCL ) to enhance cross-lingual transfer for LLMs.

Catalog record

CREATORHaneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-02460

Browse the full library · About the Tower of Babel