Code-Switching Curriculum Learning for Multilingual Transfer in LLMs
Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee · 2024
Read Code-Switching Curriculum Learning for Multilingual Transfer in LLMs by Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02460.txt.
Description
A 2024 arXiv research paper by Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee. Large language models (LLMs) now exhibit near human-level performance in various tasks, but their performance drops drastically after a handful of high-resource languages due to the imbalance in pre-training data. Inspired by the human process of second language acquisition, particularly code-switching—the practice of language alternation in a conversation—we propose code-switching curriculum learning ( CSCL ) to enhance cross-lingual transfer for LLMs.
Catalog record
| CREATOR | Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-02460