Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models
Chia-Hsuan Chang, Tien-Yuan Huang, Yi-Hang Tsai, Chia-Ming Chang, San-Yih Hwang · 2024
Read Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models by Chia-Hsuan Chang, Tien-Yuan Huang, Yi-Hang Tsai, Chia-Ming Chang, San-Yih Hwang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12433.txt.
Description
Chia-Hsuan Chang and co-authors published a computing paper in 2024 on finding topics in text across languages. Clustering-based topic models work well in one language by grouping learned text vectors. Across languages they falter, because multilingual models add dimensions that depend on the language itself. The team adds a step to cancel that effect.
The new step uses a matrix method to refine the dimensions before clustering. Tests on three datasets show the updated pipeline generally beats leading rivals for cross-lingual topic finding. The authors present the fix as a way to let the model spot shared topics without language artifacts steering the groups.
Catalog record
| CREATOR | Chia-Hsuan Chang, Tien-Yuan Huang, Yi-Hang Tsai, Chia-Ming Chang, San-Yih Hwang |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-12433