Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models

Chia-Hsuan Chang, Tien-Yuan Huang, Yi-Hang Tsai, Chia-Ming Chang, San-Yih Hwang · 2024

Read Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models by Chia-Hsuan Chang, Tien-Yuan Huang, Yi-Hang Tsai, Chia-Ming Chang, San-Yih Hwang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12433.txt.

Description

Chia-Hsuan Chang and co-authors published a computing paper in 2024 on finding topics in text across languages. Clustering-based topic models work well in one language by grouping learned text vectors. Across languages they falter, because multilingual models add dimensions that depend on the language itself. The team adds a step to cancel that effect.

The new step uses a matrix method to refine the dimensions before clustering. Tests on three datasets show the updated pipeline generally beats leading rivals for cross-lingual topic finding. The authors present the fix as a way to let the model spot shared topics without language artifacts steering the groups.

Catalog record

CREATORChia-Hsuan Chang, Tien-Yuan Huang, Yi-Hang Tsai, Chia-Ming Chang, San-Yih Hwang
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-12433

Browse the full library · About the Tower of Babel