Semantic Communities and Boundary-Spanning Lyrics in K-pop: A Graph-Based Unsupervised Analysis

Oktay Karakuş · 2026

Read Semantic Communities and Boundary-Spanning Lyrics in K-pop: A Graph-Based Unsupervised Analysis by Oktay Karakuş (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-12881.txt.

Introduction

How lyrics are turned into numbers shapes what similarity means, and K-pop offers a large, multilingual test case. Oktay Karakuş and Can Eyüpoğlu compare four multilingual MiniLM representations of 7,891 songs by 1,456 artists, drawn from charts covering 2000 through October 2023. Whole-song truncated embeddings separated neighbouring from random song pairs most sharply, while chunked versions agreed more on clusters and line-based versions gave higher modularity.

From whole-song embeddings the authors build a nearest-neighbour graph and find 21 communities, though stability analysis shows no robust plateau. Community membership tracks character-script composition, and songs spanning many communities connect more broadly. The study shows representation choices reshape the map of a cultural corpus, with caveats around truncation and the lack of independent human validation.

Catalog record

CREATOROktay Karakuş
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-12881

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Semantic Communities and Boundary-Spanning Lyrics in K-pop: A Graph-Based Unsupervised Analysis Oktay Karakuş Abstract Large-scale lyric corpora present unique challenges for data-driven analysis, including the absence of reliable annotations, multilingual content, and high levels of stylistic repetition. Most existing approaches rely on supervised classification, genre labels, or coarse document-level representations, limiting their ability to uncover latent semantic structure. We present a graph-based framework for unsupervised discovery and evaluation of semantic communities in K-pop lyrics using line-level semantic representations. By constructing a similarity graph over lyric texts and applying community detection, we uncover stable micro-theme communities without genre, artist, or language supervision. We further identify boundary-spanning songs via graph-theoretic bridge metrics and analyze their structural properties. Across multiple robustness settings, boundary-spanning lyrics exhibit higher lexical diversity and lower repetition compared to core community members, challenging the assumption that hook intensity or repetition drives cross-theme connectivity. Our framework is language-agnostic and applicable to unlabeled cultural text corpora. ∎ 1 Introduction Lyrics constitute a large and culturally significant class of text data, yet they remain comparatively under-explored within data science and natural language processing 6 ; 7 . Unlike news articles or social media posts, lyric corpora pose distinct methodological challenges: they are rarely annotated with reliable semantic labels, frequently mix multiple languages, and exhibit high levels of intentional repetition due to musical structure 7 . These properties limit the applicability of conventional supervised learning approaches and motivate unsupervised methods that can reveal latent structure directly from text. K-pop lyrics provide a particularly challenging and timely testbed for unsupervised cultural text analysis 19 . As a globally consumed musical genre, K-pop spans multiple languages, stylistic traditions, and narrative themes, while maintaining strong structural regularities such as choruses and refrains. At the same time, available metadata, such as genre or mood tags, are often coarse, inconsistent, or artist-dependent, making them unsuitable as ground truth for semantic analysis. This combination of scale, diversity, and weak supervision creates an ideal setting for studying how semantic structure can be discovered without labels. In this work, we introduce a graph-based framework for unsupervised discovery of semantic communities in lyric corpora using line-level semantic representations 21 ; 4 . Rather than treating each song as a single document, we model lyrics as collections of semantically meaningful lines, which are embedded and aggregated to construct a lyric similarity graph. Community detection on this graph reveals stable micro-theme groupings that emerge solely from textual content, without relying on genre, artist, or temporal metadata 2 ; 18 . Beyond identifying communities, we study how songs relate to multiple semantic regions of the lyric space. Using graph-theoretic bridge and boundary metrics, we identify boundary-spanning lyrics that connect otherwise distinct semantic communities 8 ; 9 ; 3 . Analyzing a corpus of 7,983 K-pop songs by 1,485 artists, we find that while the graph decomposes into 18 semantic communities, the median artist occupies only two communities, indicating strong thematic locality. Boundary-spanning songs form a small but structurally distinctive subset: across multiple robustness settings, they exhibit higher lexical diversity and lower repetition than core community members, suggesting that cross-theme connectivity is driven by semantic breadth rather than hook intensity or repetitive structure. We further demonstrate that the learned semantic structure generalizes beyond the training corpus by embedding recent, out-of-sample chart-topping releases into the existing lyric space. The contributions of this work are threefold: • We propose a line-level, graph-based framework for unsupervised semantic analysis of lyric corpora that is robust to repetition and multilingual content. • We introduce boundary-based metrics that identify songs spanning multiple semantic communities and characterize their structural properties. • We demonstrate the framework on a large-scale K-pop lyric corpus and show that the resulting semantic space meaningfully accommodates both in-sample and out-of-sample songs, providing quantitative evidence for the relationship between semantic diversity, repetition, and boundary-spanning behavior. While our analysis focuses on K-pop lyrics, the proposed methodology is language- agnostic and applicable to a wide range of unlabeled cultural text datasets, including poetry, song lyrics from other genres, and short-form narrative text. 2 Related Work 2.1 Computational approaches to lyric analysis Computational studies of song lyrics have a long history within music information retrieval (MIR) and computational humanities, where lyrics are treated as a form of cultural text with stylistic, topical, and affective signals. Early work often relied on bag-of-words representations, TF–IDF features, or topic models to support tasks such as lyric-based genre and mood classification, emotion recognition, and similarity search, typically evaluated against metadata labels or editorial taxonomies 6 ; 22 ; 7 . Such approaches have been valuable for establishing that lyrical content carries predictive information beyond audio features, but they also inherit limitations of word-count representations, particularly for short, repetitive, and multilingual texts; all common in popular music. Our work is aligned with this tradition in treating lyrics as analyzable text, but it departs from label-driven pipelines. Rather than predicting genres or moods, we focus on discovering latent semantic structure and cross-community connectivity directly from textual similarity. 2.2 Semantic embeddings in cultural and creative domains Representation learning has shifted natural language processing from sparse lexical features toward distributed embeddings that capture semantic and syntactic regularities 17 ; 20 . More recently, contextual language models have provided strong general-purpose text representations 5 , and sentence-level embedding methods have enabled semantic comparison at the granularity of phrases, sentences, and short lines 4 ; 21 . These developments are particularly relevant to lyrics, where meaningful units are often line-level and where repetition can dominate document-level statistics. Methodologically, the present paper builds on sentence embeddings but uses them in a strictly unsupervised setting: line embeddings are aggregated to form song-level representations that are used only to define similarity relations. This contrasts with much prior lyric work that either (i) uses bag-of-words or topic models as primary representations, or (ii) fine-tunes lyric models for supervised prediction. 2.3 Network- and graph-based analysis of cultural artefacts Graph representations provide a complementary lens for cultural data by enabling the study of meso-scale organisation (communities) and structural roles (centrality) that are not reducible to pairwise similarity. Network methods have been used widely in computational social science and cultural analytics, including studies that map large-scale cultural and historical data into networks to reveal macroscopic structure 24 . Within network science, community structure is commonly analysed via modularity-based methods 18 ; 2 , and boundary-spanning roles are often operationalised through centrality measures such as betweenness 8 . In contrast to pipelines that analyse texts independently and then aggregate results, our approach builds a nearest-neighbour graph directly from lyric-derived semantic representations. This design makes community structure and boundary-spanning behaviour explicit objects of analysis, rather than by-products of downstream classification tasks. 2.4 Positioning of the present work The proposed framework sits at the intersection of lyric analysis, semantic representation learning, and network-based cultural analytics. Conceptually, it treats a lyric corpus as a semantic landscape whose structure can be recovered from local similarity relations. Methodologically, it differs from much of the existing lyric literature in four respects. • First, we use sentence-level language embeddings to represent lyric lines, avoiding bag-of-words and TF–IDF features and reducing sensitivity to stylistic repetition. • Second, we construct a sparse k -nearest-neighbour graph over songs, enabling community detection

Read the complete text