Synergistic Feature Fusion for Latent Lyrical Classification: A Gated Deep Learning Architecture

Marco Gameiro · 2025

Read Synergistic Feature Fusion for Latent Lyrical Classification: A Gated Deep Learning Architecture by Marco Gameiro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11673.txt.

Introduction

M. A. Gameiro classifies song lyrics by fusing two kinds of evidence: deep semantic embeddings from a sentence transformer, which are rich but opaque, and simple structural features that a human can interpret. Neither source alone tells the whole story about what a lyric is doing.

A gated Synergistic Fusion Layer lets the structural cues modulate the deep features, deciding how much each should count. The task separates one dominant, uniform cluster of lyrics from everything else, a split derived from clustered embeddings. The gated model edges out a strong random forest baseline on accuracy and F1 score. The design shows how interpretable signals can steer, rather than merely accompany, deep representations.

Catalog record

CREATORMarco Gameiro
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-11673

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Synergistic Feature Fusion for Latent Lyrical Classification: A Gated Deep Learning Architecture Marco Gameiro Abstract This study addresses the challenge of integrating complex, high-dimensional deep semantic features with simple, interpretable structural cues for lyrical content classification. We introduce a novel Synergistic Fusion Layer (SFL) architecture, a deep learning model utilizing a gated mechanism to modulate Sentence-BERT embeddings ( F deep F_{\text{deep}} ) using low-dimensional auxiliary features ( F struct F_{\text{struct}} ). The task, derived from clustering UMAP-reduced lyrical embeddings, is reframed as binary classification, distinguishing a dominant, homogeneous cluster (Class 0) from all other content (Class 1). The SFL model achieved an accuracy of 0.9894 0.9894 and a Macro F1 score of 0.9894 0.9894 , outperforming a comprehensive Random Forest (RF) baseline that used feature concatenation ( Accuracy = 0.9868 \text{Accuracy}=0.9868 ). Crucially, the SFL model demonstrated vastly superior reliability and calibration, exhibiting a 93 % 93\% reduction in Expected Calibration Error ( ECE = 0.0035 \text{ECE}=0.0035 ) and a 2.5 × 2.5\times lower Log Loss ( 0.0304 0.0304 ) compared to the RF baseline ( ECE = 0.0500 \text{ECE}=0.0500 ; Log Loss = 0.0772 \text{Log Loss}=0.0772 ). This performance validates the architectural hypothesis that non-linear gating is superior to simple feature concatenation, establishing the SFL model as a robust and trustworthy system for complex multimodal lyrical analysis. \jvol vv \jnum nn 2025 \dochead Long Paper \pageonefooter Action editor: {action editor name}. Submission received: DD Month YYYY; revised version received: DD Month YYYY; accepted for publication: DD Month YYYY. \affilblock 1 Introduction Embedding-based representations of text have become central to classification tasks across domains Tavares and Ayres 2025 . The foundation of modern Natural Language Processing (NLP) rests on the Transformer architecture, which revolutionized sequence modeling by introducing the self-attention mechanism Vaswani et al. 2017 , proving that attention alone was sufficient for state-of-the-art results. This advancement led directly to the development of powerful pre-trained language models, most notably the Bidirectional Encoder Representations from Transformers (BERT) Devlin et al. 2019 . BERT achieved significant accomplishments by pre-training deep bidirectional representations from unlabelled text, allowing it to fine-tune with a single output layer for a wide range of NLP tasks. These BERT-based models currently dominate classification pipelines Wu and Wan 2025 . Building upon this success, Sentence-BERT (SBERT) Reimers and Gurevych 2019 adapted the core BERT model using Siamese and triplet network structures. SBERT’s key accomplishment was generating highly semantically meaningful sentence embeddings that could be compared efficiently using cosine similarity, which significantly accelerated semantic similarity search and clustering. While these deep models provide rich semantic context, their outputs often lack structural interpretability, and their evaluation frequently neglects crucial reliability metrics like Expected Calibration Error (ECE) Guha et al. 2024 ; Cherubin 2023 ; Gazin et al. 2025 . The ECE method Naeini, Cooper, and Hauskrecht 2015 quantifies model reliability by measuring the deviation of predicted confidence from empirical correctness across probability bins, a critical accomplishment for building trustworthy machine learning systems. The challenge of combining deep semantic information with complementary structural metadata remains a core problem in multimodal learning Gao et al. 2020 . Previous works often resort to simple feature concatenation or complex transformer ensembles Shaukat et al. 2025 , which are computationally prohibitive. Our architectural choice leverages the concept of gating , a mechanism originally introduced in Recurrent Neural Networks (RNNs), specifically in the GRU (Gated Recurrent Unit) proposed in 2014 Cho et al. 2014 . The accomplishment of the gating mechanism was enabling RNNs to selectively remember or forget information across time steps, which we adapt here to modulate feature importance. In terms of methodology, data exploration relies on robust techniques. We use UMAP (Uniform Manifold Approximation and Projection) McInnes, Healy, and Melville 2018 for dimensionality reduction. UMAP’s accomplishment is effectively retaining both local and global data structure in the reduced space. For clustering this complex structure, HDBSCAN (Hierarchical Density-Based Spatial Clustering of Applications with Noise) Campello, Moulavi, and Sander 2013 is employed, providing a highly effective solution by identifying clusters based on hierarchical density estimates. For comparative baseline analysis, ensemble methods like Random Forest (RF) Breiman 2001 remain crucial. Random Forests, which construct multiple decision trees and output the mode of the classes, are accomplished for their robustness and ability to handle high-dimensional feature spaces. We address these limitations by introducing the Synergistic Fusion Layer (SFL) architecture. This work makes two principal contributions: 1. Methodological Advance: We propose a Gated Deep Learning architecture (SFL) designed to non-linearly fuse high-dimensional SBERT embeddings ( F_{\text{deep}} ) with an engineered set of low-dimensional structural cues ( F_{\text{struct}} ). This validates the hypothesis that structural features serve optimally as contextual modulators, not just concatenated inputs. 2. Reliability Enhancement: We demonstrate that the SFL model achieves a state-of-the-art level of calibration and probability fidelity for this classification task, drastically outperforming a robust Random Forest baseline (RF) that utilizes the same concatenated feature set. Our rigorous evaluation, including a comparison against the RF baseline and a feature ablation study, confirms the SFL architecture’s superiority in both predictive power and, critically, model reliability. 2 Methods 2.1 Data Acquisition, Preprocessing, and Feature Engineering The data preparation follows the previous pipeline: lyrics were normalized and embedded using Sentence-BERT (all-MiniLM-L6-v2, 384 dimensions) Reimers and Gurevych 2019 . This approach, which adapts the foundational BERT model Devlin et al. 2019 for semantic similarity, constitutes the Deep Feature Set ( F_{\text{deep}} ). 2.1.1 Custom Lyrical Structure Features ( F_{\text{struct}} ) Our Auxiliary Feature Set ( F_{\text{struct}} ) comprises normalized Popularity and three custom linguistic features, which are designed to capture explicit, interpretable characteristics: • Rhyme Density, Lexical Diversity (TTR), and Narrative Structure (Pronoun Ratio) were calculated as defined previously. The F_{\text{deep}} and F_{\text{struct}} sets were normalized using StandardScaler to ensure equal variance prior to model input. 2.2 Embedding, Reduction, and Clustering The 384-dimensional F_{\text{deep}} embeddings were reduced to 20 dimensions using UMAP ( n\_components=20 ) McInnes, Healy, and Melville 2018 to preserve global topology. HDBSCAN Campello, Moulavi, and Sander 2013 was then applied to this reduced space to identify the natural, intrinsic structure of the lyrical content. As shown in Figure 1(a) , HDBSCAN identified 11 distinct clusters plus a small noise component (labeled -1). This result validates that the lyrical dataset contains a complex semantic landscape composed of multiple lyrical archetypes (e.g., various themes, narrative styles, or structural properties). (a) Intrinsic Semantic Clusters (HDBSCAN). (b) Final Binary Classification Target. Figure 1 : UMAP Projection of Lyrics Embeddings. (a) shows the 11 intrinsic clusters identified by HDBSCAN. (b) shows the reframed binary target: Class 0 is the single largest intrinsic cluster (Dominant Archetype), and Class 1 comprises all other content, confirming the high topological separability of the final classification task. The classification task was then intentionally reframed from a complex multi-class problem to a highly separated binary task (Figure 1(b) ): • Class 0 (Dominant Archetype): Defined as the single largest, most homogeneous intrinsic cluster identified by HDBSCAN ( 51.861\% of the data). • Class 1 (Alternative Archetypes): Comprises all remaining 10 intrinsic clusters and the noise component ( 48.139\% of the data). This reframing ensures a balanced target variable and provides a clear objective: discriminating the dataset’s main lyrical body from all other, more diverse content. 2.3

Read the complete text