Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI

Hieu Man, Van-Cuong Pham, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen · 2026

Read Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI by Hieu Man, Van-Cuong Pham, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21300.txt.

Introduction

Hieu Man and four colleagues split writing style from topic so authorship calls survive domain shifts and AI-made text. Their EAVAE system first trains style encoders with supervised contrastive learning, then keeps style and content in separate encoders in a variational autoencoder. A discriminator polices the split and explains its calls in plain language, curbing false topic-style links. The method leads on authorship sets including Amazon Reviews, PAN21, and HRS, and shines at few-shot AI-text spotting on M4.

Catalog record

CREATORHieu Man, Van-Cuong Pham, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41839
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21300

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI Hieu Man, Van-Cuong Pham, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen Abstract Learning robust representations of authorial style is crucial for authorship attribution and AI-generated text detection. However, existing methods often struggle with content-style entanglement, where models learn spurious correlations between authors’ writing styles and topics, leading to poor generalization across domains. To address this challenge, we propose Explainable Authorship Variational Autoencoder (EAVAE), a novel framework that explicitly disentangles style from content through architectural separation-by-design. EAVAE first pretrains style encoders using supervised contrastive learning on diverse authorship data, then finetunes with a Variational Autoencoder (VEA) architecture using separate encoders for style and content representations. Disentanglement is enforced through a novel discriminator that not only distinguishes whether pairs of style/content representations belong to the same or different authors/content sources, but also generates natural language explanation for their decision, simultaneously mitigating confounding information and enhancing interpretability. Extensive experiments demonstrate the effectiveness of EAVAE. On authorship attribution, we achieve state-of-the-art performance on various datasets, including Amazon Reviews, PAN21, and HRS. For AI-generated text detection, EAVAE excels in few-shot learning over the M4 dataset. Code and data repositories are available online 1 1 1 https://github.com/hieum98/avae 2 2 2 https://huggingface.co/collections/Hieuman/document-level-authorship-datasets . 1 Introduction Authorship Analysis, which identifies the stylistic fingerprints of authors, has become a critical technology for navigating modern digital landscape. A primary task within this field is Authorship Attribution (AA), which seeks to identify the author of a given text from a pool of candidates, with applications in intellectual property protection, academic integrity, and forensic investigation 33 ; 31 . Recent advancement of highly fluent Large Language Models (LLMs) has intensified these challenges while creating new tasks, such as AI-generated text detection, where the goal is to distinguish human-written content from machine-generated text 37 ; 9 . The evolution of authorship attribution methods reflects broader trends in natural language processing. Early approaches relied on hand-crafted stylometric features and traditional machine learning classifiers 30 ; 32 ; 31 . Though interpretable, they often struggled with scalability and domain transferability. Recent work has embraced neural approaches that learn representations directly from text using deep learning techniques, particularly contrastive learning 6 ; 26 . Despite significant progress in authorship analysis, a fundamental challenge known as the content confounding problem continues to limit the robustness and generalizability of these methods. This issue, formally studied as topic confusion , occurs when models learn spurious correlations between authors’ identities and the topics they frequently discuss, rather than capturing their intrinsic, topic-agnostic writing style. An intuitive example is presented in Figure 1 , in which a model incorrectly labels a query document as a work by Sir Arthur Conan Doyle due to having learned to associate the author’s identity with Detective Fiction content instead of author’s unique writing style. Figure 1: An example of content-style entanglement. Current style-content disentanglement methods 2 ; 27 ; 20 often rely on training a single encoder with contrastive learning objectives to learn holistic text representations and may implicitly conflate style and content into a single embedding. Moreover, they tend to employ small language model (SLM) encoders that have limited capacity to learn complex representations. As a result, these approaches struggle to generalize across diverse topics and domains. Moreover, none of the existing methods provides interpretability for the learned representations, making it difficult to understand what stylistic features are being captured and how they contribute to attribution decisions. To address these limitations, we propose Explainable Authorship Variational Autoencoder (EAVAE), a novel framework that explicitly disentangles authorial style from content through architectural separation-by-design. EAVAE employs a two-stage training approach: First, we pretrain a style encoder based on LLMs using supervised contrastive learning on diverse authorship data to establish strong foundational representations; Second, we propose a novel finetuning framework with separate encoders for style and content representations, assuming style-content independence. Our framework utilizes Variational Autoencoder (VAE) to reconstruct the documents from their encodings. Moreover, we introduce an explainable discriminatory objective that not only distinguishes whether pairs of style/content representations originate from the same authors/content sources, but also generates natural language explanation for their decision. This dual objective of disentanglement and explainability explicitly alleviates confounding information and enhances model interpretability, providing insights into the features that contribute to the learned representations. Extensive experiments show that EAVAE achieves substantial improvements on the benchmark datasets Amazon Reviews 22 , PAN21 5 and HRS corpus 3 3 3 https://www.iarpa.gov/research-programs/hiatus for authorship attribution, and strong performance on the M4 dataset 35 for AI-generated text detection, demonstrating the generalization and robustness of authorial style representations from our architectural disentanglement mdethod. Our contributions are threefold: (1) We introduce a disentangled representation learning framework specifically designed for robust authorship attribution across content domains with VAE; (2) We propose an explainable adversarial discriminatory objective that enforces disentanglement while also providing interpretable explanation for learned representations; and (3) We demonstrate state-of-the-art performance on challenging AA benchmarks and competitive results on zero-shot AI-generated text detection. 2 Methodology We present Explainable Authorship Variational Autoencoder (EAVAE), a novel framework that addresses the content-confounding problem through architectural disentanglement and adversarial training with explainable feedback. EAVAE employs a two-stage approach: (1) contrastive pre-training to establish strong authorial representations, and (2) VAE-based finetuning with separate encoders for style and content, enforced through an explainable discriminator to ensure effective disentanglement and interpretability. 2.1 Problem Formulation Following 26 ; 20 , we formulate authorship attribution as a ranked retrieval problem. Given a query document d_{q} , we aim to learn a function f_{\theta}(d_{q}) that maps documents to representation vectors such that documents by the same author have higher cosine similarity than those by different authors: \text{sim}(f_{\theta}(d_{q}),f_{\theta}(d_{i}))>\text{sim}(f_{\theta}(d_{q}),f_{\theta}(d_{j})) (1) where \text{author}(d_{q})=\text{author}(d_{i})\neq\text{author}(d_{j}) , and \text{sim}(\cdot,\cdot) denotes cosine similarity. The key challenge lies in ensuring that f_{\theta} captures authorial style patterns independently of content, avoiding spurious topic-author correlation that lead to poor cross-domain generalization. Figure 2: The architecture of Explainable Authorship Variational Autoencoder (EAVAE). EAVAE employs separate encoders for style and content, with an explainable discriminator that distinguishes whether pairs of style/content representations originate from the same or different authors/content sources, while generating natural language explanations for its decisions. 2.2 Contrastive Pretraining We first establish strong authorial representations based on LLMs via supervised contrastive learning 13 on a large, diverse authorship-labeled dataset. This pretraining stage aims to learn representations that cluster documents by the same author while separating those by different authors, providing a solid foundation for subsequent disentanglement. Formally, given a dataset \mathcal{D}=\{(d_{i},a_{i})\}_{i=1}^{N} where d_{i} is a document and a_{i} is its author, we optimize: \displaystyle\mathcal{L}_{\text{con}}=-\sum_{i=1}^{N}\sum_{j\in\mathcal{P}(i)}\log\frac{\exp(r_{i}\cdot r_{j}/\tau)}{\sum_{k=1}^{N}\exp(r_{i}\cdot r_{k}/\tau)} (2) where r_{i}=f_{\theta}(d_{i})/\|f_{\theta}(d_{i})\| is the \ell_{2} -normalized representation, \mathcal{P}(i)=\{k:a_{k}=a_{i},k\neq i\} contains positive samples (same author), and \tau is the temperature hyperparameter. To enhance the contrastive learning process, following 20 , we employ hard negative mining using BM25 to mine the negative samples. Specifically, for each anchor document d_{i} , we retrieve the top- K BM25 matches from different authors. This strategy forces the model to distinguish between documents that are lexically similar but stylistically different, reducing reliance on surface-level features. Additionally, we incorporate bidirectional attention mechanisms within the LLM, following recent advances in LLM’s representation learning 4 ; 21 . This bidirectional context modeling significantly

Read the complete text