Human-Centric Topic Modeling with Goal-Prompted Contrastive Learning and Optimal Transport
Rui Wang † , Yi Zheng † , Dongxin Wang † , Haiping Huang †∗ , Yuanzhi Yao ‡ , Yuxiang Zhou ♢ , Jialin Yu ♡ , Philip Torr ♡ · 2026
Read Human-Centric Topic Modeling with Goal-Prompted Contrastive Learning and Optimal Transport by Rui Wang † , Yi Zheng † , Dongxin Wang † , Haiping Huang †∗ , Yuanzhi Yao ‡ , Yuxiang Zhou ♢ , Jialin Yu ♡ , Philip Torr ♡ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12663.txt.
Introduction
Rui Wang and seven colleagues build topic models around a user goal. Older methods chase coherence and often yield redundant, off-target topics. Their Human-TM task feeds a human goal straight into topic discovery. A GCTM-OT model first prompts a language model for goal candidates. Contrastive learning with optimal transport then shapes topics from those candidates. Tests on three subreddit sets show stronger coherence and diversity. Goal fit improves markedly over leading baselines. The work points toward more human-centered topic discovery.
Catalog record
| CREATOR | Rui Wang † , Yi Zheng † , Dongxin Wang † , Haiping Huang †∗ , Yuanzhi Yao ‡ , Yuxiang Zhou ♢ , Jialin Yu ♡ , Philip Torr ♡ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54532 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12663
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Human-Centric Topic Modeling with Goal-Prompted Contrastive Learning and Optimal Transport 498 Thanks: * Corresponding author. CCS: Information systems Document topic models Rui Wang † , Yi Zheng † , Dongxin Wang † , Haiping Huang †∗ , Yuanzhi Yao ‡ , Yuxiang Zhou ♢ , Jialin Yu ♡ , Philip Torr ♡ Abstract . Existing topic modeling methods, from LDA to recent neural and LLM-based approaches, which focus mainly on statistical coherence, often produce redundant or off-target topics that miss the user’s underlying intent. We introduce “Human-centric Topic Modeling” ( Human-TM ), a novel task formulation that integrates a human-provided goal directly into the topic modeling process to produce interpretable, diverse and goal-oriented topics. To tackle this challenge, we propose the G oal-prompted C ontrastive T opic M odel with O ptimal T ransport (GCTM-OT), which first uses LLM-based prompting to extract goal candidates from documents, then incorporates these into semantic-aware contrastive learning via optimal transport for topic discovery. Experimental results on three public subreddit datasets show that GCTM-OT outperforms state-of-the-art baselines in topic coherence and diversity while significantly improving alignment with human-provided goals, paving the way for more human-centric topic discovery systems. 1. Introduction Topic models ( 1 ; 46 ) , such as the Latent Dirichlet Allocation (LDA) ( 3 ) and advanced variants including the Corpus-Aware Self-similarity enhanced Topic Model (CAST) ( 21 ) , have been widely adopted for open information extraction ( 40 ; 41 ) and knowledge discovery ( 36 ; 49 ) . These approaches uncover coherent semantic patterns from large text corpora without supervision. However, when the analytical objective is guided by a specific human goal , these methods often fall short because they are not designed to adapt topic discovery to user-defined intentions without extensive manual intervention. Consider the example in Figure 1 , where the human goal, expressed in question "What’s the thing that’s bothering you?" , is to identify the main issues of concern within a collection of text responses. Traditional topic models, which are optimized solely for statistical coherence, often produce topics that, although internally consistent, are redundant, less interpretable, or unrelated to the goal. For example, topics containing terms such as ‘house’ , ‘sister’ , ‘father’ or ‘happy’ , ‘enjoy’ , ‘hope’ are coherent in a statistical sense but do not address the intended analytical objective. As a result, important patterns such as ‘breakup struggles’ , ‘health issue’ or ‘academic stress’ may be overlooked or obscured, requiring substantial manual filtering and interpretation. Figure 1. Key differences between Traditional Topic Modeling and Human-Centric Topic Modeling (with human’s goal). To address these limitations, we propose a new task formulation called Human-centric Topic Modeling ( Human-TM ). As illustrated in Figure 1 , given a text corpus (e.g. Subreddit corpus ‘Whatsbotheringyou’ ) 1 1 1 https://www.reddit.com/r/whatsbotheringyou/ and a human-provided free-text goal (e.g. “What’s the thing that’s bothering you?” ), Human-TM aims to automatically generate a set of goal-oriented topics. These topics should satisfy the following three requirements: 1). Topics are semantically relevant to the human-provided goal. 2). Topics are semantically coherent and easily interpretable. 3). Topics are diverse (non-redundant) and collectively provide broad coverage of the corpus. To tackle the Human-TM task, we propose the G oal-prompted C ontrastive T opic M odel with O ptimal T ransport (GCTM-OT), which formulates topic modeling as a representation learning procedure based on advanced prompt engineering ( 10 ) and optimal transport theory ( 25 ) . The core idea is to incorporate goal information, identified through LLM-based prompting from texts, into the modeling process for goal-oriented topic extraction. Specifically, GCTM-OT first generates phrase-style goal candidates for each document using a goal-oriented summarization prompt and aggregates them into a corpus-level goal set. To improve topic interpretability, it integrates contextualized word representations from a transformer ( 9 ) to build contextualized document representations and models topics with topic representations to infer document-topic distributions. Moreover, to embed goal information and encourage topic diversity, it forms goal representations by clustering goal candidates in the corpus-level goal set and employs optimal transport ( 25 ) to guide topic representation training. After training with the supervision signals provided by contrastive learning and optimal transport, GCTM-OT is capable of identifying interpretable and diverse goal-oriented topics. Additionally, it could generate a phrase-style topic summary for each topic, offering document-level topic interpretation. The main contributions of this work are summarized as: • We introduce Human-TM , a novel topic modeling formulation that takes human goals into account and generates interpretable, diverse and goal-oriented topics. • We propose the novel G oal-prompted C ontrastive T opic M odel with O ptimal T ransport (GCTM-OT), which leverages LLM-based prompting to identify goal candidates within texts and incorporates them into the modeling process via contrastive learning and optimal transport, enabling goal-oriented topic extraction. • We evaluate GCTM-OT on three Subreddit datasets. Experimental results show that GCTM-OT outperforms state-of-the-art baselines in topic coherence and diversity. In addition, it generates topics that closely align with human goals, as measured by Goal Similarity ( GS ), Goal-relevant Topic Rate ( GTR ) and Goal Coverage Rate ( GCR ) metrics. 2. Related Work Our work is relevant to neural topic modeling and Large Language Model based prompting. 2.1. Neural Topic Modeling Modeling topics using generative neural networks, such as Variational Autoencoders (VAE) ( 17 ) and Generative Adversarial Networks (GAN) ( 14 ) , has emerged as an active area of research. Miao et al. proposed the Neural Variational Document Model (NVDM) ( 22 ) , which is the pioneering work in this field, based on the VAE. Likewise, Wang et al. proposed the Adversarial-neural Topic Model (ATM) ( 39 ) and the Bidirectional Adversarial Topic (BAT) ( 37 ) model in an adversarial manner and utilized a generator network to capture semantic patterns. Inspired by NVDM, Xu et al. proposed the VONT ( 47 ) by employing a mixture of von-Mises Fisher distributions as topic prior. Ma et al. utilized the word embeddings to filter out irrelevant words and proposed the Corpus-Aware Self-similarity Topic (CAST) ( 21 ) model. Fang et al. incorporated the dynamic word representations into the modeling process and proposed the Contextualized Word Topic Model (CWTM) ( 11 ) . To mine the public’s opinion towards ChatGPT, Wang et al. employed a topic disentangle mechanism and proposed the Disentangled Contextualized Topic Model (DisCTM) ( 38 ) . However, all of these approaches are not able to incorporate the human’s goal into the modeling process, resulting in generic topics that do not match specific human needs. 2.2. Large Language Model based Prompting Advances in Large Language Models (LLMs) have made them a thriving research topic and have been explored for their robust capabilities in NLP tasks ( 50 ; 32 ; 44 ) . Meanwhile, Prompt Engineering ( 30 ) has emerged as an indispensable approach to extend the capability of LLMs. Firstly, Radford et al. proposed the Zero-shot prompting ( 27 ) to offer a paradigm shift in leveraging LLMs. By providing several input-output examples to induce the target of the given task, Brown et al. proposed the Few-shot Prompting ( 4 ) . Along this line, Wei et al. introduced the Chain-of-Thought