Modeling User Behavior from Adaptive Surveys with Supplemental Context
Aman Shukla, Daniel Patrick Scantlebury, Rishabh Kumar · 2025
Read Modeling User Behavior from Adaptive Surveys with Supplemental Context by Aman Shukla, Daniel Patrick Scantlebury, Rishabh Kumar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20919.txt.
Introduction
Aman Shukla, Daniel Patrick Scantlebury, and Rishabh Kumar model user behavior by fusing survey answers with outside context, in a 2025 study. Surveys are clear and easy to run, yet they tire users and stay short, so they miss much. Their system, LANTERN, keeps survey data in the lead role. Extra signals join only when relevant, through gating, residual links, and a late cross-attention step.
The system beat strong survey-only models at predicting many survey answers at once. Extra tests probed cut-off settings and which attributes gain from context, rare versus common. The design accepts new encoders and fresh data types with ease. The authors pitch it as a blueprint for survey-centered products.
Catalog record
| CREATOR | Aman Shukla, Daniel Patrick Scantlebury, Rishabh Kumar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-20919
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modeling User Behavior from Adaptive Surveys with Supplemental Context Aman Shukla, Daniel Patrick Scantlebury, Rishabh Kumar Abstract Modeling user behavior is critical across many industries where understanding preferences, intent, or decisions informs personalization, targeting, and strategic outcomes. Surveys have long served as a classical mechanism for collecting such behavioral data due to their interpretability, structure, and ease of deployment. However, surveys alone are inherently limited by user fatigue, incomplete responses, and practical constraints on their length making them insufficient for capturing user behavior. In this work, we present LANTERN (Late-Attentive Network for Enriched Response Modeling), a modular architecture for modeling user behavior by fusing adaptive survey responses with supplemental contextual signals. We demonstrate the architectural value of maintaining survey primacy through selective gating, residual connections and late fusion via cross-attention, treating survey data as the primary signal while incorporating external modalities only when relevant. LANTERN outperforms strong survey-only baselines in multi-label prediction of survey responses. We further investigate threshold sensitivity and the benefits of selective modality reliance through ablation and rare/frequent attribute analysis. LANTERN’s modularity supports scalable integration of new encoders and evolving datasets. This work provides a practical and extensible blueprint for behavior modeling in survey-centric applications. 1 Introduction Understanding user behavior is a fundamental challenge in applied machine learning. In domains like marketing, healthcare, and public policy, this often takes the form of measuring preferences, decisions, and experiences over time. Surveys have historically played a key role here due to their structured format, interpretability, and wide adoption. Whether embedded in feedback loops, onboarding flows, or customer lifecycle touchpoints, surveys provide domain-specific and longitudinal insight into user traits. However, the practical limitations of surveys are well known. Users cannot be expected to engage with long or frequent questionnaires. The result is often a tradeoff between breadth and depth: surveys either ask fewer questions to maximize response rates or risk high dropout and noise. As a result, important aspects of user behavior may remain unobserved. Crucially, survey responses are bounded by who chooses to answer, creating a structured but inherently sparse view of the population. To counter this, many systems now rely on hybrid modeling strategies ( Zhang et al. 2023 ) , ( Wei et al. 2023 ) , supplementing primary signals with contextual or observational data. In contrast to surveys, supplementary signals, such as demographic traits, engagement metrics, or transactional logs are collected passively in the wild. These signals are not constrained by voluntary response and thus exist in much higher volume. However, the massive volume also introduces significant noise and potential bias making them volatile inputs in hybrid modeling. The challenge is to combine these supplementary features with survey responses in a way that respects the structure and semantics of the survey, avoids feature bloat, and remains interpretable and modular. Our model LANTERN, is anchored on a large, user-facing survey that serves as a critical source of ground truth. This survey captures a broad spectrum of behavioral, demographic, and psychographic attributes, including but not limited to age, gender, ethnicity, brand preferences, digital media habits, lifestyle interests, and purchasing intentions. By sourcing these responses directly from users at the time of survey deployment, we obtain high fidelity labels that reflect self-reported truths, distinguishing this signal from passively observed or inferred behavioral data. The richness and scope of this survey design empower us to build nuanced behavioral representations and ensure our learning framework is guided by concrete signals with deep relevance to user understanding, personalization, and market insights. This anchoring mechanism also positions the survey as an indispensable foundation upon which supplemental behavioral signals can be integrated to expand coverage and depth. LANTERN is a scalable neural architecture designed to keep survey signals central while selectively integrating external context. The model applies late fusion via cross-attention, using survey embeddings to query contextual embeddings and learn only behaviorally relevant interactions from supplementary signals. The gating and residual mechanisms preserve interpretability and alignment with the survey semantics. Furthermore, both survey and supplemental data are stored in structured tabular formats within data warehouses in the industry. We provide a blueprint, illustrated in Figure 1 , in which we process these tables through encoder modules that produce embeddings for each user. These embeddings are then passed to LANTERN. Importantly, the system is built for deployment: it is modular, efficient ( \sim 50M parameters), and ready for deployment. Figure 1: Ecosystem Overview. (Left) Pipeline for generating signal x_{s} from survey. (Right) Pipeline to generate signal x_{e} from external data. Both pipelines sample information from a database of survey respondents that includes different modalities including user behavior. 2 Related Work Recent advancements in deep learning for user modeling have demonstrated the utility of structured behavioral signals. For example, Sukhbaatar et al. ( Sukhbaatar et al. 2019 ) apply a multi-layer perceptron (MLP) to prediction factors derived from student’s online learning activities to identify those at risk of course failure. Gao et al. ( Gao et al. 2021 ) introduce a cascading assumption among behavior types and integrate Neural Collaborative Filtering ( He et al. 2017 ) within a multi-task learning framework. Despite their effectiveness, these approaches generally assume behavioral signals are self-sufficient, often overlooking supplementary contextual cues. Two-step user modeling architectures such as DMT ( Gu et al. 2020 ) and ZEUS ( Gu et al. 2021 ) learn cross-type user representations by concatenating intra-type sequential embeddings, while GHCF conducts multi-behavior prediction via behavior-wise fusion of intra-type collaborative representations ( Chen et al. 2021 ) . However, these methods fall short in modeling interdependent context across modalities. Attention mechanisms have emerged as powerful tools for multimodal modeling. Tsai et al. ( Tsai et al. 2019 ) introduce a transformer-based architecture that performs cross-modal attention without requiring temporal alignment, enabling effective fusion of language, visual, and acoustic signals for sentiment and emotion tasks. ViLBERT ( Lu et al. 2019 ) extends the BERT ( Devlin et al. 2019 ) model with a two-stream architecture, applying co-attentional transformers to integrate visual and textual inputs, and achieves state-of-the-art results across vision and language benchmarks. Gating mechanisms have also been shown to be effective in handling task and modality heterogeneity. The Multi-gate Mixture-of-Experts (MMoE) framework ( Ma et al. 2018 ) supports task-specific routing of shared experts, yielding strong gains in recommendation and advertising contexts. Likewise, the Gated Multimodal Unit (GMU) ( Arevalo et al. 2020 ) introduces a learnable gating structure for fusing multimodal inputs, demonstrating improvements on genre classification using plot and poster data. Our work is inspired by these advances in fusion strategies, gated learning, and cross-modal attention. However, unlike prior work, which often targets high-dimensional or richly aligned modalities, we focus on the underexplored setting of leveraging these techniques on heterogeneous tabular user behavior data in advertising. In doing so, we bridge the gap between state-of-the-art user modeling techniques and practical, industry-scale tabular data environments. 3 Methodology 3.1 Problem Formulation Let x_{s} denote adaptive survey responses and x_{e} represent external contextual features for N users. Each user completes an adaptive survey composed of multiple-choice questions of three types - binary choice, single choice, and multiple choice. We model this at the response key level: each possible answer option is treated as an independent binary label.