EPR-GAIL: An EPR-Enhanced Hierarchical Imitation Learning Framework to Simulate Complex User Consumption Behaviors

Tao Feng, Yunke Zhang, Huandong Wang, Yong Li · 2025

Read EPR-GAIL: An EPR-Enhanced Hierarchical Imitation Learning Framework to Simulate Complex User Consumption Behaviors by Tao Feng, Yunke Zhang, Huandong Wang, Yong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06392.txt.

Introduction

Tao Feng and three co-authors build a way to fake shopping records that still ring true. Real records of what people buy, and where, feed store advice and sales forecasts, but the records are patchy and age fast. Their 2025 method blends a learning game with a classic model of how people choose where to shop.

The classic model breaks each choice into buying, exploring, and going back to liked spots. That split guides both the fake record maker and the judge that grades it. On two real data sets, the fakes beat the best rival method on likeness by a wide margin. The fakes also lifted sales forecasts and place advice when used as extra training data.

Catalog record

CREATORTao Feng, Yunke Zhang, Huandong Wang, Yong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-06392

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EPR-GAIL: An EPR-Enhanced Hierarchical Imitation Learning Framework to Simulate Complex User Consumption Behaviors Tao Feng, Yunke Zhang, Huandong Wang, Yong Li Abstract User consumption behavior data, which records individuals’ online spending history at various types of stores, has been widely used in various applications, such as store recommendation, site selection, and sale forecasting. However, its high worth is limited due to deficiencies in data comprehensiveness and changes of application scenarios. Thus, generating high-quality sequential consumption data by simulating complex user consumption behaviors is of great importance to real-world applications. Two branches of existing sequence generation methods are both limited in quality. Model-based methods with simplified assumptions fail to model the complex decision process of user consumption, while data-driven methods that emulate real-world data are prone to noises, unobserved behaviors, and dynamic decision space. In this work, we propose to enhance the fidelity and trustworthiness of the data-driven Generative Adversarial Imitation Learning (GAIL) method by blending it with the Exploration and Preferential Return (EPR) model . The core idea of our EPR-GAIL framework is to model user consumption behaviors as a complex EPR decision process, which consists of purchase, exploration, and preference decisions. Specifically, we design the hierarchical policy function in the generator as a realization of the EPR decision process and employ the probability distributions of the EPR model to guide the reward function in the discriminator. Extensive experiments on two real-world datasets of user consumption behaviors on an online platform demonstrate that the EPR-GAIL framework outperforms the best state-of-the-art baseline by over 19% in terms of data fidelity. Furthermore, the generated consumption behavior data can improve the performance of sale prediction and location recommendation by up to 35.29% and 11.19%, respectively, validating its advantage for practical applications. 1 Introduction Consumption behavior data records consumers’ spatio-temporal buying activities at various providers. Understanding the underlying and decisive patterns of user consumption behaviors is of great importance to a variety of applications, such as store recommendation Kowatsch and Maass (2010) , sales prediction Kaneko and Yada (2016) , and site selection Guo et al. (2018) ; Liu et al. (2019) . Particularly, in the burgeoning e-commerce era, online platforms like Meituan Li et al. (2022) ; Ping et al. (2021) and Meta Yaacoub and Najjar (2016) profoundly rely on user consumption behavior data to predict potential purchases and make marketing decisions for substantial commercial revenues. However, the availability and applicability of user consumption behavior data are often restricted by the limitation of data comprehensiveness, e.g. , missing consumption records or covering limited categories of stores. Meanwhile, directly replicating real-world data would make it hard to model counterfactual scenarios Yuan et al. (2022) . As a result, the realistic simulation of user consumption behaviors to produce artificial purchase sequences data with fidelity and utility still remains a valuable but challenging problem. In this paper, we are devoted to generating massive consumption behavior sequences by integrally simulating individuals’ decision processes of whether , where and when to purchase, while preserving the original characteristics of real-world data. Existing solutions of simulating user consumption behavior data can be categorized into two branches, i.e. , model-based methods and data-driven methods . The model-based methods generate consumption sequences explicitly with mathematical and statistical models derived from economical, sociological, or psychological theories Engel et al. (1986) ; Ajzen (1996) ; Said et al. (2001) . In particular, such methods often assume that user consumption behaviors can be represented by a decision process that only features a limited number of factors ( e.g. , consumer’s demand and store preference), which are not fully capable of simulating complex decision processes with complex factors based on spatial and temporal dependencies Ajzen (1996) , especially for consumption behaviors on online platforms. On the other hand, the recent advances of generative adversarial networks Yu et al. (2017) ; Chen et al. (2016) and imitation learning Torabi et al. (2018) ; Ng et al. (2000) shed light on directly fitting real-world consumption behavior data through data-driven approaches. Despite that data-driven approaches are empowered by neural networks and have succeeded in imitating real-world data with better performance, still they cannot fully capture some hidden and decisive patterns Yuan et al. (2022) due to the lack of prior knowledge of real-world consumption behaviors. In this paper, we propose a novel framework by integrating the advantages of model-based methods and data-driven methods , to achieve high-quality user consumption behavior simulation. Our core idea is to leverage a specially designed Exploration and Preferential Return (EPR) model Song et al. (2010) as the guidance of users’ consumption decision process in a data-driven Generative Adversarial Imitation Learning (GAIL) framework Ho and Ermon (2016) . We customize the EPR model to depict the spatial choices of individuals as a two-stage decision process and further capture the characteristic of user consumption behaviors. In particular, the two-decision process explicitly explains two kinds of key decisions by users, i.e. , the decision on whether to explore new stores or return to visited places, and the decision on which location to visit. We implement such a decision process and its statistical characteristics into both the generator and the discriminator of a customized GAIL framework. Specifically, we design a hierarchical policy function that consists of a purchase agent, an exploration agent, and a preference agent in the generator as the realization of the EPR model to generate consumption decisions based on various factors. Moreover, we blend the probability distribution of location choices of the EPR model into the reward function, with the goal to inspire the discriminator to distinguish user consumption behaviors by considering the overall distribution of different consumption choices in the generated sequences. Our contributions can be summarized as follows: (1) We propose a novel EPR-enhanced hierarchical generative imitation learning framework (EPR-GAIL), which exploits the advantages of model-based methods and data-driven methods to efficiently generate sequential consumption data of high quality; (2) We propose to utilize the prior knowledge of the exploration and preferential return model by modeling the EPR decision process in the generator; (3) Extensive experiments on two real-world consumption datasets demonstrate that the proposed EPR-GAIL outperforms the state-of-the-art baseline approaches by reducing the Jensen-Shannon divergence metrics by more than 19.04%. Furthermore, we apply the generated consumption sequence data in sale prediction and store recommendation tasks, and our generated data improves the mean average percentage errors and overall accuracy by over 35.29% and 11.19%, respectively. 2 Problem Formulation We consider a general e-commerce scenario, where customers use the mobile App to access the online platform and explore different stores for shopping and consumption. The consumption history of each user is composed of a series of spatio-temporal records. To pave the way for modeling the spatio-temporal sequences from the consumption datasets with consistency and under different resolutions, we divide time into fixed-length slots and utilize identifiers to represent different online stores. We denote \mathcal{U} , \Omega and \mathcal{T} as the set of users, the set of stores and the set of time slots, respectively. Then, for each user u\in\mathcal{U} , his/her consumption history can be represented by T_{u}=\{(t_{1},l_{1},f_{1}),(t_{2},l_{2},f_{2}),...,(t_{N},l_{N},f_{N})\} . Here, l_{i} is the identifier of the stores with consumption history, t_{i} is the corresponding timestamp, N is the length of consumption sequence, and f_{i}

Read the complete text