Data-Semantics-Aware Recommendation of Diverse Pivot Tables DOI: XXXXXXX.XXXXXXX Conference: International Conference on Management of Data; May 31–June 5, 2026; Bengaluru, India ISBN: 978-1-4503-XXXX-X/2018/06

Whanhee Cho, Anna Fariha · 2025

Read Data-Semantics-Aware Recommendation of Diverse Pivot Tables DOI: XXXXXXX.XXXXXXX Conference: International Conference on Management of Data; May 31–June 5, 2026; Bengaluru, India ISBN: 978-1-4503-XXXX-X/2018/06 by Whanhee Cho, Anna Fariha (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06171.txt.

Introduction

Whanhee Cho and Anna Fariha present a 2025 system that suggests pivot tables for large data sets. Pivot tables sum up data by grouping rows and adding up chosen fields. Picking good groupings by hand is slow when a data set has many fields. Their system, SAGE, scores each table for how much insight it gives. It uses the meaning of the data, not just its shape. It also makes sure the set of tables it picks are unlike each other.

A fast stepwise method chooses a budget of tables with high total value. Tests on three real data sets showed the system beat rival methods. It also scaled to data sets with many fields without bogging down. Case studies compared it with shop software and large language models. The authors say meaning-aware scoring is the key gain over older tools.

Catalog record

CREATORWhanhee Cho, Anna Fariha
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06171

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data-Semantics-Aware Recommendation of Diverse Pivot Tables DOI: XXXXXXX.XXXXXXX Conference: International Conference on Management of Data; May 31–June 5, 2026; Bengaluru, India ISBN: 978-1-4503-XXXX-X/2018/06 Whanhee Cho, Anna Fariha Abstract . Data summarization is essential to discover insights from large datasets. In spreadsheets, pivot tables offer a convenient way to summarize tabular data by computing aggregates over some attributes, grouped by others. However, identifying attribute combinations that will result in useful pivot tables remains a challenge, especially for high-dimensional datasets. We formalize the problem of automatically recommending insightful and interpretable pivot tables, eliminating the tedious manual process. A crucial aspect of recommending a set of pivot tables is to diversify them. Traditional works inadequately address the table-diversification problem, which leads us to consider the problem of pivot table diversification . We present SAGE, a data- s emantics- a ware system for recommendin g k-budgeted div e rse pivot tables, overcoming the shortcomings of prior work for top-k recommendations that cause redundancy. SAGE ensures that each pivot table is insightful , interpretable , and adaptive to the user’s actions and preferences, while also guaranteeing that the set of pivot tables are different from each other, offering a diverse recommendation. We make two key technical contributions: (1) a data-semantics-aware model to measure the utility of a single pivot table and the diversity of a set of pivot tables, and (2) a scalable greedy algorithm that can efficiently select a set of diverse pivot tables of high utility, by leveraging data semantics to significantly reduce the combinatorial search space. Our extensive experiments on three real-world datasets show that SAGE outperforms alternative approaches, and efficiently scales to accommodate high-dimensional datasets. Additionally, we present several case studies to highlight SAGE’s qualitative effectiveness over commercial software and Large Language Models (LLMs). 1. Introduction Data is at the heart of data-driven decision making. We rely on data—specifically, trends observed in the data—to obtain insights ( Ding et al. 2019 ) that help us make informed decisions. However, due to limitations in human comprehensibility, data must be summarized ( Joglekar et al. 2019 ; Sarawagi 2001 ; Gebaly et al. 2014 ) to enable humans observe trends and discover insights from the summaries—either directly or via visualizations ( Vartak et al. 2015 ) over the summaries. One of the most common techniques to summarize data is aggregation . Simple aggregations involve functions (e.g, SUM ) to aggregate all rows. More nuanced aggregations involve multiple groupings of the entities (e.g., GROUP BY GENDER, MARITAL_STATUS ) and then aggregating each group separately. While SQL provides functionalities for any custom aggregation query, it is not suitable for novices, and has various interface-related limitations. Thanks to the ubiquity of spreadsheet software—such as Microsoft Excel ( Microsoft 2025 ) , Google Sheets ( Google 2025 ) , Apple Numbers ( Inc. 2025 ) , etc.—a substantial portion of businesses (around 60% ( Diginomica 2025 ) ) and about 2 billion people ( MOOC.org nd ) use spreadsheets for data management and analysis. These users rely on pivot tables , a summary of tabular data that computes aggregates over a few data attributes, grouped by other data attributes. Most commercial spreadsheets include a built-in and user-friendly mechanism to construct pivot tables. Spreadsheet pivot tables are particularly suitable for novices, where they can rearrange, group, and aggregate data using intuitive interfaces such as drag-and-drop. Unlike SQL aggregates, spreadsheet pivot tables offer dynamic user interactions, allowing interactive exploration such as drilling down, filtering, sorting, etc. In an exploratory setting where the goal is to discover interesting data trends, a key challenge in constructing insightful pivot tables lies in selecting the right parameters , i.e., determining which attributes to use for groupings and aggregations. This task becomes even harder when users lack domain knowledge, face missing or cryptic attribute names, or work with high-dimensional data. In such cases, users must manually explore a vast space of parameter combinations through a tedious trial-and-error process. This involves experimenting with various combinations of (1) grouping attributes, (2) aggregation attributes, and (3) aggregation functions, then manually assessing the insightfulness of the resulting pivot tables. We illustrate this challenge with the following example. ID Gender Age Experience Degree Department Salary 1 Male 48 3 PhD IT $50,000 2 Female 32 1 MS Sales $20,000 3 Male 45 12 PhD HR $100,000 Figure 1 . A sample table from an employee compensation dataset. Example 1.0. Sasha is investigating potential factors affecting salary across various groups in an employee compensation dataset over 21 attributes including ID , Gender , Age , Experience , Degree , Department , Salary , etc. (Figure 1 ). With an aim to discover salary discrepancies across various group combinations, she starts with the pivot table shown in Figure 2 : she puts Gender in the row-groups {\smallA}⃝ and Department in the column-groups {\smallB}⃝ ; and chooses Salary as an aggregate attribute {\smallC}⃝ and Average as the aggregate function {\smallD}⃝ . Sasha is interested in Salary discrepancies, so her choice for {\smallC}⃝ is fixed. However, she still needs to explore various combinations for {\smallA}⃝ , {\smallB}⃝ , and {\smallD}⃝ . Sasha wishes to put demographic attributes (e.g., Gender , Race , Age , Marital Status , etc.) in the row-groups, as any discrepancy across different rows will indicate discrimination, and all other attributes in the column-groups. For this particular dataset, there are 5 demographic attributes and 15 non-demographic attributes. Sasha decides to explore 4 aggregation functions: MAX , MIN , AVERAGE , and SUM , as all of them can expose different types of discrepancies. This leaves her \;5\times 15\times 4=300 possible combinations, 1 1 1 Sasha chose only one option for each parameter. Multiple options (e.g., Gender and Race for row-groups) will further increase the search space of possible pivot tables. and she must carefully inspect each pivot table to identify salary discrepancies, by manually contrasting the pivot table cells. Assuming each pivot table has 10 cells on average and it takes about 2 minutes to examine each pivot table, Sasha needs 300\times 2=600 minutes ( 10 hours)! Figure 2 . A pivot table requires 4 parameters: {\smallA}⃝ row-groups, {\smallB}⃝ column-groups, {\smallC}⃝ aggregate attributes, and {\smallD}⃝ aggregate functions for each aggregate attribute. Users can choose multiple values for each parameter. In Example 1.1 , Sasha has fixed {\smallC}⃝ , but still needs to explore {\smallA}⃝ (5 options), {\smallB}⃝ (15 options), and {\smallD}⃝ (4 options). Recommending Pivot Tables. Example 1.1 highlights the need for a smart recommendation system that can automatically suggest the “best” pivot tables, relieving Sasha from tedious, error-prone work. While existing spreadsheet software, such as Microsoft Excel and Google Sheets, are equipped with features for automatic pivot table recommendation, they have several shortcomings. We proceed to highlight some of their key limitations through Example 1.2 . Example 1.0. Frustrated by the manual exploration, Sasha gives pivot table recommendation features of commercial spreadsheet software a try (Figure 3 ). Google Sheets provides three recommendations. 2 2 2 Test conducted in February 2025. However, the recommended pivot tables often include too many aggregated attributes beyond what she wanted ( Salary ), resulting in convoluted and large pivot tables. Sasha also observes that most recommendations are redundant—they default to the groupings by

Read the complete text