Comparing Without Saying: A Dataset and Benchmark for Implicit Comparative Opinion Mining from Same-User Reviews DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information system

Thanh-Lam T. Nguyen, Ngoc-Quang Le, Quoc-Trung Phu, Thi-Phuong Le, Ngoc-Huyen Pham, Phuong-Nguyen Nguyen, Hoang-Quynh Le · 2026

Read Comparing Without Saying: A Dataset and Benchmark for Implicit Comparative Opinion Mining from Same-User Reviews DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information system by Thanh-Lam T. Nguyen, Ngoc-Quang Le, Quoc-Trung Phu, Thi-Phuong Le, Ngoc-Huyen Pham, Phuong-Nguyen Nguyen, Hoang-Quynh Le (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13575.txt.

Introduction

Thanh-Lam T. Nguyen and co-authors built a data set for likes stated with no plain compare words. Past work on comparative opinion mining read plain cues such as better than. Such cues are rare in real reviews. Most likes are hid. A user pans one item in one review and praises a next in a next review, with no cue to join them.

Their set, SUDO, holds same user reviews in pairs. From a pair, a tool must infer which item the user likes more. That is the true form of the task in the wild. For review teams, a set that fits the hid form gives a fair test past cue hunts.

Catalog record

CREATORThanh-Lam T. Nguyen, Ngoc-Quang Le, Quoc-Trung Phu, Thi-Phuong Le, Ngoc-Huyen Pham, Phuong-Nguyen Nguyen, Hoang-Quynh Le
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-13575

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Comparing Without Saying: A Dataset and Benchmark for Implicit Comparative Opinion Mining from Same-User Reviews DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Data mining CCS: Computing methodologies Machine learning Thanh-Lam T. Nguyen, Ngoc-Quang Le, Quoc-Trung Phu, Thi-Phuong Le, Ngoc-Huyen Pham, Phuong-Nguyen Nguyen, Hoang-Quynh Le Abstract . Existing studies on comparative opinion mining have mainly focused on explicit comparative expressions, which are uncommon in real-world reviews. This leaves implicit comparisons – where users express preferences across separate reviews – largely underexplored. We introduce SUDO , a novel dataset for implicit comparative opinion mining from same-user reviews, allowing reliable inference of user preferences even without explicit comparative cues. SUDO comprises 4,150 4,150 annotated review pairs ( 15,191 15,191 sentences) with a bi-level structure capturing aspect-level mentions and review-level preferences. We benchmark this task using two baseline architectures: Traditional Machine Learning- and Language Model-based baselines. Experimental results show that while the latter outperforms the former, overall performance remains moderate, revealing the inherent difficulty of the task and establishing SUDO as a challenging and valuable benchmark for future research. 1. Introduction In today’s market, where countless brands and options are available, users often struggle to make informed decisions. Traditional reviews primarily capture individual experiences, but rarely offer direct comparisons between alternatives. Although consumers may have experienced multiple products, they rarely provide explicit comparisons in their reviews. Comparative opinion mining addresses this gap by analyzing and comparing different options. It helps users discern key differences and make more informed choices, particularly when evaluating similar products ( 14 ) . As illustrated in Figure 1 , user opinions can be expressed through explicit or implicit comparisons. While explicit comparisons clearly state a preference between products, implicit ones are often spread across separate reviews, requiring contextual inference for interpreting user preferences. Such reviews may contain valuable insights, but without structured comparisons, it is difficult for users to determine which aspects matter most or which product performs better overall. As a result, users often struggle to extract relevant insights from an overwhelming volume of fragmented reviews. Given two reviews written by the same user for different products, the task of implicit comparative opinion mining is to infer the preferred product for each defined aspect. We prioritize the same-user setting to mitigate noise arising from individual behavioral variances. Consider a strict user who gives low ratings and writes brief summaries, versus a lenient user known for high ratings and detailed reviews. Paradoxically, a rating of “good” from the former often implies higher quality than “amazing” from the latter. By isolating comparisons to the same user, we remove inconsistencies and capture preferences against a baseline. Figure 1 . Illustration of explicit vs. implicit comparative opinions in user reviews. Explicit: Direct comparison using terms like ‘ more refreshing than ’. Implicit: Two separate reviews from the same user. Preference is implied – harder to detect. Although several comparative opinion mining datasets have been proposed in recent years, most of them primarily focus on explicit comparisons, where comparative statements are explicitly expressed in a single review. As a result, the subtler and more realistic case of implicit comparisons remains underexplored. Some recent efforts have attempted to address implicit comparisons by pairing reviews of different products but these datasets typically involve reviews written by different users. Therefore, the paired reviews often differ significantly in writing style, personal preferences, and contextual structure. These inconsistencies make it difficult to isolate the true comparative intent and understand implicit preferences clearly. To address this gap, we introduce SUDO ( S ame U ser – D ifferent O bjects/products), a dataset that captures implicit comparative preferences of the same user across different products. SUDO consists of review pairs written by the same user, allowing inference of subtle preferences without considering user-specific differences. It features a hierarchical bi-level annotation scheme in which sentences are annotated with aspect-level labels, while comparative opinions are annotated at the review level. To our knowledge, SUDO is the first dataset to systematically capture implicit product comparisons from the perspective of the same user. As baselines, we present two architectures – Traditional Machine Learning- and Language Model-based baselines – to address the problem of comparing two reviews across aspects. The dataset, models, and source code will be made publicly available upon the formal acceptance and publication of this work. 2. Related Work Comparative opinion mining ( 6 ) was pioneered by extracting comparative sentences from user-generated content, introducing two key subtasks: sentence identification and relation extraction, paving the way for later research. Opinion orientation in comparative sentences ( 3 ) was addressed by a rule-based method that identified which entity was preferred by the author using domain knowledge and contextual cues. However, it did not account for complex structures or inter-sentence comparisons commonly found in user reviews. The Comparative Opinion Quintuple Extraction (COQE) task and dataset ( 8 ) – which extend traditional comparative mining by extracting all comparative opinion quintuples (Subject, Object, Comparative Aspect, Comparative Opinion, Comparative Preference) – were presented. A multistage BERT-based approach significantly outperformed baseline systems in three datasets. Nevertheless, inter-sentence comparisons were not the focus of this work. The CoCoTrip dataset ( 5 ) – which utilizes summarization to highlight contrastive and common points between hotels based on multiple user reviews – is tangentially related. Although not focused on opinion mining, it shares the goal of extracting differences between entities. However, it is relatively small (48 pairs) and relies on human-written summaries, limiting natural linguistic variation. The VCOM corpus and benchmark model in the Vietnamese smartphone domain ( 2 ) represent a notable contribution to comparative opinion mining. The dataset focuses on explicit comparative structures extracted from online product reviews, comprising over 2,400 annotated comparative tuples. Its reliance on overt comparative language limits the usefulness in real-world scenarios dominated by implicit preferences, making it less suitable for capturing subtle comparative intents. Despite significant progress, most existing studies remain constrained by their reliance on explicit comparative sentences and limited ability to handle arbitrary product pairs. Our dataset and baselines address these challenges by uncovering implicit comparative opinions embedded in same-user review pairs. We also provide a detailed comparison between the SUDO dataset and other related corpora to highlight its unique characteristics and applicability in Section 3.2 and Table 1 . 3. Dataset Construction 3.1. Annotation Pipeline Figure 2 . Data annotation pipeline. Our SUDO dataset is built upon the BeerAdvocate corpus ( 9 ) , whose reviews naturally cover four sensory aspects: appearance , aroma , palate , and taste . This dataset consists of user-generated beer reviews in structured tabular form and contains approximately 1.5 million reviews collected over a decade. We chose the beer domain because its reviews are rich in aspect-level descriptions and highly detailed, making them well-suited for analyzing implicit comparative opinions. Moreover, the dataset’s large-scale, user-identified reviews enable the construction of same-user pairs, which is a key requirement for our task design. Since real-world reviews often intertwine these aspects with personal impressions, we designed a two-step annotation process (see Figure 2 ). In the first step, each sentence is examined to determine whether it explicitly refers to any of the

Read the complete text