GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interaction

Meisam Jamshidi Seikavandi 1,2 , Alice Modica 1,3 , Anna Obara 1,4 , Shan Ahmed Shaffi 1 , Fabricio Batista Narcizo 1,2 , Tanya Ignatenko 1 , Ted Vucurevich 1 , Karim Haddad 1 , Daniel Barratt 3 , Daniel Overholt 4 , Jesper Bünsow Boldt 1 , Paolo Burelli 2 , Andrew Burke Dittberner 1 1 GN Advanced Science, GN Group, Ballerup, Denmark 2 IT University of Copenhagen, brAIn lab, Copenhagen, Denmark 3 Copenhagen Business School, Copenhagen, Denmark 4 Aalborg University, Denmark · 2026

Read GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interaction by Meisam Jamshidi Seikavandi 1,2 , Alice Modica 1,3 , Anna Obara 1,4 , Shan Ahmed Shaffi 1 , Fabricio Batista Narcizo 1,2 , Tanya Ignatenko 1 , Ted Vucurevich 1 , Karim Haddad 1 , Daniel Barratt 3 , Daniel Overholt 4 , Jesper Bünsow Boldt 1 , Paolo Burelli 2 , Andrew Burke Dittberner 1 1 GN Advanced Science, GN Group, Ballerup, Denmark 2 IT University of Copenhagen, brAIn lab, Copenhagen, Denmark 3 Copenhagen Business School, Copenhagen, Denmark 4 Aalborg University, Denmark (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19765.txt.

Introduction

Seikavandi and colleagues release GroupAffect-4, a dataset of forty people in ten four-person groups. The groups tackle pooling, negotiation, idea generation and a public-goods game together. Each person wears body sensors and eye-tracking glasses with a close microphone, alongside self-reports, outcomes and personality scores on a shared clock. Coverage tops ninety-one percent for body signals and ninety-eight for eye tracking, and a check validates the negotiation block. Fifteen test targets span single people, pairs and groups, with leave-one-group-out baselines included.

Catalog record

CREATORMeisam Jamshidi Seikavandi 1,2 , Alice Modica 1,3 , Anna Obara 1,4 , Shan Ahmed Shaffi 1 , Fabricio Batista Narcizo 1,2 , Tanya Ignatenko 1 , Ted Vucurevich 1 , Karim Haddad 1 , Daniel Barratt 3 , Daniel Overholt 4 , Jesper Bünsow Boldt 1 , Paolo Burelli 2 , Andrew Burke Dittberner 1 1 GN Advanced Science, GN Group, Ballerup, Denmark 2 IT University of Copenhagen, brAIn lab, Copenhagen, Denmark 3 Copenhagen Business School, Copenhagen, Denmark 4 Aalborg University, Denmark
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE114475
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.19765

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interaction Meisam Jamshidi Seikavandi 1,2 , Alice Modica 1,3 , Anna Obara 1,4 , Shan Ahmed Shaffi 1 , Fabricio Batista Narcizo 1,2 , Tanya Ignatenko 1 , Ted Vucurevich 1 , Karim Haddad 1 , Daniel Barratt 3 , Daniel Overholt 4 , Jesper Bünsow Boldt 1 , Paolo Burelli 2 , Andrew Burke Dittberner 1 1 GN Advanced Science, GN Group, Ballerup, Denmark 2 IT University of Copenhagen, brAIn lab, Copenhagen, Denmark 3 Copenhagen Business School, Copenhagen, Denmark 4 Aalborg University, Denmark Abstract Existing affective-computing, social-signal-processing, and meeting corpora capture important parts of human interaction, but they rarely support analysis of affect in co-located groups as a coupled individual, interpersonal, and group-level process. The required signals (per-participant physiology, eye movement, audio, self-report, task outcomes, and personality) are usually fragmented across separate dataset traditions. We introduce GroupAffect-4 , a multimodal corpus of 40 participants in 10 four-person groups, each completing four ecologically varied collaborative tasks spanning information pooling, negotiation, idea generation, and a public-goods game. Each participant is instrumented with a wrist-worn physiology sensor, eye-tracking glasses, and a close-talk microphone; sessions include continuous affect self-reports, post-task questionnaires, task outcomes, and Big-Five personality scores, all time-aligned to a shared clock. The dataset covers over 91% of expected physiology windows and 98% of eye-tracking windows, with strong task validity confirmed by a clear affective manipulation check across the negotiation block. We define fifteen benchmarkable targets spanning three analysis levels within-person state, between-person traits, and group dynamics and report leave-one-group-out feasibility baselines establishing the dataset’s evaluative scope. GroupAffect-4 is released with a BIDS ( BIDS )-inspired structure, Croissant metadata, a datasheet, per-session quality reports, and open processing scripts. Code and processing scripts are available at https://github.com/meisamjam/GroupAffect-4 ; the dataset is publicly archived at https://zenodo.org/records/20037847 . BIDS Brain Imaging Data Structure VFOA visual focus of attention VAD Valence-Arousal-Dominance PAD Pleasure-Arousal-Dominance BFI-44 Big-Five Inventory LSL Lab Streaming Layer SAM Self-Assessment Manikin PPG photoplethysmography EDA electrodermal activity IMU inertial measurement unit QC quality control HRV heart-rate variability RMSSD root mean square of successive differences DUA Data Use Agreement FAIR Findable, Accessible, Interoperable, and Reusable LOGO-CV leave-one-group-out cross-validation KNN k -nearest-neighbour AUC area under the curve BH-FDR Benjamini–Hochberg false discovery rate MAE mean absolute error NGT nominal group technique XDF Extensible Data Format MAD median absolute deviation SSE Server-Sent Events HR heart rate SCR skin conductance response RR R-R interval ET eye tracking EEG electroencephalography GSR galvanic skin response dBFS decibels relative to full scale 1 Introduction Meetings are a central setting where affect, cognition, and social dynamics co-occur under collaborative pressure 8 ; 17 ; 23 . Understanding them requires observation at three co-occurring levels: within each person (physiological state, attention, cognitive load), between people (personality, trust, negotiation stance), and across the group (floor balance, coordination, collective outcomes), following multilevel views of team process and social interaction 23 ; 59 . Yet, most multimodal affect corpora address at most one of these levels, and typically in single-participant or dyadic settings 39 ; 6 ; 19 . Co-located groups impose qualitatively different constraints: turn-taking is multi-party, gaze targets multiply, roles can shift within a session, and physiological responses must be interpreted against an evolving social context 41 ; 15 ; 58 ; 59 . Theoretically, this situates group affect at the intersection of individual appraisal processes, where personal relevance and coping capacity shape felt response 21 ; 43 , and interpersonal emotion dynamics, where the ongoing reactions of co-present others can reshape appraisal, expression, and regulation 36 ; 56 ; 2 . Datasets combining per-participant physiology, gaze, audio, task outcomes, self-reports, and personality measures in the same co-located group setting are rare among the publicly described corpora reviewed in Sections 2 and 1 . We present GroupAffect-4 , a multimodal corpus of four-person group interaction designed to support analysis at three levels: within-person affective and cognitive state, between-person stable traits, and group-level interaction dynamics within the same synchronised release. The motivating premise is not scale, but density: each participant is observed simultaneously through autonomic sensing, egocentric eye tracking, close-talk audio, task outcomes, and in-situ self-report, so the same session can support questions about regulation, attention, conversational floor dynamics, and cooperation that are usually split across separate datasets. Simultaneity matters because cross-level relationships such as whether physiological arousal tracks subjective dominance, or whether audio overlap predicts cognitive demand independently of physiology, can only be tested when modalities are co-observed at the same moment across all participants. This design also builds on prior work showing that gaze dynamics, personality, and multimodal physiological signals can contribute complementary information for emotion perception and face-to-face affect modelling 47 ; 45 ; 46 ; 48 . This paper is a dataset-characterisation paper: its primary contribution is a transparent description of what the dataset contains, how modalities are synchronised, what can be evaluated, and where the main limitations lie. Figure 1 gives a schematic of the study design, modality stack, task sequence, and benchmarkable outputs. 2 Literature and Dataset Positioning GroupAffect-4 is a compact, high-density dataset rather than a scale-first corpus, following the dataset-characterisation tradition in which value depends not only on sample size but also on documentation, synchronisation, annotation quality, and evaluative scope 13 ; 60 ; 33 . Studying group affect requires capturing three co-occurring levels simultaneously: individual affective and cognitive state, interpersonal dynamics, and group-level coordination and outcomes 23 ; 59 . Individual state is supported by physiology, pupil, and self-report; interpersonal dynamics by audio and gaze; and group-level coordination by floor-balance and outcome measures. The central comparison question is therefore not which prior corpus is largest, but which combines the per-participant signals needed at each level – wearable physiology, egocentric gaze, close-talk audio, in-situ self-report, explicit task outcomes, and personality measures – in one synchronised co-located four-person release. Classic affective corpora provide necessary background: IEMOCAP 6 , RECOLA 39 , and DEAP 19 address dyadic or individual settings; AMIGOS adds group media-viewing with wearable physiology and personality 27 ; K-EmoCon provides wearable sensing with rich emotion annotation in dyadic debates 35 ; UDIVA covers dyadic interaction with personality and physiology 34 . Among multiparty corpora, AMI and ICSI are canonical meeting baselines 8 ; 17 ; ELEA, GAP, and UGI add small-group decision tasks with questionnaires and performance measures 42 ; 62 ; 3 . The KTH-Idiap Group-Interviewing corpus provides four-person discussions with close-talk microphones and gaze/ VFOA ( VFOA ) design 30 ; GaMMA contributes four-person polyadic conversations with eye-tracking glasses, motion, and multi-talker audio 11 ; a recent agile-team dataset covers four-person software teams with audio, visual attention, and equity surveys 26 ; and G-REx contributes large-scale group PPG/EDA in naturalistic movie sessions 4 . The ingredients already exist but are distributed across corpora: task structure and outcomes in AMI, ELEA, GAP, UGI, and the agile-team dataset; physiology and affect labels in AMIGOS, K-EmoCon, and G-REx; gaze-rich multiparty sensing in KTH-Idiap and GaMMA. Table 1 tabulates the closest comparators per axis. Among publicly described datasets reviewed here, we did not find an earlier dataset that clearly combines all these strands in one co-located four-person benchmarkable release. GroupAffect-4 is positioned between fully lab-controlled paradigms (tightly constrained illumination, timing, and stimuli) and

Read the complete text