MEGC2026: Micro-Expression Grand Challenge on Visual Question Answering

Xinqi Fan, Jingting Li, John See, Moi Hoon Yap, Su-Jing Wang, Adrian K. Davison Department of Computing and Mathematics, Manchester Metropolitan University State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, CAS & Department of Psychology, University of the Chinese Academy of Sciences School of Mathematical and Computer Sciences, Heriot-Watt University Malaysia · 2026

Read MEGC2026: Micro-Expression Grand Challenge on Visual Question Answering by Xinqi Fan, Jingting Li, John See, Moi Hoon Yap, Su-Jing Wang, Adrian K. Davison Department of Computing and Mathematics, Manchester Metropolitan University State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, CAS & Department of Psychology, University of the Chinese Academy of Sciences School of Mathematical and Computer Sciences, Heriot-Watt University Malaysia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08927.txt.

Introduction

Xinqi Fan and colleagues run the 2026 micro-expression grand challenge on video question answering. Micro-expressions are brief, involuntary face movements people show while trying to hide an emotion, usually in high-stakes settings. The challenge adds two tasks, short-video and long-video question answering, and requires all entrants to post results on a public leaderboard.

Catalog record

CREATORXinqi Fan, Jingting Li, John See, Moi Hoon Yap, Su-Jing Wang, Adrian K. Davison Department of Computing and Mathematics, Manchester Metropolitan University State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, CAS & Department of Psychology, University of the Chinese Academy of Sciences School of Mathematical and Computer Sciences, Heriot-Watt University Malaysia
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19307
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08927

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MEGC2026: Micro-Expression Grand Challenge on Visual Question Answering Xinqi Fan, Jingting Li, John See, Moi Hoon Yap, Su-Jing Wang, Adrian K. Davison Department of Computing and Mathematics, Manchester Metropolitan University State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, CAS & Department of Psychology, University of the Chinese Academy of Sciences School of Mathematical and Computer Sciences, Heriot-Watt University Malaysia Abstract Facial micro-expressions (MEs) are involuntary movements of the face that occur spontaneously when a person experiences an emotion but attempts to suppress or repress the facial expression, typically found in a high-stakes environment. In recent years, substantial advancements have been made in the areas of ME recognition, spotting, and generation. The emergence of multimodal large language models (MLLMs) and large vision-language models (LVLMs) offers promising new avenues for enhancing ME analysis through their powerful multimodal reasoning capabilities. The ME grand challenge (MEGC) 2026 introduces two tasks that reflect these evolving research directions: (1) ME video question answering (ME-VQA), which explores ME understanding through visual question answering on relatively short video sequences, leveraging MLLMs or LVLMs to address diverse question types related to MEs; and (2) ME long-video question answering (ME-LVQA), which extends VQA to long-duration video sequences in realistic settings, requiring models to handle temporal reasoning and subtle micro-expression detection across extended time periods. All participating algorithms are required to submit their results on a public leaderboard. More details are available at https://megc2026.github.io . I Introduction Fig. 1: An overview of Micro-Expression Grand Challenges (MEGCs). When a person attempts to suppress a facial expression, typically in a high-stakes scenario, there is a possibility of an involuntary movement occurring on the face, namely a facial micro-expression (ME) [ 3 ] . As such, the duration of an ME is very short, generally being no more than 500 milliseconds (ms), and is the telltale sign that distinguishes them from a normal facial expression [ 9 ] . Computational analysis and automation of tasks on MEs is an emerging area in multimedia research. However, only recently, the availability of a few spontaneously induced facial ME datasets has provided the impetus to advance further from the computational aspect. Over the years, we have organised a series of ME grand challenges (MEGCs) to explore emerging directions and advance the state-of-the-art in ME research. To date, seven MEGCs have been held: FG’18 [ 20 ] , focusing on ME recognition; FG’19 [ 16 ] , addressing both ME spotting and recognition; FG’20 [ 8 ] , centered on ME spotting; MM’21 [ 11 ] , introducing ME generation and continuing with spotting; MM’22 [ 10 ] , continuing with spotting and generation; MM’23 [ 6 ] , with a focus on spotting; MM’24 [ 15 ] , which introduced the spot-then-recognize paradigm and cross-cultural spotting; and MM’24 [ 7 ] , which introduced visual-question answering. An overview of all the MEGCs can be found in Fig. 1 . This year marks the 9th MEGC, held in conjunction with Face and Gesture (FG) 2026. Two tasks are featured: (1) ME video question answering (ME-VQA), and (2) ME long-video question answering (ME-LVQA). Task 1: ME-VQA. The rise of multimodal large language models (MLLMs) and large vision-language models (LVLMs) has opened new opportunities for ME analysis through their advanced multimodal reasoning capabilities. In this task, traditional ME annotations, such as emotion categories and action units, are reformulated into question-answer (QA) pairs. Given a video sequence of relatively short duration along with a natural language prompt, the model is expected to generate answers that describe the observed MEs, their attributes, and related information. This task introduces a novel multimodal direction for ME understanding, promoting interpretability, flexibility, and human-aligned interaction through natural language. ME-VQA was successfully introduced in MEGC 2025, and we continue with this task in MEGC 2026 with some modifications. Task 2: ME-LVQA. ME-LVQA is a new task introduced in MEGC 2026. Extending from the ME-VQA task, ME-LVQA addresses the challenge of analyzing ME within long-duration video sequences in realistic, naturalistic settings. This task requires models to handle temporal reasoning over extended periods, spotting and understanding subtle MEs amidst natural facial movements and expressions. Participants must provide answers to questions about MEs in long videos with multiple expression events, making this a more challenging variant that tests the robustness and practical applicability of ME analysis methods in real-world scenarios. II Task 1: Video Question Answering II-A Task Formulation In the ME-VQA setting, the input to the model consists of (i) a sequence of video frames capturing subtle facial movements associated with MEs, and (ii) a corresponding natural language question related to the emotions or attributes of the sequence. The model is required to generate an answer in natural language, drawing on its understanding of both the visual cues and the question of MEs. These questions can cover a wide range of attributes, from binary classification such as “Is the action unit lip corner depressor shown on the face?” to multiclass classification like “What is the expression class?”, and to more complex inquiries like “Provide a detailed analysis of the micro-expression observed in this clip.”. II-B Dataset We do not have a restriction on the training set, while we recommend participants to use SAMM [ 5 ] , CASME II [ 17 ] , SMIC [ 13 ] , CAS(ME) 3 [ 9 ] , or 4DME [ 12 ] datasets for training. To facilitate the task training, we curated a dataset from the SAMM, CASME II, and SMIC annotations to a ME-VQA (ME-VQA-v1) dataset 1 1 1 The ME-VQA version dataset is available at https://megc2025.github.io/challenge.html [ 7 ] . In addition to this, in MEGC 2026, we refined some questions and answers and thus provide the ME-VQA-v2 dataset 2 2 2 The ME-VQA-v2 dataset is available at https://megc2026.github.io/challenge.html that is suitable to train an ME-VQA model. The ME-VQA-v2 test set contains 24 ME clips, including 7 clips from the SAMM Challenge dataset [ 19 , 5 ] and 17 clips cropped from different videos in CAS(ME) 3 (unreleased before). The frame rate for SAMM is 200 fps, and the frame rate for CAS(ME) 3 is 30 fps. The participants should test on this unseen dataset. TABLE I: Baseline results of the ME-VQA task with ME-VQA-v2 training and test sets. The test set results of the ME-VQA task using Qwen2.5VL-3B and Qwen3VL-4B (the baseline methods) trained on the curated ME-VQA dataset. The coarse emotion class refers to positive, negative, and surprise. The fine-grained emotion class refers to happiness, surprise, fear, disgust, anger, and sadness. ZS refers to zero-shot performance, while FT refers to fine-tuned performance. Method SAMM CAS(ME) 3 Overall Coarse Fine-Grained Coarse Fine-Grained Coarse Fine-Grained UF1 UAR UF1 UAR BLEU ROUGE UF1 UAR UF1 UAR BLEU ROUGE UF1 UAR UF1 UAR BLEU ROUGE Qwen2.5VL-3B (ZS) 0.242 0.333 0 0 0.090 0.295 0.262 0.333 0.057 0.048 0.089 0.315 0.256 0.333 0.057 0.048 0.065 0.312 Qwen2.5VL-3B (FT) 0.206 0.25 0.057 0.1 0.234 0.331 0.376 0.515 0.044 0.111 0.109 0.375 0.328 0.422 0.059 0.117 0.122 0.362 Qwen3VL-4B (ZS) 0.242 0.333 0 0 0.068 0.229 0.262 0.382 0.114 0.222 0.065 0.382 0.256 0.333 0.079 0.200 0.066 0.339 Qwen3VL-4B (FT) 0.242 0.333 0.178 0.250 0.128 0.416 0.262 0.333 0 0

Read the complete text