Temporal Visual Semantics-Induced Human Motion Understanding with Large Language Models

Zheng Xing, Weibing Zhao · 2025

Read Temporal Visual Semantics-Induced Human Motion Understanding with Large Language Models by Zheng Xing, Weibing Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22249.txt.

Description

Zheng Xing and Weibing Zhao improve unsupervised human motion segmentation by letting a language model label what the body is doing. Cutting motion sequences into meaningful segments is often done with subspace clustering, but classic methods ignore temporal semantics. Their idea is to ask a large language model, working from images, whether consecutive frames show the same motion, and feed that judgment back into the clustering.

The resulting method adds a temporal regularizer that pulls each frame's subspace embedding toward its neighbors' embeddings, and a matching constraint during segmentation itself. A feedback loop keeps refining the embedding from the segmentation output. On four benchmark motion datasets, the approach outperformed current state-of-the-art methods for unsupervised segmentation.

Catalog record

CREATORZheng Xing, Weibing Zhao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE119 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-22249

Browse the full library · About the Tower of Babel