Temporal Visual Semantics-Induced Human Motion Understanding with Large Language Models
Zheng Xing, Weibing Zhao · 2025
Read Temporal Visual Semantics-Induced Human Motion Understanding with Large Language Models by Zheng Xing, Weibing Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22249.txt.
Description
Zheng Xing and Weibing Zhao improve unsupervised human motion segmentation by letting a language model label what the body is doing. Cutting motion sequences into meaningful segments is often done with subspace clustering, but classic methods ignore temporal semantics. Their idea is to ask a large language model, working from images, whether consecutive frames show the same motion, and feed that judgment back into the clustering.
The resulting method adds a temporal regularizer that pulls each frame's subspace embedding toward its neighbors' embeddings, and a matching constraint during segmentation itself. A feedback loop keeps refining the embedding from the segmentation output. On four benchmark motion datasets, the approach outperformed current state-of-the-art methods for unsupervised segmentation.
Catalog record
| CREATOR | Zheng Xing, Weibing Zhao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 119 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-22249