SILK: Smooth InterpoLation frameworK for motion in-betweening A Simplified Computational Approach

Elly Akhoundi, Hung Yu Ling, Anup Deshmukh, Judith Butepage · 2025

Read SILK: Smooth InterpoLation frameworK for motion in-betweening A Simplified Computational Approach by Elly Akhoundi, Hung Yu Ling, Anup Deshmukh, Judith Butepage (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-09075.txt.

Introduction

Elly Akhoundi and co-authors simplify motion in-betweening, the animator's tool that fills the frames between key poses. Recent machine learning systems stack skeleton-aware modules and multi-stage training to do it. Their 2025 framework, SILK, bets on one plain transformer encoder and better data decisions instead.

The experiments isolate what actually buys quality. More training data matched or beat architectural cleverness. The choice of pose representation mattered enormously. Adding velocity features sharpened the motion further. The moral is data-centric: how motion is encoded and fed outweighs how exotic the network is. Animators get realistic transitions from a system simple enough to train, inspect, and ship without a research team attached.

Catalog record

CREATORElly Akhoundi, Hung Yu Ling, Anup Deshmukh, Judith Butepage
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-09075

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SILK: Smooth InterpoLation frameworK for motion in-betweening A Simplified Computational Approach Elly Akhoundi, Hung Yu Ling, Anup Deshmukh, Judith Butepage Abstract Motion in-betweening is a crucial tool for animators, enabling intricate control over pose-level details in each keyframe. Recent machine learning solutions for motion in-betweening rely on complex models, incorporating skeleton-aware architectures or requiring multiple modules and training steps. In this work, we introduce a simple yet effective Transformer-based framework, employing a single Transformer encoder to synthesize realistic motions for motion in-betweening tasks. We find that data modeling choices play a significant role in improving in-betweening performance. Among others, we show that increasing data volume can yield equivalent or improved motion transitions, that the choice of pose representation is vital for achieving high-quality results, and that incorporating velocity input features enhances animation performance. These findings challenge the assumption that model complexity is the primary determinant of animation quality and provide insights into a more data-centric approach to motion interpolation. Additional videos and supplementary material are available at https://silk-paper.github.io . 1 Introduction In this work, we focus on developing a deep learning-based approach for solving animation in-betweening. Animation in-betweening is the process of generating intermediate frames to smoothly transition between artist-specified keyframes, creating the illusion of natural movement. Keyframing and in-betweening remain the primary ways to create believable animations while allowing animators to control pose-level details of each keyframe. Existing in-betweening software often fails to generate realistic transitions for large keyframe gaps, necessitating animators to manually insert additional keyframes. With the rise of deep learning, several learning-based solutions have been proposed to solve the long horizon in-betweening problem, e.g., Harvey et al. 2020 ; Kim et al. 2022 ; Zhou et al. 2020 ; Kaufmann et al. 2020 . The most successful machine learning models to-date are Transformer-based approaches that treat in-betweening as a sequence-to-sequence problem Qin et al. 2022 ; Oreshkin et al. 2023 ; Mascaró et al. 2024 . In order to create a sequence-to-sequence setup, the missing input frames are pre-filled either with linearly interpolated values Duan et al. 2022 ; Xu et al. 2024b ; Agrawal et al. 2024 ; Xu et al. 2024a ; Wang et al. 2025 or the predictions of a separate Transformer model Qin et al. 2022 while learnable position embeddings encode the positions of missing frames. Training a single Transformer encoder in this setup has so far only achieved inferior results Kim et al. 2022 ; Duan et al. 2022 compared to more complex models with several encoders or training stages Qin et al. 2022 ; Oreshkin et al. 2023 ; Mascaró et al. 2024 . In this work, we show that data modeling choices and the quantity of data play a more significant role than architecture design. Contrary to previous findings, we demonstrate that a single Transformer encoder can solve the in-betweening task as well as complex models. We propose a simplified approach to motion in-betweening that achieves comparable or superior results to state-of-the-art methods while significantly reducing architectural complexity. Our key findings are: • We demonstrate that a single transformer architecture performs as well as or better than complex models in in-betweening tasks. • We employ only relative position embeddings without any additional embedding types (such as keyframe position embeddings), demonstrating that a single, simple embedding strategy is sufficient. • Contrary to the vast majority of related work, we find that interpolation in the input sequence leads to inferior results compared to simple zero filling. • We demonstrate that creating a more extensive dataset by sampling data points with a smaller offset than used by related works significantly increases performance for simpler models. • We show that operating directly in trajectory space can have several advantages compared to working in local-to-parent space. • We find that including velocity features in the model input boosts the model’s capabilities. 2 Related Work Motion in-betweening refers to the constrained motion synthesis problem in which the final character pose is known in advance, and the generation time window is also specified. Methods to automatically fill the gaps between hand-drawn keyframes have a long history. For example, Kort 2002 introduced an automatic stroke-based system to interpolate between hand-drawn keyframes. Time series models such as recurrent neural networks (RNNs) have been the main approach for several years. Zhang and van de Panne 2018 introduced an RNN-based system to autocomplete keyframes for a simple 2D character. Harvey and Pal 2018 introduced Recurrent Transition Networks (RTN) to autocomplete more complex human motions with a fixed in-betweening length of 60 frames. The key idea is to use two separate encoders, a target encoder and an offset encoder, to encode parts of the future context. RTNs have been extended by Zhou et al. 2020 to allow for variable in-betweening lengths ranging from one to thousands of frames. Concurrently, Harvey et al. 2020 enhanced RTN by adding a time-to-arrival embedding to support varying transition lengths, as well as using scheduled target noise to allow variations and improve robustness in generated transitions. Both Harvey et al. 2020 and Zhou et al. 2020 leveraged adversarial training to further improve the quality of the generated motion. The motion manifold model Tang et al. 2022 conditions motion transitions on control variables, allowing for transition disambiguation while simultaneously ensuring high-quality motion. As a non-recurrent model, Kaufmann et al. 2020 proposed an end-to-end trainable convolutional autoencoder for filling in missing frames. Our proposed model, in contrast to previous RNN-based or convolution-based methods, employs Transformers to handle various forms of missing frames in parallel through a single-shot prediction. Several generative models have been designed that also support in-betweening, e.g., based on Variational Autoencoders He et al. 2022 and diffusion models Tevet et al. 2022 . As we do not focus on generative models, we do not dive deeper into this branch of related work. 2.1 Transformer-based Motion In-betweening A number of Transformer-based approaches have been suggested that treat in-betweening as a sequence-to-sequence problem. These solutions present different versions of a set of design choices such as how to represent the input and output data, how to encode frame embeddings, whether and how to pre-fill the missing frames, whether to use additional constraining keyframes during training, the model architecture and the loss function. As one of the first Transformer-based in-betweening models, Kim et al. 2022 treats motion in-betweening as a masked motion modeling problem, similar to BERT Devlin et al. 2018 in computational linguistics. Kim et al. 2022 aim at a model that can be conditioned both on keyframes and semantic information, such as motion types, to produce the intermediate frames. As a sequence-to-sequence Transformer model operates on both the present keyframes and the missing frames, they propose to fill the missing frames with a linear interpolation between the start and end keyframes. Many of the works following Kim et al. 2022 that we describe below employ the same linear interpolation strategy for the input values Duan et al. 2022 ; Aberman et al. 2020 ; Xu et al. 2024b ; Agrawal et al. 2024 ; Wang et al. 2025 . Extending Kim et al. 2022 , Duan et al. 2022 propose learnable position encoding for keyframes and learn additional embeddings that encode whether a frame is a keyframe,

Read the complete text