LensCraft: Your Professional Virtual Cinematographer

Zahra Dehghanian, Morteza Abolghasemi, Hossein Azizinaghsh, Amir Vahedi, Hamid Beigy, Hamid R. Rabiee · 2025

Read LensCraft: Your Professional Virtual Cinematographer by Zahra Dehghanian, Morteza Abolghasemi, Hossein Azizinaghsh, Amir Vahedi, Hamid Beigy, Hamid R. Rabiee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00988.txt.

Introduction

Zahra Dehghanian and co-authors present LensCraft, a system that works as a virtual cinematographer for digital creators. Filmmakers and animators often struggle to turn a creative idea into exact camera moves. Earlier automated systems treat the subject as a single point, ignoring which way it faces and how much space it takes up, which limits their sense of the scene.

LensCraft instead imitates a skilled camera operator. It pairs a simulation framework that produces high-quality training data with a neural model that follows the script while staying aware of the subject's volume and motion. Creators can steer it with text prompts, a subject path, key points, or a full camera path. The design runs in real time with low computing cost. Tests on still and moving scenes showed accuracy and coherence ahead of prior systems, and the team has released the data, code, and trained model publicly.

Catalog record

CREATORZahra Dehghanian, Morteza Abolghasemi, Hossein Azizinaghsh, Amir Vahedi, Hamid Beigy, Hamid R. Rabiee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00988

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LensCraft: Your Professional Virtual Cinematographer Zahra Dehghanian, Morteza Abolghasemi, Hossein Azizinaghsh, Amir Vahedi, Hamid Beigy, Hamid R. Rabiee Abstract Digital creators, from indie filmmakers to animation studios, face a persistent bottleneck: translating their creative vision into precise camera movements. Despite significant progress in computer vision and artificial intelligence, current automated filming systems struggle with a fundamental trade-off between mechanical execution and creative intent. Crucially, almost all previous works simplify the subject to a single point—ignoring its orientation and true volume—severely limiting spatial awareness during filming. LensCraft solves this problem by mimicking the expertise of a professional cinematographer, using a data-driven approach that combines cinematographic principles with the flexibility to adapt to dynamic scenes in real time. Our solution combines a specialized simulation framework for generating high-fidelity training data with an advanced neural model that is faithful to the script while being aware of the volume and dynamic behavior of the subject. Additionally, our approach allows for flexible control via various input modalities, including text prompts, subject trajectory and volume, key points, or a full camera trajectory, offering creators a versatile tool to guide camera movements in line with their vision. Leveraging a lightweight real time architecture , LensCraft achieves markedly lower computational complexity and faster inference while maintaining high output quality. Extensive evaluation across static and dynamic scenarios reveals unprecedented accuracy and coherence, setting a new benchmark for intelligent camera systems compared to state-of-the-art models. Extended results, the complete dataset, simulation environment, trained model weights, and source code are publicly accessible on LensCraft Webpage . 1 Introduction The language of cinematography extends far beyond simple camera operations, encompassing a rich representation of visual storytelling elements that can express distinct styles, perceived motions, emotional resonances, and visual perceptions Wang et al. 2023 . While this sophisticated language holds the capacity to translate a director’s narrative vision into precise camera movements - just as it does in real-world filmmaking - it demands exact alignment and precise execution from automated systems. Each camera movement must not merely follow rules, but rather embody the director’s intent with the finesse of an experienced professional cinematographer, whether capturing the subtle tension in a dramatic scene or the dynamic energy of an action sequence Dehghanian et al. 2025 . Current automated approaches fall into two limiting categories. Traditional methods that sacrifice creative potential for predictability, reducing the rich language of cinematography to mechanical executions of predefined rules, constraints and objectives Gebhardt et al. 2018 ; Jiang et al. 2024a . On the other hand, more recent learning-based approaches, while capable of generating complex camera sequences, often get lost in this complexity due to imbalanced training data distributions and insufficient richness in their learning examples Courant et al. 2025 ; Bonatti et al. 2021 . As a result, these methods struggle to maintain professional quality while staying faithful to user instructions and produce sophisticated sequences that drift from the intended cinematographic direction. This fundamental disconnect becomes particularly apparent when handling diverse filming scenarios, where the balance between professional execution and precise alignment with user intent becomes crucial. Additionally, one crucial aspect that prior models often overlook is the impact of subject volume. In real-world filmmaking, the scale and physical presence of the subject—whether filming from an ant’s perspective or capturing a building—significantly influence the camera’s behavior and trajectory. However, most of prior works simplify the subject by representing it as a point Jiang et al. 2024a ; Courant et al. 2025 or by modeling it in a fixed specific form, such as SMPL Wang et al. 2024a ; Chen et al. 2024 . This oversimplification, due to limitations in dataset complexity, fails to capture the true dynamics of subject volume, which is essential for generating realistic and context-aware camera movements. This fundamental disconnect motivated us to develop LensCraft, a novel approach that bridges the gap between professional cinematographic execution and precise user control. In addressing this challenge, we first identified two key obstacles: the absence of a unified, comprehensive standard for a representative cinematographic language, and the lack of a balanced, large-scale, volume-aware dataset that covers the full spectrum of camera movements. To overcome these challenges, we designed a standard cinematography language (SCL) to provide a unified foundation for our approach and developed first fully open-source, carefully designed simulation framework to generate a diverse and well-balanced dataset, serving as the foundational pillars required for our model. Leveraging this backbone to combine the solidity of traditional rule-based methods with the creativity of neural models, we designed a model that inherits both features. We developed a lightweight transformer-based architecture that learns and generates complex simulated movements, using only a text prompt or optional key frames, enabling it to produce robust and creatively aligned outputs. Also, to accommodate a wider range of user instructions, we incorporate a Appendix that converts any arbitrary user prompts into our standardized cinematographic description. The data flow and training procedure of our model is shown in Figure 1 . Figure 1 : The data generation pipeline illustrating the hierarchical transformation of user intent into camera trajectories in simulation. 2 Related Works Camera trajectory generation has evolved significantly from traditional rule-based approaches He et al. 1996 ; Christie et al. 2008b to modern deep learning methods Jiang et al. 2024b ; Courant et al. 2025 . Previous works in this domain can be broadly categorized into three main streams: rule-based methods that rely on predefined cinematographic principles Silva et al. 2011 ; Galvane et al. 2014 , optimization-based techniques that formulate trajectory generation as a constraint satisfaction problem Bengio 2000 ; Tewari et al. 2021 , and learning-based approaches that leverage data-driven models to generate or transfer camera movements Jiang et al. 2020 ; Wang et al. 2023 . In recent years, with the advancement of large language models and vision-language models like CLIP Radford et al. 2021 , there has been growing interest in incorporating semantic understanding into camera control systems He et al. 2024 ; Liu et al. 2024 . Rule-based Approach: Early work in camera trajectory generation primarily relied on rule-based methods that encoded established cinematographic principles into algorithmic frameworks. The Virtual Cinematographer He et al. 1996 pioneered this approach by implementing film idioms as hierarchical finite state machines to automatically produce camera specifications in real-time. Building on this foundation, next work Tomlinson et al. 2000 developed a behavior-based system that utilized ethologically inspired mechanisms to adapt to interactive 3D environments. Upcoming work Christie et al. 2008b further expanded these concepts by introducing a framework for viewpoint computation and motion planning based on established filming conventions. More recent work Louarn et al. 2018 attempted to enable more flexible camera control by extending the Prose Storyboard Language (PSL) Ronfard et al. 2015 . These rule-based approaches offered computational efficiency and reliability in controlled scenarios but were limited by their inherent rigidity, making them unsuitable for new, dynamic, or creative contexts. Optimization Approach: Optimization-based methods emerged as a more flexible alternative to rule-based systems, formulating camera trajectory generation as a mathematical optimization problem. Early work computed optimal viewpoints by maximizing the projected area to surface area ratio Kamada and Kawai 1988 . The field advanced significantly with the introduction of Toric Space Christie et al. 2008a

Read the complete text