Attention Guidance through Video Script: A Case Study of Object Focusing on 360º VR Video Tours Conference: Symposium on Virtual and Augmented Reality; September 30-October 3, 2024; Manaus, Brazil Symposium on Virtual and Augmented Reality (SVR 2024), September 30-October 3, 2024, Manaus, Brazil DOI: 10.1145/3691573.3691618 ISBN: 979-8-4007-0979-1/24/09
Paulo Vitor Santana da Silva, Arthur Ricardo Sousa Vitória, Diogo Fernandes Costa Silva, Arlindo Rodrigues Galvão Filho · 2026
Read Attention Guidance through Video Script: A Case Study of Object Focusing on 360º VR Video Tours Conference: Symposium on Virtual and Augmented Reality; September 30-October 3, 2024; Manaus, Brazil Symposium on Virtual and Augmented Reality (SVR 2024), September 30-October 3, 2024, Manaus, Brazil DOI: 10.1145/3691573.3691618 ISBN: 979-8-4007-0979-1/24/09 by Paulo Vitor Santana da Silva, Arthur Ricardo Sousa Vitória, Diogo Fernandes Costa Silva, Arlindo Rodrigues Galvão Filho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16875.txt.
Introduction
Silva and co-authors use video scripts to steer attention inside 360 degree VR tours. Such tours immerse viewers, yet nothing guides the eye toward key objects. The team combines Grounding DINO with Segment Anything to focus on objects named in a script. Their case study is a 360 degree video tour of the University of Reading. The authors report that script based focusing improved the user experience. It helped direct attention to the elements that mattered in each scene.
Catalog record
| CREATOR | Paulo Vitor Santana da Silva, Arthur Ricardo Sousa Vitória, Diogo Fernandes Costa Silva, Arlindo Rodrigues Galvão Filho |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16505 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16875
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Attention Guidance through Video Script: A Case Study of Object Focusing on 360º VR Video Tours Conference: Symposium on Virtual and Augmented Reality; September 30-October 3, 2024; Manaus, Brazil Symposium on Virtual and Augmented Reality (SVR 2024), September 30-October 3, 2024, Manaus, Brazil DOI: 10.1145/3691573.3691618 ISBN: 979-8-4007-0979-1/24/09 Paulo Vitor Santana da Silva, Arthur Ricardo Sousa Vitória, Diogo Fernandes Costa Silva, Arlindo Rodrigues Galvão Filho Abstract . Within the expansive domain of virtual reality (VR), 360º VR videos immerse viewers in a spherical environment, allowing them to explore and interact with the virtual world from all angles. While this video representation offers unparalleled levels of immersion, it often lacks effective methods to guide viewers’ attention toward specific elements within the virtual environment. This paper combines the models Grounding Dino and Segment Anything (SAM) to guide attention by object focusing based on video scripts. As a case study, this work conducts the experiments on a 360º video tour on the University of Reading. The experiment results show that video scripts can improve the user experience in 360º VR Videos Tour by helping in the task of directing the user’s attention. Figure 1. Guiding users’ attention on 360º VR video tours through textual scripts using deep learning and computational vision Figure 2. Different moments of the scene showing the museum on the video tour. It is defined in the video script as “Look at the sculpture of a person on the right side” at moment (1) and “Look at the sculpture of a centaur on the left side” at moment (2). (a) The original frame of the video. (b) The object described in the script detected and segmented. (c) The target object with the vignette effect applied. 1. Introduction Attention guidance involves the interpretation of pertinent information and directing focus towards specific aspects of the visual scene. Due to its immersive viewing experience and omnidirectional view, 360º videos have gained popularity in various areas ( 13 ; 14 ) such as entertainment, education, and more ( 3 ; 22 ; 4 ; 17 ) . Users who are experiencing virtual environments have the freedom to explore the full scene around them, which can lead to a different experience than expected by the narrative ( 1 ) . However, such narratives are still undergoing experiments to establish an effective narrative language ( 15 ) . To control the narrative, several techniques can be utilized to captivate the audience’s focus on particular elements within a frame ( 15 ) . Depth of field control is a widely used technique in which the focal length of the camera is adjusted to highlight important elements while blurring the rest of the scene ( 2 ) . A similar approach can be applied to virtual reality environments ( 5 ) , in which visual blur effects improve the experience of participants. Several works address how to effectively improve how to guide users’ attention through visual features ( 21 ; 19 ) . In the study proposed by Wallgrün et al. ( 23 ) , they assess the efficacy of three distinct visual guiding mechanisms (arrow, butterfly, and radar) in educational VR tour applications of real-world sites through a user study. All mechanisms showed an improvement over the no-guidance condition, with the arrow having greater preference between 33 participants. The work of Danieau et al. ( 2 ) proposes an overview of visual resources to guide users through narratives 360º videos, comparing a fade to black, desaturation, blur, and deformation. The intensity of each effect is gradually increased to direct the user’s attention toward the area of interest. Moreover, the effectiveness of fade to black and desaturation effects were assessed through a user study, showing promising results yet highlighting the difficulty to make a user unconsciously move his head. In the work of Woodworth et al. ( 24 ) 9 distinct visual features are explored in order to guide or restore users’ attention. Their work encompasses a guidance task wherein subjects gaze at different regions of interest in a randomized order, and a restoration task in which gaze sequences are interrupted by distraction events, requiring a return of focus. Showing an extensive direct comparison of attention guidance and restoration cues. Hillaire et al. ( 6 ) proposed two techniques to enhance user experience during first-person navigation in a virtual environment. These techniques include simulating realistic camera motion similar to human eye movement during walking, and implementing a depth of field blur effect to mimic human perception, where sharp objects are perceived only within a certain range of distances around the focal point. The results showed that participants globally preferred the use of these effects when they are dynamically adapted to the focus point in a virtual environment. With the rapid democratization of immersive technologies, numerous design challenges and considerations must be taken into account to improve how the users’ experience virtual reality. In this context, this work proposes an approach that, through a video script and deep learning, automatically recognizes important elements in a scene and then guides the user’s attention to them through a vignette effect, using VR tours as a study case. This work is organized as follows, in Section 2 the material and methods are described, describing all techniques utilized to generate the regions of interests and segmentation, following by how we apply the visual feature of vignette to guide the user’s attention. In Section 3 the experimental results are shown using a 360º video tour on the University of Reading. Finally, in Section 4 the results and implications of the results are discussed on how these mechanisms can enhance attention guidance in virtual reality environments. 2. Material and Methods The 360º videos used consists in a video tour through the campus of University of Reading, featuring both indoor and outdoor environments as shown in Figure 3 . During the video, the user is moved to different locations, allowing him to freely look around to several university environments. Moreover, at some frames, there might be more than one region of interest that the user’s attention should be directed. Figure 3. Different frames from the 360º video showcasing distinct environments: (a) depicts an external area, (b) showcases a biology Laboratory, c) shows an external building, and (d) the gym. Given a video script, containing the target object description in relation to time intervals of the video, on every n frames, the object description and frame are sent as input to Grounding Dino, which in turn, detect the object on the scene and return its bounding-box coordinates as shown in Figure 4 -b). These coordinates are sent as input jointly with the input frame to the SAM, so that the segmentation mask of the target object can be computed, as shown in Figure 4 -c). With the bounding-boxes coordinates and the mask of the region of interest, a vignette effect is applied to the scene, indicating where the user must pay attention at this moment as shown in Figure 4 -d). Figure 4. General workflow for a single frame in a 360º VR Tour. a) Through a given input video description along with a selected 360º input frame t as input to Grounding Dino. b) Grounding Dino selects