Mixed Reality Scenic Live Streaming for Cultural Heritage: Visual Interactions in a Historic Landscape Conference: Proceedings of the International Conference on Human-Engaged Computing; November 21–23, 2025; Singapore Proceedings of the International Conference on Human-Engaged Computing (ICHEC ’25

Zeyu Huang, Zuyu Xu, Yuanhao Zhang, Chengzhong Liu, Yanwei Zhao, Chuhan Shi, Jason Chen Zhao, Xiaojuan Ma · 2025

Read Mixed Reality Scenic Live Streaming for Cultural Heritage: Visual Interactions in a Historic Landscape Conference: Proceedings of the International Conference on Human-Engaged Computing; November 21–23, 2025; Singapore Proceedings of the International Conference on Human-Engaged Computing (ICHEC ’25 by Zeyu Huang, Zuyu Xu, Yuanhao Zhang, Chengzhong Liu, Yanwei Zhao, Chuhan Shi, Jason Chen Zhao, Xiaojuan Ma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17246.txt.

Introduction

Zeyu Huang and seven co-authors give scenic live streams a layer of interactivity. Such streams, fixed cameras broadcasting famous landscapes with no host, draw large synchronous audiences but offer viewers little to do. The team overlays mixed reality content matched to a site's geography and local culture, calling the result MRSLS, and prototypes it at a UNESCO-listed heritage site in China.

Design work began with interviews to identify the site's scenery and cultural highlights, followed by two iterative studies. A mixed-methods comparison then showed the mixed reality version gave more immersive appreciation of the scenery, stronger cultural impressions, and a more vivid sense of shared experience than the plain stream. The authors argue this underexplored format balances authenticity, participation, and cultural value, and deserves more attention from interaction designers.

Catalog record

CREATORZeyu Huang, Zuyu Xu, Yuanhao Zhang, Chengzhong Liu, Yanwei Zhao, Chuhan Shi, Jason Chen Zhao, Xiaojuan Ma
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17246

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mixed Reality Scenic Live Streaming for Cultural Heritage: Visual Interactions in a Historic Landscape Conference: Proceedings of the International Conference on Human-Engaged Computing; November 21–23, 2025; Singapore Proceedings of the International Conference on Human-Engaged Computing (ICHEC ’25), November 21–23, 2025, Singapore DOI: XXXXXXX.XXXXXXX ISBN: XXX-X-XXXX-XXXX-X/25/11 11 CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing Interface design prototyping Zeyu Huang, Zuyu Xu, Yuanhao Zhang, Chengzhong Liu, Yanwei Zhao, Chuhan Shi, Jason Chen Zhao, Xiaojuan Ma Abstract . Scenic Live Streams (SLS), capturing real-world scenic sites from fixed cameras without streamers, have gained increasing popularity recently. They afford unique real-time lenses into remote sites for viewers’ synchronous and collective engagement. Foregrounding its lack of dynamism and interactivity, we aim to maximize the potential of SLS by making it interactive. Namely MRSLS, we overlaid plain SLS with interactive Mixed Reality content that matches the site’s geographical structures and local cultural backgrounds. We further highlight the substantial benefit of MRSLS to cultural heritage site interactions, and we demonstrate this design proposal with an MRSLS prototype at a UNESCO-listed heritage site in China. The design process includes an interview (N=6) to pinpoint local scenery and culture, as well as two iterative design studies (N=15, 14). A mixed-methods, between-subjects study (N=43, 37) shows that MRSLS affords immersive scenery appreciation, effective cultural imprints, and vivid shared experience. With its balance between cultural, participatory, and authentic attributes, we appeal for more HCI attention to (MR)SLS as an under-explored design space. 1. Introduction The ways we experience cultural heritage sites are rapidly evolving beyond physical presence. Digital mediation, from online archives ( 37 ; 66 ; 36 ; 8 ) to virtual tours ( 38 ; 54 ; 65 ; 57 ) , offers valuable windows into distant landscapes, a trend accelerated by the recent global pandemic. Yet, a tension persists within this digital landscape. On one hand, immersive Extended Reality (XR) applications provide lifelike, yet often solitary, encounters ( 38 ; 54 ; 65 ; 57 ) . On the other, community-driven platforms foster a sense of collective presence but can lack deep, engaging interaction with the site itself ( 37 ; 66 ; 36 ; 8 ) . This leaves a crucial gap: an experience that combines the liveness of being there and the richness of communal engagement, creating a more complete “virtual trip” experience. In this paper, we turn our attention to the recent popularity of scenic live streams (SLS), sometimes also known as world cameras or live webcams . They broadcast real-world landscapes in real time through fixed cameras and operate 24/7 non-stop without human streamers. They can be found on both dedicated websites like SkylineWebcams 1 1 1 https://www.skylinewebcams.com/ and general-purpose video platforms like YouTube 2 2 2 An example Venice SLS: https://www.youtube.com/watch?v=HpZAez2oYsA . With their real-time fidelity and the inherent collective nature of live streaming ( 25 ; 70 ; 26 ) , SLS have been increasingly adopted by cultural heritage sites for their touristic and educational potential ( 30 ; 31 ) . However, the conventional SLS experience remains a passive one, largely confined to observational appreciation. This passivity not only fails to communicate the layered cultural narratives and living heritage embedded within these sites ( 30 ) , but also misses the opportunity to leverage the participatory, community-building power of the live stream medium ( 22 ) . To unlock the full potential of SLS for remote cultural heritage engagement, we introduce Mixed Reality Scenic Live Streams (MRSLS), a new form of interactive multimedia experiences derived from regular SLS that dynamically overlays interactive virtual elements onto the live scenic footage. By semantically aligning these digital augmentations with the site’s geographical structures and cultural context, MRSLS elevates passive viewing into an active, participatory, and culturally resonant experience. This fusion of the real and the virtual forges new pathways for cultural transmission and digital placemaking, connecting global audiences in real time with the symbols, traditions, and stories of a place. We demonstrate this concept through the design and evaluation of an MRSLS prototype at a renowned UNESCO-listed heritage landscape in China ( 72 ; 73 ; 69 ) . Our generalizable design workflow, which involved interviews to formalize local elements and iterative feature refinement, produced a prototype with context-aware visual overlays and interactive features tailored to the site’s unique picturesque and literary charms. A subsequent mixed-methods, between-subjects study (N=43, 37) confirmed that MRSLS effectively affords a sense of virtual embodiment, deepens cultural appreciation, and fosters social connection among remote viewers. In sum, this research makes three primary contributions: (1) We introduce and formalize the concept of MRSLS as a new interaction mechanism for cultural heritage sites. (2) We provide an exemplary design flow and a functional MRSLS prototype for a real-world heritage site. (3) We derive design implications and future research directions for the application and generalization of MRSLS. 2. Related Work 2.1. XR for Cultural Heritage Sites Virtual Reality (VR) is a dominant approach for creating interactive, remote experiences of cultural heritage sites. Typically, this involves meticulously reconstructing a site in a virtual environment to allow for free exploration ( 57 ; 54 ; 55 ; 64 ; 15 ) . Some systems enhance this by incorporating multi-user features, fostering lively social interactions within these virtual replicas ( 28 ; 48 ) . While immersive, VR reconstructions are inherently static. They capture a single moment in time, often missing a site’s authentic, real-time dynamism—the daily rhythm of local life, the serendipitous cultural moments, etc. Recreating this “livingness” in VR requires immense effort in 3D animation and continuous updates to reflect the present. Beyond reconstruction-centric VR, narrative guides and digital storytelling have also been used to deliver curated narratives at heritage sites and museums. 61 present systems where virtual docents mobilize speech, gaze, and gestures to create attractive heritage storytelling and improve social presence. 3 report a co-designed VR narrative for intangible heritage, where indigenous storytellers and visitors engage in embodied mutual interactions to strengthen authenticity and interest. Recent heritage chapters also note pilots of live-streamed virtual tours where an avatar shows around the scenes and answers questions in in real time ( 27 ) . These storytelling applications focus more on informativeness, and sometimes provide a companion narrator. However, they cannot offer first-person immersion at the broadcast site or direct interactions with it. In contrast to full immersion in virtual replicas or augmenting online guides with touristic information, what we want to achieve is an engaging, participatory, and situated experience of cultural heritage sites, foregrounding the site’s real-time “livingness”. We posit that Mixed Reality (MR) offers a compelling alternative by overlaying interactive digital content onto an authentic, live view of a heritage site. A primary challenge for remote MR is accessing a real-time visual feed of the physical environment. Inspired by the recent popularity of touristic live streams ( 74 ; 43 ; 50 ; 13 ; 46 ) , we propose that Scenic Live Streams (SLS) can be a promising base for remote MR interactions, for their unmediated, streamer-less, real-time footage of remote sites serves as an authentic visual canvas. In addition, its typically passive viewership presents a clear design opportunity, a space that remains largely under-explored in HCI

Read the complete text