A Conceptual Model of Intelligent Multimedia Data Rendered using Flying Light Specks

Nima Yazdani, Hamed Alimohammadzadeh, Shahram Ghandeharizadeh · 2024

Read A Conceptual Model of Intelligent Multimedia Data Rendered using Flying Light Specks by Nima Yazdani, Hamed Alimohammadzadeh, Shahram Ghandeharizadeh (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12938.txt.

Introduction

Nima Yazdani, Hamed Alimohammadzadeh, and Shahram Ghandeharizadeh design a data model for displays made of tiny flying lights, in a 2024 paper. Each speck is a mini drone with a lamp, and a swarm of them paints three-dimensional pictures in a fixed space. Users can even touch the swarm and feel force back. The paper asks how the content of such displays should be organized so people can search it by meaning.

Their core model lets users tag the lit scenes with notes and facts, growing a shared store of knowledge about the content. They show how the model stretches to two uses: authoring tools for entertainment, and medical scans in health care. The work is a blueprint, not a built product.

Catalog record

CREATORNima Yazdani, Hamed Alimohammadzadeh, Shahram Ghandeharizadeh
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-12938

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Conceptual Model of Intelligent Multimedia Data Rendered using Flying Light Specks Nima Yazdani, Hamed Alimohammadzadeh, Shahram Ghandeharizadeh Abstract . A Flying Light Speck, FLS, is a miniature sized drone configured with light sources to illuminate 3D multimedia objects in a fixed volume, an FLS display. A swarm of FLSs may provide haptic interactions by exerting force back at a user’s touch. This paper presents a conceptual model for the multimedia data to enable content-based queries. The model empowers users of an FLS display to annotate the illuminations by adding semantics to the data, extending a multimedia repository with information and knowledge. We present a core conceptual model and demonstrate its extensions for two diverse applications, authoring tools with entertainment and MRI scans with healthcare. † † authors: . Holodecks Reference Format: Holodecks, 1(1): 38-44, 2023. doi:10.61981/ZFSH2309 † † This work is licensed under the Creative Commons BY-NC-ND 4.0 International License. Visit https://creativecommons.org/licenses/by-nc-nd/4.0/ to view a copy of this license. For any use beyond those covered by this license, obtain permission by emailing [email protected] . Copyright is held by the owner/author(s). Publication rights licensed to the Holodecks Foundation. Proceedings of the Holodecks Foundation, Vol. 1, No. 1. doi:10.61981/ZFSH2309 1. Introduction There is an abundance of 3D data and devices that produce this data. They pertain to diverse applications ranging from healthcare to entertainment. For example, with healthcare, MRI scanners produce 3D scans of a patient’s brain. With entertainment, a graphic artist may use a 3D authoring tool such as Maya or Blender to produce animated sequences. Flying Light Specks ( Ghandeharizadeh 2021 ; Ghandeharizadeh 2022 ; Alimohammadzadeh et al. 2023b ) , FLSs, enable 3D displays to render this data without sacrificing either its meta-data or the raw device data. A conceptual challenge is how these displays will integrate into the eco-system of today’s devices to illuminate their 3D data and facilitate advanced interactions. This paper presents a conceptual data model to address this challenge. Its objective is to articulate the requirements at a high level to engage all stake holders, both technical and non-technical. The model will facilitate future logical (mathematical) and physical (software and hardware) models. The proposed data model is extensible, enabling a designer to extend it with new concepts specific to an application. Figure 1 provides an end-to-end overview of a framework that includes the proposed conceptual data model. At one end of the spectrum, devices and authoring tools produce raw data with diverse metadata. This metadata may be rich in content. For example, the metadata authored by a graphic artist using a 3D authoring tool may pertain to settings of algorithms that perform complex tasks, e.g., keyframing for interpolations that produce animated sequences ( Haarbach et al. 2018 ) . This data is abstracted and transformed into information, a summarization that is more interpretable by humans, e.g., MRI scan of the patient’s brain shows dark matter. Finally, data and information is transformed into knowledge that provides an understanding of the content of the physical and virtual worlds, e.g., the patient has seizures because of head injury. Figure 1 . An eco-system for devices and authoring tools, and 3D FLS displays. At the other end of the spectrum, a 3D FLS display provides its users with illuminations and diverse forms of interactions including haptics. Users may query the system for the relevant data, information, and knowledge. In addition, users may annotate the illuminations to contribute additional data, information, and knowledge to the system. In this paper, we present a conceptual model that describes the end-to-end spectrum of Figure 1 . The immediate benefit of the conceptual data model is two folds. First, it facilitates design and implementation of efficient algorithms for the FLS display. Second, it enables content-based queries and annotations that contribute knowledge, realizing intelligent multimedia data. Consider each in turn. An algorithm that enables a 3D FLS display may use the semantics of multimedia data. To illustrate, consider an animated sequence produced by an authoring tool. To illuminate this sequence, an FLS display must compute the flight path of FLSs as a function of time. This can be done in several ways. In ( Ghandeharizadeh 2022 ) , the animated sequence is reduced to a sequence of mesh files that are subsequently processed using the Motill ( Ghandeharizadeh 2022 ) algorithm. While highly parallelizable, Motill is a resource intensive algorithm that detects motion across the points of different mesh files. A more efficient algorithm may use the proposed conceptual model that identifies the key frames that have motion. This may be the basis of a new algorithms with a significantly lower complexity than Motill. Similarly, with content based queries, we may use the information and knowledge readily available from devices and authoring tools to provide relevant results. This will enable language models that understand and respond to domain specific queries. The contributions of this paper include: (1) A core conceptual data model for intelligent multimedia data displayed using an FLS display. Section 3 . (2) Extensions of the core to MRI healthcare data and authoring tools for animation. Sections 4 and 5 . Section 2 presents related work. Brief conclusions and future research directions are presented in Section 6 . 2. Related Work The Flying Light Speck, FLS, as a miniature sized drone configured with light sources, processing, storage and networking capabilities to illuminate complex multimedia shapes was first introduced in ( Ghandeharizadeh 2021 ) . 3D FLS displays ( Ghandeharizadeh 2021 ; Ghandeharizadeh 2022 ; Ghandeharizadeh and Garcia 2022 ; Alimohammadzadeh et al. 2023a ) are in the same class of systems that materialize virtual objects in a fixed volume. These include fast 3D printing ( DeSimone ster ) , Claytronics as physical artifacts using programmable matter consisting of catoms ( Goldstein et al. 2005 ) , Roboxels as cellular robots that dynamically configure themselves into the desired shape and size ( McNeely 1993 ) , BitDrones ( Gomes et al. 2016 ) and GridDrones ( Braley et al. 2018 ) as interactive nano-drones. Motill ( Ghandeharizadeh 2022 ) is an algorithm that computes the flight path of FLSs for an animated sequence consisting of mesh files displayed at a pre-specified rate, e.g., 24 mesh files per second. Motill is resource intensive and time consuming. For an animated sequence that is displayed repeatedly, it is more efficient to store Motill’s computed flight paths in a file once and read the file for each repeated display. A file format to store these flight paths is described in ( Alimohammadzadeh et al. 2023b ) . This study presents a conceptual data model for its file format. The conceptual model presented here is different because it captures information and knowledge. It strives to maintain semantics and facilitate content-based queries. Conceptual models are recognized as an important tool in several computing disciplines including databases, multimedia, and software engineering. The Entity-Relationship (ER) data model used in our study dates back to the seminal work of Chen ( Chen 1975 ) and instructed by numerous computer science textbooks, e.g., ( Silberschatz et al. 2020 ) . Conceptual models and the idea of data transformed to information and knowledge is present in diverse scientific applications including Earth Sciences ( Ramapriyan

Read the complete text