On the Impact of 3D Visualization of Repository Metrics in Software Engineering Education

Dario Di Dario, Stefano Lambiase, Fabio Palomba, Carmine Gravino · 2024

Read On the Impact of 3D Visualization of Repository Metrics in Software Engineering Education by Dario Di Dario, Stefano Lambiase, Fabio Palomba, Carmine Gravino (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16061.txt.

Introduction

Dario Di Dario, Stefano Lambiase, Fabio Palomba, and Carmine Gravino propose an experiment on whether virtual reality helps students read a software project's health. Repository metrics such as pull requests and issues guide real decisions, and immersive three-dimensional displays might make them click for learners. Evidence in educational settings, though, is thin.

As a registered report, the paper lays out a controlled experiment comparing VR and non-VR presentations of the same metrics. The hypothesis is that immersion builds the analytical skills industry expects, improving both the learning experience and process comprehension. The design is specified in advance, including its aims and context. Results will test whether the headset earns its place in the classroom.

Catalog record

CREATORDario Di Dario, Stefano Lambiase, Fabio Palomba, Carmine Gravino
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-16061

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Impact of 3D Visualization of Repository Metrics in Software Engineering Education Dario Di Dario, Stefano Lambiase, Fabio Palomba, Carmine Gravino Abstract Context: Software development is a complex socio-technical process requiring a deep understanding of various aspects. In order to support practitioners in understanding such a complex activity, repository process metrics, like number of pull requests and issues, emerged as crucial for evaluating CI/CD workflows and guiding informed decision-making. The research community proposed different ways to visualize these metrics to increase their impact on developers’ process comprehension: VR is a promising one. Nevertheless, despite such promising results, the role of VR, especially in educational settings, has received limited research attention. Objective: This study aims to address this gap by exploring how VR-based repository metrics visualization can support the teaching of process comprehension. Method: The registered report proposes the execution of a controlled experiment where VR and non-VR approaches will be compared, with the final aim to assess whether repository metrics in VR’s impact on learning experience and software process comprehension. By immersing students in an intuitive environment, this research hypothesizes that VR can foster essential analytical skills, thus preparing software engineering students more effectively for industry requirements and equipping them to navigate complex software development tasks with enhanced comprehension and critical thinking abilities. I Introduction Developing software is a complex socio-technical activity, where the software lifecycle encompasses multiple stages that need to be correctly managed in order to ensure the project success [ 1 ] . Mitigating such complexity necessitates a thorough understanding of the software process itself. Thus, the ability to comprehend and analyze the development process is critical not only in industry and open-source practices [ 2 , 3 , 4 , 5 ] but also in software engineering (SE) education [ 6 , 7 ] . To facilitate a deeper understanding of the development process, research communities have introduced various tools, with process metrics emerging as key instruments. Software process metrics provide quantitative measures for assessing, monitoring, and enhancing the effectiveness and efficiency of software development workflows. Particularly, in Continuous Integration and Continuous Delivery (CI/CD) environments, repository (process) metrics , such as the number of pull requests, issues, and commits offer insights into the health of software communities that are essential to enable contributors to make informed decisions that enhance process quality and contribute to improving overall well-being within the development environment [ 8 ] . To support practitioners into understanding those metrics, researchers started to investigate visualization strategies [ 9 , 10 , 11 , 12 ] . Leveraging principles from perception, cognition, and graphical design, these strategies encode data values and attributes through visual elements and properties, which has been shown to improve comprehension of complex information, facilitate faster communication compared to textual or numerical data, and reduce cognitive load for easier analysis. The literature thus indicates that these strategies support practitioners in comprehending software processes , a crucial skill for key activities in both industry—such as software maintenance [ 2 ] and code review [ 3 , 4 , 5 ] —and education, particularly in teaching SE [ 6 , 7 ] . Metric visualization is typically performed using a keyboard and mouse in a 2D environment (e.g., a monitor). Nevertheless, their effectiveness in improving the program comprehension process has led to the development of innovative tools that incorporate advanced technologies like virtual reality (VR) [ 13 , 14 , 15 ] . Although still relatively new, VR-based tools for visualizing repository metrics are already proving valuable for enhancing development activities. Despite increasing research interest in streamlining processes for IT practitioners [ 13 , 14 , 15 ] and academic researchers [ 16 ] , relatively little focus has been placed on educational applications . Specifically, while the importance of process comprehension activities, such as those supported by CI/CD platforms, is well-established for post-university careers in SE [ 6 , 7 ] , there is limited research that explores how VR-based software visualization techniques could support teaching these essential skills for software engineers. Addressing this gap is essential for several reasons. First, the increasing pervasiveness of open-source in the software development environment has led to widespread adoption of CI/CD platforms—and consequently, repositories—as standard practice. Since repository metrics are inherently part of these systems, equipping students with the skills to understand these metrics is crucial for the future of the field. Second, comprehension of process metrics is increasingly valuable as large organizations, including Microsoft and Google, integrate practices rooted in these skills, such as code review [ 17 , 18 , 19 ] . Third, teaching software metrics comprehension has been shown to benefit students by fostering critical analytical, discipline-specific, and collaborative skills [ 20 , 21 , 6 , 7 ] —core competencies within the socio-technical landscape of software development [ 22 , 23 ] . Additionally, research in SE has shown that incorporating VR into process understanding can shorten learning curves and enhance creativity, providing substantial benefits for university-level education [ 24 ] . Given (1) the promising results achieved through integrating VR for software process comprehension [ 13 , 9 ] , (2) the documented importance of teaching software comprehension to future professionals [ 6 , 7 ] , and (3) the need to enhance the teachability of this critical skill, this confirmatory registered report builds on the work of Moreno-Lumbreras et al. [ 15 ] by examining whether VR, when used to visualize repository metrics, can improve software engineering students’ educational experiences in comprehending development processes . VR may indeed provide students with a more intuitive grasp of complex concepts, thereby enriching the learning experience and better equipping them for real-world software engineering challenges. II Background and Related Studies This section provides a brief overview of the foundational concepts necessary to understand this research. II-A Software Visualization Software visualization plays a vital role in comprehending programs, particularly during maintenance and evolution activities, as it helps interpret complex data and supports informed decision-making. Various techniques exist, each adopting a different approach to visualization. For instance, graph-based methods depict structural relationships and system changes using nodes and links, creating a network of interconnected elements. In contrast, notation-based approaches, such as UML diagrams, utilize formal models to represent system modifications in a structured way. Matrix-based techniques focus on tracking the version history and relationships between different modules, providing insights into the evolution of specific components over time. Meanwhile, metaphor-based methods offer a more intuitive approach by employing visual metaphors, like visualizing the software as a 3D city, to make system evolution more engaging and easier to understand [ 25 ] . These techniques serve different purposes, depending on the level of abstraction and the aims. Some approaches are artifact-centered , aiming to show how individual elements or files change over time. Others are metric-centered , designed to highlight variations in quality parameters across versions. There are also feature-centered techniques that assess the impact of modifications on particular system features, and architecture-centered approaches that visualize the evolution of the software’s overall structure, including component dependencies and interactions [ 25 ] . Software repositories often provide the primary data source for these visualizations, documenting the project’s entire development history, from minor edits to major releases.

Read the complete text