CGReplay: Capture and Replay of Cloud Gaming Traffic for QoE/QoS Assessment

Alireza Shirmarz , Ariel G. de Castro , Fabio L. Verdi , Christian E. Rothenberg · 2025

Read CGReplay: Capture and Replay of Cloud Gaming Traffic for QoE/QoS Assessment by Alireza Shirmarz , Ariel G. de Castro , Fabio L. Verdi , Christian E. Rothenberg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11973.txt.

Introduction

Alireza Shirmarz and three co-authors built a tool to record and replay cloud gaming traffic, in a short paper from twenty twenty-five. Cloud gaming study is held back by wild game engines and closed trade platforms with locked logs. Their tool, CGReplay, records player commands and the frames that come back, in step as an action and reaction loop. Replay then lets labs grade user feel and service quality under set network states. The code is public.

Catalog record

CREATORAlireza Shirmarz , Ariel G. de Castro , Fabio L. Verdi , Christian E. Rothenberg
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE13 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-11973

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CGReplay: Capture and Replay of Cloud Gaming Traffic for QoE/QoS Assessment Alireza Shirmarz , Ariel G. de Castro , Fabio L. Verdi , Christian E. Rothenberg Abstract Cloud Gaming (CG) research faces challenges due to the unpredictability of game engines and restricted access to commercial platforms and their logs. This creates major obstacles to conducting fair experimentation and evaluation. CGReplay captures and replays player commands and the corresponding video frames in an ordered and synchronized action-reaction loop, ensuring reproducibility. It enables Quality of Experience/Service (QoE/QoS) assessment under varying network conditions and serves as a foundation for broader CG research. The code is publicly available for further development 1 1 1 https://github.com/dcomp-leris/CGReplay.git . . I Introduction & Motivation Cloud Gaming (CG) is rapidly growing as a popular entertainment medium, making both objective and subjective Quality of Experience (QoE) critical areas of research and industry focus [ 1 , 2 ] . However, most mainstream CG platforms ( e.g. , Xbox Cloud Gaming, GeForce Now) are closed-source, hampering controlled research experiments and evaluation, restricting the exploration of innovative research directions in areas such as frame generation techniques, novel QoE metrics development, latency optimization strategies, and adaptive streaming algorithms tailored specifically for interactive gaming contexts. Additionally, the inherently non-deterministic nature of gameplay means that the same scene is never repeated, preventing direct comparison of video frames across different network conditions. Since a CG session involves uplink commands (player input) and downlink video frames (server response), their interactive behavior – particularly, response time – is essential to QoE. Therefore, a platform that can capture, synchronize, and replay these interactions is essential for reproducible testing and QoE assessment. While open-source CG platforms such as GamingAnywhere 2 2 2 https://github.com/chunying/gaminganywhere.git . and Moonlight Game Streaming 3 3 3 https://github.com/moonlight-stream/moonlight-stream.github.io.git . exist, they also present challenges for QoE evaluation due to gameplay non-determinism – where commands and video frames vary unpredictably. This variability makes it difficult to assess downlink video frame quality, uplink command accuracy, and their interactive influences under different network conditions. For generating CG traffic and evaluating its QoE, a platform is needed to capture CG over the Internet and replay the same uplink and downlink sequences. Such a solution would allow researchers to compare received video frames and evaluate how network conditions affect interactivity between commands and frames. Experimental Cloud Gaming Platform (eCGP) [ 2 ] aimed to achieve deterministic cloud gaming outputs by bypassing the non-determinism of game engines for Quality of Experience (QoS) evaluation. However, this approach does not fully support the automatic interactivity between uplink and downlink. Moreover, they fail to address real-world cloud gaming challenges, such as command and frame loss, which impact fidelity. Inspired by TCPReplay, we propose CGReplay 4 4 4 This is a complementary work supporting the full paper ‘ In-Network AR/CG Traffic Classification Entirely Deployed in the Programmable Data Plane ‘ accepted at Netsoft 2025 main track. , an open-source, configurable platform that captures and replays CG sessions at the application layer while preserving automatic interactivity. By synchronizing the timing and sequence of commands and frames, CGReplay allows researchers to conduct reproducible QoE experiments under various network conditions, ensuring higher fidelity to real-world cloud gaming environments. CGReplay is organized into two main phases: 1. CG Capturing: in this phase, the platform records uplink commands and downlink video frames along with their interaction, ensuring that the complete behavioral pattern of a cloud gaming session is preserved. 2. CG Replaying: the recorded data is synchronized and replayed to mimic the original session, enabling reproducible testing under diverse network conditions. For this demonstration, our implementation uses UDP, RTP, and SCReAM 5 5 5 https://github.com/EricssonResearch/scream.git . , however, as an open-source platform, it can be extended for other streaming protocols such as RTP over QUIC (RoQ) [ 3 ] . CGReplay can also be used as the platform for evaluation end development of other research CG adaptive rendering improvement [ 1 ] , the adaptive encoding [ 4 ] for CG and Generative interactive environments (Genie) [ 5 ] . II Highlights of CGReplay CGReplay is an open-source platform for capturing and replaying bi-directional cloud gaming sessions (Action/Reaction) based on real online CG interactions. It offers easy configuration via YAML files for each component, ensuring flexibility and simplicity. Its main contributions are structured into three key parts: capturing, replaying, and ensuring action/reaction interactivity and reliability. In the capturing phase, the platform records uplink commands and downlink video frames while extracting their sequential patterns. During replaying, these sequences are utilized by two agents: (a) CG server and (b) CG player running on Python-supported systems, to faithfully mimic the original session. Finally, the action/reaction interactivity module emulates user actions and server responses, with SCReAM (optional) integration for UDP-based congestion control to evaluate ECN-based signaling alongside traditional drop mechanisms. II-A Capturing the Cloud Gaming In this phase, the module run_capturing.py captures both uplink commands (sniffed via the USB port) and downlink video frames (captured from the screen) at a configurable sampling rate of 30 frames per second. In our demonstration, a human player uses an Xbox cloud gaming platform to play three games – Forza Horizon 5, Fortnite, and Mortal Kombat 11, as shown in Fig. 1 . This flexible setup accommodates various platforms and topologies ( e.g. , PlayStation, GeForce Now, Luna) and generates two synchronized files: one containing commands stored in a JSON file and the other containing video frames as PNG files, both annotated with IDs and timestamps. These logs are then used to extract a synchronized command/frame sequence for accurate sequential command and frame replay. Although the capturing module can record various inputs, in this study we focus on the joystick – specifically, the Xbox Controller. Fig. 1: Capturing online CG. The AP is connected to the Internet via a wired connection and connects to the laptop using Wi-Fi 6. II-B Replaying the Cloud Gaming CGReplay comprises two Python agents – (a) CG server and (b) CG player – deployed on separate hosts that can be interconnected via physical devices or simulated/emulated networks (see Fig. 2 ). These modules use IPv4 and UDP for both uplink and downlink communications. Video streaming is implemented with GStreamer 6 6 6 https://gstreamer.freedesktop.org/ . , with RTP and H.264 encoding, with optional SCReAM integration as a scalable congestion control mechanism. The synchronized sequence of commands and frames ensures sequential replay between the CG player and CG server . During replay, the CG server streams frames sequentially until a command is needed. The CG player processes each frame, triggers the corresponding command, and sends it to the server. Streaming resumes upon receiving the expected command, ensuring proper interactivity. Fig. 2: Replaying CG traffic with CGReplay agents at server and player sides. Game Video Frame: video frames are stored as PNG files in the CG server’s folder and sent in response to specific commands. Each frame is dynamically labeled with a unique ID and timestamp embedded as a QR code, allowing the CG player to verify frames during replay. Commands: commands are stored in JSON format with “axes” for joystick movements and “button” for presses (see Fig. 3 ). Each command includes a unique ID, timestamp, and ACK/NACK, ensuring synchronization and sequence order between the

Read the complete text