Scenario-based System Testing for Distributed Robotics Applications Journal: Robotics and Autonomous Systems
Jan Peleska, Felix Brüning, Wen-Ling Huang, Anne E. Haxthausen · 2026
Read Scenario-based System Testing for Distributed Robotics Applications Journal: Robotics and Autonomous Systems by Jan Peleska, Felix Brüning, Wen-Ling Huang, Anne E. Haxthausen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25772.txt.
Introduction
Peleska and three colleagues present SCSL, a language for system-level testing of distributed robotics. Older model-based testing fails here: systems are too complex for one model, behavior cannot be fully precomputed under nondeterminism, and setups change at runtime. SCSL answers with composable scenarios, online execution, and a construct for dynamic reconfiguration. Scenarios state expected behavior and stimuli for each test. A robot salvage mission illustrates the language, with an auto-generated test run showing the prototype in action.
Catalog record
| CREATOR | Jan Peleska, Felix Brüning, Wen-Ling Huang, Anne E. Haxthausen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 116860 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.25772
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Scenario-based System Testing for Distributed Robotics Applications Journal: Robotics and Autonomous Systems Jan Peleska, Felix Brüning, Wen-Ling Huang, Anne E. Haxthausen Abstract We present the SC enario S pecification L anguage (SCSL) for automated generation and execution of system-level tests. SCSL targets complex distributed systems (e.g., collaborating autonomous robots) where classical model-based testing becomes impractical because (1) the overall system complexity is too high for a single monolithic model, (2) test behaviour cannot be fully precomputed due to substantial nondeterminism in the distributed system under test (SUT), and (3) the SUT configuration may change dynamically at runtime. Challenge (1) is addressed by scenarios: each scenario specifies test-specific expected SUT behaviour and/or stimuli to be applied during execution. Complex system tests are composed from elementary scenarios using sequential and parallel composition. To address (2), the SCSL tool platform supports online (on-the-fly) testing, selecting and executing test steps during runtime. For (3), SCSL provides a collaboration construct that supports dynamic reconfiguration: removing unavailable components, registering newly joining components, and rewiring interfaces during test execution. We illustrate the syntax and semantics of SCSL using a system-test example in which robots perform a salvage mission, and we use an automatically generated test execution to demonstrate the concepts supported by our prototype tool platform. 1 Introduction 1.1 Objectives The objective of this article is to present the SC enario S pecification L anguage (SCSL) for defining and executing functional system tests for complex cyber-physical systems (CPS). The presentation uses a typical example of a system test for several robots collaborating in a joint mission. When comparing “classical” model-based system testing (MBT) to the scenario-based approach, the crucial differences are as follows. 1. MBT aims to capture all admissible system behaviours within a comprehensive system model. From this model, test cases, test data, and test procedures are derived to achieve a certain level of coverage. This model coverage may also be related to requirements coverage, if the underlying formalism allows for tracing model elements to requirements and vice versa [ 1 ] . 2. Scenarios are more restrictive behavioural models, each scenario describing a relevant behavioural aspect of the system, for example, a traffic scenario for an autonomous vehicle. Each relevant system behaviour should be covered by at least one scenario. The collection of all scenarios, referred to as the scenario library , serves as a structured specification of system behaviour for testing purposes. A separate validation activity not discussed in this paper ensures that all relevant behaviours are covered by the library [ 2 ] . 3. Typically, scenarios types are parameterised, so that they can be instantiated in different system test situations with different parameter values. A scenario instance is a concrete behavioural specification, where all parameters have been associated with concrete values (so-called actual parameters ). 4. The objects under test – in the example presented below, the collaborating robots and a command centre supervising the mission – are input parameters to the test scenarios, and their expected behaviour is specified in the scenario, since only the scenario-specific behavioural aspects need to be described. 5. A scenario-based system test consists of a set of scenario instances that define a meaningful end-to-end system behaviour in alignment with specific test objectives. Consequently, scenarios are easier to specify than the reference models needed in MBT, where the expected behaviour of a system under test (SUT) needs to be modelled for all operational situations. Apart from their complexity, the distributed CPS that have influenced the design of the SCSL typically pose two further challenges: The local autonomy of the SUT components induce a very high degree of nondeterminism. Consequently, pre-calculated linear test steps will often be unsuitable to reach the system test objectives. Therefore, the underlying tool platform needs to support online testing, where the consecutive test steps are calculated at runtime, based on the currently observable state of the SUT. Note that this capability just depends on the underlying tool implementation, it is possible both for MBT (see Larsen et al. [ 3 ] ) and scenario-based testing. The final challenge consists in the fact that complex distributed CPS may change their configuration at runtime: robots, for example, may autonomously decide to leave or enter the SUT configuration, they may no longer be available due to some component failure, and interfaces may be “rewired” at runtime. Therefore, modelling formalisms only able to describe static process networks [ 4 ] are unsuitable for describing (comprehensive models or) scenarios for testing these CPS. 1.2 Test Configurations Typical test configurations for the scenario-based approach advocated by the authors will be variants of the one depicted in Figure 1 . The CPS under test is a distributed system where control computers communicate with each other and may act on electro-mechanical peripherals. In a system test configuration, some of these control computers will be present as original equipment OE , while others are replaced by simulations SIM . Hardware peripherals could also be replaced by other simulations, or they could be present as original peripherals PER . The solid lines between boxes each represent one or more interfaces for data exchange. Interfaces (to be introduced in Section 3.8 ) realise uni-directional data flows between components participating in a system test. The objective of system tests is to check the functional behaviour of all original equipment and peripherals, as well as their interactions. The “local” behaviour of original equipment is monitored by original equipment harnesses OEH . These harnesses run test-specific elementary scenarios specifying the expected behaviour of their OE during the system test, as well as the stimulations to be provided for some OE input interfaces, as far as these are not provided by other OE or by simulations or peripherals. Figure 1: System test configuration. The succession of elementary scenarios to be executed by each OEH is coordinated by a coordinator agent CA . The CA receives status information about ongoing elementary scenario executions performed by each OEH and provides further elementary scenarios to be scheduled by the associated OEH . The collaboration between all components of the CPS will result in certain emergent properties [ 5 ] achieved by the overall system. These can be checked by an emergent property monitor EPM observing all communications between CPS sub-components and its operational environment (typically replaced by simulations during a system test). 1.3 Contributions Previous work by the authors This article is based on the authors’ conference contribution to TAROS2025 [ 6 ] . There, the SCSL syntax and its semantics have been introduced in abbreviated form. A robotics system test where all scenarios acted as observers (i.e. test oracles) had been used to illustrate SCSL usage. While other existing scenario modelling languages are frequently domain-specific, the SCSL has been expressly designed to allow for applications in any domain: Domain-specific details (e.g. physical laws) can be encapsulated in separate elementary scenarios that are collected in a re-usable library. Another distinguising feature of the SCSL is that elementary scenarios may combine declarative and imperative specification styles: Linear Temporal Logic (LTL) allows for declarative specifications, and a guarded action language allows for imperative specification. From our experience, this facilitates behavioural modelling in a considerable way. 1. Declarative specifications are good for including all