LEGOS-SLEEC: Tool for Formalizing and Analyzing Normative Requirements
Kevin Kolyakov, Lina Marsso, Nick Feng, Junwei Quan, Marsha Chechik · 2025
Read LEGOS-SLEEC: Tool for Formalizing and Analyzing Normative Requirements by Kevin Kolyakov, Lina Marsso, Nick Feng, Junwei Quan, Marsha Chechik (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12544.txt.
Introduction
Kevin Kolyakov, Lina Marsso, Nick Feng, Junwei Quan, and Marsha Chechik presented a tool for writing and checking rules about how human-facing systems should behave in a 2025 paper. Robots and chatbots can cause social, legal, or cultural harm, so their allowed behavior must be spelled out. The rule writers are often lawyers or ethicists without deep technical training.
A plain-language rule language lets such stakeholders state norms directly. The tool helps them formalize the rules, then finds clashes, gaps, and flaws. It builds on parts proven across nine case studies. The team rebuilt the interface and its error guidance, then tested the gains with four stakeholders from mixed fields. A video shows the tool in use.
Catalog record
| CREATOR | Kevin Kolyakov, Lina Marsso, Nick Feng, Junwei Quan, Marsha Chechik |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-12544
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LEGOS-SLEEC: Tool for Formalizing and Analyzing Normative Requirements Kevin Kolyakov, Lina Marsso, Nick Feng, Junwei Quan, Marsha Chechik Abstract Systems interacting with humans, such as assistive robots or chatbots, are increasingly integrated into our society. To prevent these systems from causing social, legal, ethical, empathetic, or cultural (SLEEC) harms, normative requirements specify the permissible range of their behaviors. These requirements encompass both functional and non-functional aspects and are defined with respect to time. Typically, these requirements are specified by stakeholders from a broad range of fields, such as lawyers, ethicists, or philosophers, who may lack technical expertise. Because such stakeholders often have different goals, responsibilities, and objectives, ensuring that these requirements are well-formed is crucial. SLEEC DSL, a domain-specific language resembling natural language, has been developed to formalize these requirements as SLEEC rules. In this paper, we present LEGOS-SLEEC , a tool designed to support interdisciplinary stakeholders in specifying normative requirements as SLEEC rules, and in analyzing and debugging their well-formedness. LEGOS-SLEEC is built using four previously published components, which have been shown to be effective and usable across nine case studies. Reflecting on this experience, we have significantly improved the user interface of LEGOS-SLEEC and its diagnostic support, and demonstrate the effectiveness of these improvements using four interdisciplinary stakeholders. Showcase video URL is https://youtu.be/LLaBLGxSi8A I Introduction Nowadays, an increasing number of systems interact with our society and environments, such as assistive robots, chatbots, or forest protection drones. It is important to specify normative requirements to prevent these systems from causing social, legal, ethical, empathetic, or cultural (SLEEC) harms. For example, a legal requirement for an assistive robot might state: “Ra: When the user tells the robot to open the curtains then the robot should open the curtains, unless the user is ‘undressed”’ [ 1 ] . Normative requirements encompass both functional and non-functional aspects and are defined with respect to time, and are elicited from a diverse group of interdisciplinary stakeholders (e.g., lawyers and ethicists) who may lack technical expertise and have differing goals and priorities As a result, articulating these requirements poses challenges, making it important to support interdisciplinary stakeholders in ensuring that the elicited requirements do not have well-formedness issues (WFIs) [ 2 , 3 , 4 ] such as conflicts [ 2 ] . Previous works have proposed a domain-specific language (DSL), SLEEC DSL , to formalize these requirements as SLEEC rules [ 2 ] . SLEEC DSL has been shown to be accessible to stakeholders from different fields, including lawyers, philosophers, psychologists, ethics, doctors, roboticists, and software engineers [ 2 , 3 , 4 , 5 ] . For instance, the requirement Ra is expressed in SLEEC DSL rule r2 in Tbl. I . Our goal is to help a broad range of stakeholders elicit a coherent and well-formed set of normative requirements. To this end, we previously proposed approaches [ 3 , 4 ] to verify whether normative requirements expressed as SLEEC rules are conflicting, redundant, sufficient to prevent undesirable behavior, or overly restrictive —– issues collectively referred to as well-formedness constraints (WFIs) . We also developed an approach [ 6 ] that generates WFI verification diagnostics accessible to interdisciplinary stakeholders, along with a methodology [ 5 ] to integrate these components into the elicitation and validation process for normative requirements. In this paper, we present LEGOS-SLEEC , an integrated development environment (IDE) designed to support interdisciplinary stakeholders in specifying normative requirements as SLEEC rules and analyzing and debugging their well-formedness. LEGOS-SLEEC integrates four previously published components [ 7 , 3 , 4 , 6 ] that have been shown to successfully assist interdisciplinary stakeholders across several case studies, including assistive-care robots, tree-disease detection drones, and collaborative robots in manufacturing. Drawing from our experience, we have significantly improved the user interface and enhanced the diagnostic support in LEGOS-SLEEC by removing irrelevant information and incorporating essential missing details to better support stakeholders in debugging WFIs. The main contributions of our paper are: (1) A preliminary study identifying challenges in eliciting and analyzing normative requirements using a previous version of LEGOS-SLEEC ; (2) LEGOS-SLEEC , an IDE that provides support for the SLEEC rules elicitation process and improves diagnostic feedback for WFIs; (3) An evaluation involving four multidisciplinary stakeholders across a range of real-world case studies, demonstrating the effectiveness and usability of LEGOS-SLEEC ; and (4) A short video showcasing our tool. The rest of this paper is organized as follows. Sec. II gives the background material for our work. Sec. III present our LEGOS-SLEEC tool. Sec. IV presents the evaluation of the LEGOS-SLEEC usability, and we conclude in Sec. V . II Background In this section, we provide an overview of SLEEC DSL, and the five SLEEC well-formedness properties checked by LEGOS-SLEEC . SLEEC DSL. The key concepts of the SLEEC DSL [ 2 ] consist of definitions and rules (see Tbl. I ). Definitions declare events and measures representing system capabilities and its activities during the interaction with the environment, including humans. Events represent instantaneous actions whereas measures represent capabilities to provide (immediately) information captured by values of data types, such as Boolean , numeric , and scale . In the SLEEC DSL, events are capitalized while measures are not. Rules have the basic form “ when trigger then response ”. Such a rule defines the required response when the event in the trigger happens and its conditions on measures, if any, are satisfied. For example, rule r2 applies when the event SmokeDetectorAlarm occurs, in which case the response CallEmergencyServices is required within the next 300 seconds. A SLEEC DSL rule can be accompanied by one or more defeaters , introduced using the “ unless ” construct. The language incorporates time constructs allowing responses with deadlines and timeouts using the “ within ” construct, as seen in rule r2 . TABLE I : Normative requirements for the assistive robot expressed in SLEEC DSL . Definitions event HumanOnFloor event CallEmergencyServices event SmokeDetecorAlarm event FireSafetyMeasures measure humanAssents: boolean measure userDisablesAlarm: boolean measure userUnconscious: boolean measure userDistressed: scale (low, medium, high) constant MIN_TEMP = 16 Rules r1:= when HumanOnFloor and ( not humanAssents) then not CallEmergencyServices within 600 seconds r2:= when OpenCurtainRequest and ( not underDressed) then OpenCurtain within 30 seconds r3:= when SmokeDetecorAlarm then CallEmergencyServices within 300 seconds r4:= when DressingStarted and (roomTemperature < MIN_TEMP) and userUnderDressed) then DressingComplete within 1 minutes c1:= when SmokeDetecorAlarm and (( not userDisablesAlarm) or alarmRestarts) then not CallEmergencyServices within 1 minutes Well-formedness properties. Below, we briefly review five SLEEC well-formedness properties [ 4 ] : vacuous- and situational-conflicts, redundancies, restrictiveness, and insufficiency, focusing on situational conflicts and insufficiency (bold) since they are used in Sec. III . (1) Vacuous Conflicts: A rule is vacuously conflicting if the trigger of the rule is not in the accepted behaviours defined by the rule set, i.e., triggering the rule in any situation will lead to a violation of some rules and thus cause a conflict. (2) Situational Conflicts: A rule r is situationally conflicting if there exists a feasible r -triggering situation that eventually causes a conflict. For instance, consider the SLEEC rules r1 and r3 shown in Tbl. I . r1 conflicts with r3 in a situation where the event HumanOnFloor occurs