Project Report: Requirements for a social robot as an information provider in the public sector Journal: German Journal of Artificial Intelligence

Thomas Sievers, Nele Russwinkel · 2024

Read Project Report: Requirements for a social robot as an information provider in the public sector Journal: German Journal of Artificial Intelligence by Thomas Sievers, Nele Russwinkel (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-05013.txt.

Introduction

Thomas Sievers and Nele Russwinkel reported a project in 2024 on a social robot for public offices. The project, run with Kiel City Council, asked if a human-like robot could give information in a town hall. It also asked what skills such a robot would need when it meets the public.

The team built a test use case, listed the skills the robot should have, and ran early trials. Users liked the robot far more than a tablet with a web page. Its speech, gestures, and shifts in posture helped. The authors also propose linking the robot to a model of human thought to improve its dialogue.

Catalog record

CREATORThomas Sievers, Nele Russwinkel
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-05013

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Project Report: Requirements for a social robot as an information provider in the public sector Journal: German Journal of Artificial Intelligence Thomas Sievers, Nele Russwinkel Abstract Is it possible to integrate a humanoid social robot into the work processes or customer care in an official environment, e.g. in municipal offices? If so, what could such an application scenario look like and what skills would the robot need to have when interacting with human customers? What are requirements for this kind of interactions? We have devised an application scenario for such a case, determined the necessary or desirable capabilities of the robot, developed a corresponding robot application and carried out initial tests and evaluations in a project together with the Kiel City Council. One of the most important insights gained in the project was that a humanoid robot with natural language processing capabilities based on large language models as well as human-like gestures and posture changes (animations) proved to be much more preferred by users compared to standard browser-based solutions on tablets for an information system in the City Council. Furthermore, we propose a connection of the ACT-R cognitive architecture with the robot, where an ACT-R model is used in interaction with the robot application to cognitively process and enhance a dialogue between human and robot. ∎ 1 Application scenario and skills that a social robot should have in the public sector The idea of integrating a humanoid social robot into the work processes of public offices and authorities in a meaningful and beneficial way raises the question of a specific application scenario. In our scenario, the focus should be on contact with customers and the transfer of information. Specifically, we are talking about a deployment in the reception area of the residents’ registration office of the city of Kiel. There is a need for information here, for example, on the type of documents required for a particular case or questions about any necessary registration and procedures. Employees of the office are involved in the design and testing of the robot applications with their own ideas and feedback. In order to fulfill these and other tasks, the robot should be able to understand and respond in natural language. In a public authority environment, it would also be highly desirable if the robot could understand and speak foreign languages and carry out translations. The information provided by the robot depends on the specific application and would have to be provided as ”expert knowledge”, for example from a database or stored in the application. Apart from answering questions in the respective specialist context, it would be advantageous for human-robot interaction to be as barrier-free and smooth as possible if the robot could understand and answer very general questions in addition to the specialist questions and, if necessary, conduct a dialogue freely. In addition, it would be desirable if the information were not only provided in a national language that would be optimal for the City Council dialog partner, but also in easy language appropriate for the customer to facilitate access to important information. Easy language is defined as a language style with simpler sentence structure and additional explanations. The target groups that can benefit from information in easy language include, among others, people with little knowledge of the administrative language and people who are learning the official language as a second language. In Germany alone, more than 10 million people require text in easily understandable language to access crucial information and manage their daily lives easylanguage . The robot should also have basic social skills to provide sufficient incentives for the people it interacts with to accept its services. Apart from a suitable outward appearance, this includes an adequate response to human comments and also a way of dealing with errors or misunderstandings that prevents frustration and possible unwillingness on the part of humans as far as possible. In this context, it would be desirable if the robot would be able to recognize the current emotional state of the conversation partner and process it appropriately. 2 Solution approaches for the desired tasks The technical approaches, architectures and services we use are listed below and provide an overview of the overall structure of the robot system to achieve the goals set in the project. 2.1 Humanoid social robot Pepper Since research has generally shown that trust is the basis for successful communication tasks and trust in robots is increased by anthropomorphism vanPinxteren , we choose the humanoid social robot Pepper for the tasks to be accomplished. Pepper, shown in Figure 1 , was developed by Aldebaran and first released in 2015 Pepper . A human face, the possibility of human-like expressions and body language, and a name of its own are seen as beneficial for the trust of people in the robot. Pepper is 120 centimeters tall and optimized for human interaction. It is able to engage with people through conversation, gestures and its touch screen. It is equipped with internal sensors, four directional microphones in his head and speakers for voice output. The robot is able to process images from its 3D camera and two HD cameras by shape recognition software for identification of faces and objects so that it can focus on, identify, and recognize people. Speech recognition and dialogue are available in different languages, but the respective language package must be purchased for each language required. Beyond, Pepper can perceive basic human emotions. The robot features an open and fully programmable platform so that developers can program their own applications to be run on Pepper using software development kits (SDKs). 2.2 Case-specific expert knowledge As a knowledge base for the case-specific expert knowledge that the robot should be able to provide information about, we use data from a MySQL database hosted on a web server with a self-programmed application programming interfaces (API) that returns text answers in JSON (JavaScript Object Notation) format 10111181 . This API transmits a term or phrase that the robot has heard and recognized to the server via Wi-Fi connection. A PHP script running on the web server then returns a corresponding response from the database. This basic knowledge base could be something totally different in another case of application. It is also possible to store expected questions in the form of keywords or phrases together with answers directly in the application, so that an external data source is not necessarily required. 2.3 Utilization of OpenAI GPT models In order to implement human-like arbitrary dialogues on any conceivable topic, we have had good experience with a connection to the OpenAI language models such as Generative Pre-trained Transformer (GPT) 3 or 4 openai . Of course, the output of these language models is not deterministic, so their use harbors certain risks. However, by appropriately tuning the model parameters, using explicit prompt generation and fine-tuning the model, good results can be achieved, at least for a range of questions that are not subject-specific and where errors would not have serious consequences. In practice, there would certainly be some obstacles to the use of these language models in the public authority environment for reasons of data protection. However, a quasi-natural flow of dialogue between humans and robots can be achieved

Read the complete text