Learning and planning for optimal synergistic human-robot coordination in manufacturing contexts

Samuele Sandrini, Marco Faroni, Nicola Pedrocchi · 2025

Read Learning and planning for optimal synergistic human-robot coordination in manufacturing contexts by Samuele Sandrini, Marco Faroni, Nicola Pedrocchi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07238.txt.

Introduction

Samuele Sandrini, Marco Faroni, and Nicola Pedrocchi work on smoother teamwork between people and robots on factory floors. Shared cells promise flexible production, but poor coordination wastes time and can endanger the human partner. Planning must weigh safety from the very first step.

Their model assigns and schedules tasks with a human-aware optimizer. A key twist is a synergy term for task pairs done side by side, which captures how safety limits on the robot change timing. They learn those terms from past runs using Bayesian methods and chain sampling. In tests, plans cut wasted interference, kept people and robots farther apart, and shortened the process by up to eighteen percent.

Catalog record

CREATORSamuele Sandrini, Marco Faroni, Nicola Pedrocchi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07238

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning and planning for optimal synergistic human-robot coordination in manufacturing contexts Samuele Sandrini, Marco Faroni, Nicola Pedrocchi Abstract Collaborative robotics cells leverage heterogeneous agents to provide agile production solutions. Effective coordination is essential to prevent inefficiencies and risks for human operators working alongside robots. This paper proposes a human-aware task allocation and scheduling model based on Mixed Integer Nonlinear Programming to optimize efficiency and safety starting from task planning stages. The approach exploits synergies that encode the coupling effects between pairs of tasks executed in parallel by the agents, arising from the safety constraints imposed on robot agents. These terms are learned from previous executions using a Bayesian estimation; the inference of the posterior probability distribution of the synergy coefficients is performed using the Markov Chain Monte Carlo method. The synergy enhances task planning by adapting the nominal duration of the plan according to the effect of the operator’s presence. Simulations and experimental results demonstrate that the proposed method produces improved human-aware task plans, reducing unuseful interference between agents, increasing human-robot distance, and achieving up to an 18% reduction in process execution time. 1 Introduction Production stations often involve the coexistence of human operators and robots to ensure flexibility, reconfigurability, and suitability for high-mix, low-volume production demands. Safety has a direct impact in terms of efficiency in collaborative environments [ 2 ] , e.g. , the Speed and Separation Monitoring (SSM) proposed by ISO/TS 15066 [ 60 ] requires that the robot speed be modulated based on the agents’ distance to keep a protective separation. Researchers have tackled the “safety-vs-efficiency” trade-off by mainly acting on motion planning and control levels (e.g., impedance control [ 19 , 59 ] , safety-aware path planning [ 14 , 33 ] , and fast motion replanning [ 61 ] ). At the same time, only a few works focused on the task planning layer (e.g. [ 15 ] ). When the task planner is unaware of safety aspects, it produces plans that may lead to interference between the agents and increase the frequency of safety stops that must be activated to guarantee the operators’ safety. In such a context, our paper investigates the coordination of agents to achieve efficient production, considering safety-related effects and agent interference. The approach pursues a synergistic human-robot collaboration for Industry 5.0 [ 11 ] , with particular relevance to assembly and disassembly applications, object sorting, and bin picking for collaborative robotic cells, as shown in Figure 1 . Figure 1: Visual description of the proposed method. The boxes on the left show how task statistics and task synergies of the various agents are estimated using process experience, highlighting good or bad couplings between them. In the center, it is shown how these synergies are integrated to improve the MINLP algorithm for task allocation and scheduling. The boxes on the right show two industrial application scenarios that can benefit from the proposed method. Supplementary material can be found: https://jrl-cari-cnr-unibs.github.io/synergistic_hrtp/ . 1.1 Related Works Task Allocation and Scheduling in Human-Robot Collaboration (HRC) have been tackled using heterogeneous approaches. Several works focused only on the task allocation problem [ 9 ] . For example, [ 29 ] uses AND/OR graph plan representation [ 45 ] and solves the optimal allocation problem by graph search with A*. Building upon this work, [ 36 ] emphasized the agent’s capability-based allocation problem by introducing indices about task complexity, agent dexterity, and effort. In [ 46 ] and [ 47 ] , the problem of assigning tasks to agents online is addressed using the AND/OR graph representation and the AO* graph search, taking into account the physical load of the agent that is quantified by motion capture and ergonomic risk assessment. The ergonomics factor in the allocation problem plays a crucial role in [ 8 , 44 ] . In [ 20 ] , the online task allocation problem is integrated with a custom control node into a Behavior Tree [ 28 ] ; the allocation is solved through Mixed Integer Linear Programming (MILP) on a subset of tasks at runtime only when it is time to perform that subset of actions. [ 48 ] investigates both allocation and scheduling. The allocation is solved offline based on agent capabilities and is decoupled from the scheduling. A variant of the Hungarian algorithm [ 32 ] solves the allocation, while a MILP approach solves the scheduling. Some works incorporate the degradation of human performance during execution [ 37 , 51 , 64 ] . The work in [ 54 ] introduces the concept of awareness of the actual duration of the tasks performed by the operator using a two-level architecture: (i) a task allocation and scheduling layer based on Multi-Objective MILP and (ii) a dynamic scheduling layer that reschedules when triggered by the agents monitoring. The same architecture was used in [ 53 ] to adapt the schedule locally in case of failure. In [ 13 ] and [ 15 ] the human-robot coordination is pursued through a Timeline-based task planner included in the Task and Motion Planning (TAMP) framework [ 21 ] . In [ 39 ] , the authors combine TAMP with a human motion prediction module based on a goal-conditioned recurrent neural network to reduce human-robot interference. Human-Aware Task Planning was studied by Alami et al. in [ 1 ] using the Hierarchical Task Network paradigm [ 22 ] . This evolved into the HATP (Hierarchical Agent-based Task Planner) framework [ 10 , 34 , 35 ] and its variants [ 7 ] , which consider the human agent as a rational agent with its decision model. Theory of Mind (ToM) was recently explicitly introduced at the task planning level in [ 16 ] . A branch of the literature focused on allocation and scheduling problems for industrial applications. For instance, [ 26 ] handles the coordination of heterogeneous agents using a MILP formalization and constrained scheduling for aircraft assembly; [ 62 ] and [ 63 ] apply timeline-based planning in the TAMP framework to a semi-automated assembly/disassembly industrial case study; [ 43 ] proposed a task allocation technique for HRC using a neural network for electric vehicle battery disassembly; [ 6 ] takes up the MILP formulation to handle allocation and scheduling for the assembly of printed circuit boards using meta-heuristic techniques; and [ 40 ] solves the allocation problem using genetic algorithms for HRC in mold assembly processes. Some works consider safety and efficiency jointly at task planning level. [ 42 ] formalizes human-multi-robot allocation and scheduling problems jointly based on MILP; the cost function is optimized by considering the makespan, an index of task execution quality, and the agents’ workload. They consider safety issues by introducing spatial constraints , avoiding the parallel execution of tasks in the same work area, and providing online monitoring and rescheduling. The agents’ occupancy maps are known beforehand. In [ 41 ] , they introduce the cost of task switches during online rescheduling. [ 52 ] reformulates the dynamic scheduler in [ 51 , 54 ] to online adapt the schedule locally in case of safety halts. However, this implements an online countermeasure to risky or blocking situations without the proactivity needed to avoid such situations. [

Read the complete text