Autonomous Assembly Planning of Demonstrated Skills with Reinforcement Learning in Simulation

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)
34 Downloads (Pure)


Industrial robots used to assemble customized products in small batches require a lot of reprogramming. With this work we aim to reduce the programming complexity by autonomously finding the fastest assembly plans without any collisions with the environment. First, a digital twin of the robot uses a gym in simulation to learn which assembly skills (programmed by demonstration) are physically possible (i.e. no collisions with the environment). Only from this reduced solution space will the physical twin look for the fastest assembly plans. Experiments show that the system indeed converges to the fastest assembly plans. Moreover, pre-training in simulation drastically reduces the number of interactions before convergence compared to directly learning on the physical robot. This two-step procedure allows for the robot to autonomously find correct and fast assembly sequences, without any additional human input or mismanufactured products.
Original languageEnglish
Pages (from-to)1097-1110
Number of pages14
JournalAutonomous Robots
Issue number8
Publication statusPublished - 16 Oct 2021


Dive into the research topics of 'Autonomous Assembly Planning of Demonstrated Skills with Reinforcement Learning in Simulation'. Together they form a unique fingerprint.

Cite this