Experience Reuse with Probabilistic Movement Primitives

Svenja Stark, Jan Peters, Elmar Rückert


Acquiring new robot motor skills is cumbersome, as learning a skill from scratch and without prior knowledge requires the exploration of a large space of motor configurations. Accordingly, for learning a new task, time could be saved by restricting the parameter search space by initializing it with the solution of a similar task. We present a framework which is able of such knowledge transfer from already learned movement skills to a new learning task. The framework combines probabilistic movement primitives with descriptions of their effects for skill representation. New skills are first initialized with parameters inferred from related movement primitives and thereafter adapted to the new task through relative entropy policy search. We compare two different transfer approaches to initialize the search space distribution with data of known skills with a similar effect. We show the different benefits of the two knowledge transfer approaches on an object pushing task for a simulated 3-DOF robot. We can show that the quality of the learned skills improves and the required iterations to learn a new task can be reduced by more than 60% when past experiences are utilized.

Original languageEnglish
Title of host publication2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Number of pages8
Publication date11.2019
Article number8968545
ISBN (Print)978-1-7281-4005-6, 978-1-7281-4003-2
ISBN (Electronic)978-1-7281-4004-9
Publication statusPublished - 11.2019
Event2019 IEEE/RSJ International Conference on Intelligent Robots and Systems - Macau, China
Duration: 03.11.201908.11.2019
Conference number: 157163


Dive into the research topics of 'Experience Reuse with Probabilistic Movement Primitives'. Together they form a unique fingerprint.

Cite this