Describing Upper-Body Motions Based on Labanotation for Learning-from-Observation Robots.
Saved in:
| Title: | Describing Upper-Body Motions Based on Labanotation for Learning-from-Observation Robots. |
|---|---|
| Authors: | Ikeuchi, Katsushi1 katsuike@microsoft.com, Ma, Zhaoyuan2 zma3@wpi.edu, Yan, Zengqiang3 zyanad@connect.ust.hk, Kudoh, Shunsuke4 s-kudoh@uec.ac.jp, Nakamura, Minako5 nakamura.minako@ocha.ac.jp |
| Source: | International Journal of Computer Vision. Dec2018, Vol. 126 Issue 12, p1415-1429. 15p. 1 Color Photograph, 14 Diagrams, 2 Charts, 2 Graphs. |
| Subjects: | Humanoid robots, Labanotation, Image recognition (Computer vision), Pose estimation (Computer vision), Computer vision |
| Abstract: | We have been developing a paradigm that we call learning-from-observation for a robot to automatically acquire a robot program to conduct a series of operations, or for a robot to understand what to do, through observing humans performing the same operations. Since a simple mimicking method to repeat exact joint angles or exact end-effector trajectories does not work well because of the kinematic and dynamic differences between a human and a robot, the proposed method employs intermediate symbolic representations, tasks, for conceptually representing what-to-do through observation. These tasks are subsequently mapped to appropriate robot operations depending on the robot hardware. In the present work, task models for upper-body operations of humanoid robots are presented, which are designed on the basis of Labanotation. Given a series of human operations, we first analyze the upper-body motions and extract certain fixed poses from key frames. These key poses are translated into tasks represented by Labanotation symbols. Then, a robot performs the operations corresponding to those task models. Because tasks based on Labanotation are independent of robot hardware, different robots can share the same observation module, and only different task-mapping modules specific to robot hardware are required. The system was implemented and demonstrated that three different robots can automatically mimic human upper-body operations with a satisfactory level of resemblance. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Computer Vision is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | We have been developing a paradigm that we call learning-from-observation for a robot to automatically acquire a robot program to conduct a series of operations, or for a robot to understand what to do, through observing humans performing the same operations. Since a simple mimicking method to repeat exact joint angles or exact end-effector trajectories does not work well because of the kinematic and dynamic differences between a human and a robot, the proposed method employs intermediate symbolic representations, tasks, for conceptually representing what-to-do through observation. These tasks are subsequently mapped to appropriate robot operations depending on the robot hardware. In the present work, task models for upper-body operations of humanoid robots are presented, which are designed on the basis of Labanotation. Given a series of human operations, we first analyze the upper-body motions and extract certain fixed poses from key frames. These key poses are translated into tasks represented by Labanotation symbols. Then, a robot performs the operations corresponding to those task models. Because tasks based on Labanotation are independent of robot hardware, different robots can share the same observation module, and only different task-mapping modules specific to robot hardware are required. The system was implemented and demonstrated that three different robots can automatically mimic human upper-body operations with a satisfactory level of resemblance. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 09205691 |
| DOI: | 10.1007/s11263-018-1123-1 |
