CORC  > 北京大学  > 信息科学技术学院
Modelling inter-task relations to transfer robot skills with three-way RBMs
Wang, Yi ; Han, Xiaoqiang ; Liu, Zhan ; Luo, Dingsheng ; Wu, Xihong
2015
英文摘要Transfer on Reinforcement Learning (RL) is a promising method on learning new skills and adapting new situations for humanoid robots as tasks or environments change. Within the normal process of Transfer Learning in RL, the inter-task mapping is manually defined, which lacks generalization ability. Therefore, how to automatically learning intertask relations becomes a hot topic. Considering the limited computational resource of a physical humanoid robot, high learning efficiency regarding to both fast speed algorithm and low sample complexity should be emphasized in skills transfer. According to this view, in this research, the inter-task relations are modelled using a three-way Restricted Boltzmann Machine (RBM), which is turned out to be a powerful model in capturing the similarity between samples from source task and target task. Since standard Contrastive Divergence (CD) algorithm commonly used for RBM learning suffers from the inputindependent problem and may lead the learning process timeconsuming or inapplicable, a Cyclic Contrastive Divergence (CCD) learning algorithm is employed. In order to evaluate the performance, experiment that transfer the skill of walking on flat surface to the skill walking on slope surface is conducted on our physical robot platform, PKU-HR5.1, and the result indicates that the method is feasible and efficient. ? 2015 IEEE.; EI; 1276-1282
语种英语
出处12th IEEE International Conference on Mechatronics and Automation, ICMA 2015
DOI标识10.1109/ICMA.2015.7237669
内容类型其他
源URL[http://ir.pku.edu.cn/handle/20.500.11897/436680]  
专题信息科学技术学院
推荐引用方式
GB/T 7714
Wang, Yi,Han, Xiaoqiang,Liu, Zhan,et al. Modelling inter-task relations to transfer robot skills with three-way RBMs. 2015-01-01.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace