Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing | |
Yang, Bo2; Zhang JL(张嘉麟)1; Shi HG(石华光)1 | |
刊名 | IEEE Transactions on Industrial Informatics |
2021 | |
卷号 | 17期号:5页码:3599-3608 |
关键词 | Coordinated manufacturing industrial cyber-physical systems multiagent imitation learning |
ISSN号 | 1551-3203 |
产权排序 | 2 |
英文摘要 | Concordant operations among automatic industrial devices (i.e., agents) play a significant role in achieving efficient smart manufacturing. Existing multiagent cooperation methods focus on centralized training with decentralized execution, which is unsuitable for the edge-based distributed industrial scenarios. To harmonize distributed devices' actions and enhance the production efficiency, in this article, we propose an Interactive-Imitation-based Distributed Coordination (IIDC) algorithm. Specifically, we leverage the generative adversarial imitation learning (GAIL) model to direct one agent's actions by following external professional demonstrations. We also adopt the self-imitation learning (SIL) model to direct one agent's potential actions by following its own previous good experiences. As the imperfect demonstrations in the GAIL-based interagent imitation process may degrade the imitation accuracy, we present a confidence-based matching method to reduce the gap between the professional and imitative behaviors. Furthermore, during the SIL-based intra-agent imitation process, the rewardless explorations also lead to nonoptimal imitation policy. We then present a Stein variational policy gradient based self-imitation method to learn an expected optimal policy. We validate the IIDC algorithm's effectiveness via the sequential assembly task. Evaluation results demonstrate that the IIDC algorithm can enhance the production efficiency evidently. |
资助项目 | National Natural Science Foundation of China[62002346] ; National Natural Science Foundation of China[TII-20-0469] |
WOS研究方向 | Automation & Control Systems ; Computer Science ; Engineering |
语种 | 英语 |
WOS记录号 | WOS:000622100800060 |
资助机构 | National Natural Science Foundation of China under Grant 62002346 |
内容类型 | 期刊论文 |
源URL | [http://ir.sia.cn/handle/173321/28418] |
专题 | 沈阳自动化研究所_工业控制网络与系统研究室 |
通讯作者 | Yang, Bo |
作者单位 | 1.Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China 2.Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; |
推荐引用方式 GB/T 7714 | Yang, Bo,Zhang JL,Shi HG. Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing[J]. IEEE Transactions on Industrial Informatics,2021,17(5):3599-3608. |
APA | Yang, Bo,Zhang JL,&Shi HG.(2021).Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing.IEEE Transactions on Industrial Informatics,17(5),3599-3608. |
MLA | Yang, Bo,et al."Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing".IEEE Transactions on Industrial Informatics 17.5(2021):3599-3608. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论