ChaLearn Looking at People: IsoGD and ConGD Large-Scale RGB-D Gesture Recognition

doi:10.1109/TCYB.2020.3012092

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 生物识别与安全技术研究中心

	ChaLearn Looking at People: IsoGD and ConGD Large-Scale RGB-D Gesture Recognition
	Wan, Jun 15,16; Lin, Chi 14; Wen, Longyin 13; Li, Yunan 11,12; Miao, Qiguang 11,12; Escalera, Sergio 10; Anbarjafari, Gholamreza 7,8,9; Guyon, Isabelle 5,6; Guo, Guodong 3,4; Li, Stan Z.1,2
刊名	IEEE TRANSACTIONS ON CYBERNETICS
	2022-05-01
卷号	52 期号:5 页码:3422-3433
关键词	Gesture recognition Measurement Task analysis Training Conferences Computer vision Bidirectional long short-term memory (Bi-LSTM) gesture recognition RGB-D
ISSN号	2168-2267
DOI	10.1109/TCYB.2020.3012092
通讯作者	Wan, Jun(jun.wan@ia.ac.cn)
英文摘要	The ChaLearn large-scale gesture recognition challenge has run twice in two workshops in conjunction with the International Conference on Pattern Recognition (ICPR) 2016 and International Conference on Computer Vision (ICCV) 2017, attracting more than 200 teams around the world. This challenge has two tracks, focusing on isolated and continuous gesture recognition, respectively. It describes the creation of both benchmark datasets and analyzes the advances in large-scale gesture recognition based on these two datasets. In this article, we discuss the challenges of collecting large-scale ground-truth annotations of gesture recognition and provide a detailed analysis of the current methods for large-scale isolated and continuous gesture recognition. In addition to the recognition rate and mean Jaccard index (MJI) as evaluation metrics used in previous challenges, we introduce the corrected segmentation rate (CSR) metric to evaluate the performance of temporal segmentation for continuous gesture recognition. Furthermore, we propose a bidirectional long short-term memory (Bi-LSTM) method, determining video division points based on skeleton points. Experiments show that the proposed Bi-LSTM outperforms state-of-the-art methods with an absolute improvement of 8.1% (from 0.8917 to 0.9639) of CSR.
资助项目	Chinese National Natural Science Foundation[61961160704] ; Chinese National Natural Science Foundation[61876179] ; Key Project of the General Logistics Department[ASW17C001] ; Science and Technology Development Fund of Macau[0010/2019/AFJ] ; Science and Technology Development Fund of Macau[0025/2019/AKP] ; Science and Technology Development Fund of Macau[PID2019-105093GB-I00] ; (MINECO/FEDER, UE) ; (CERCA Programme/Generalitat de Catalunya) ; ICREA through the ICREA Academia Programme - European Regional Development Fund
WOS关键词	FUSION
WOS研究方向	Automation & Control Systems ; Computer Science
语种	英语
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号	WOS:000798227800076
资助机构	Chinese National Natural Science Foundation ; Key Project of the General Logistics Department ; Science and Technology Development Fund of Macau ; (MINECO/FEDER, UE) ; (CERCA Programme/Generalitat de Catalunya) ; ICREA through the ICREA Academia Programme - European Regional Development Fund
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/49482]
专题	自动化研究所_模式识别国家重点实验室_生物识别与安全技术研究中心
通讯作者	Wan, Jun
作者单位	1.Macau Univ Sci & Technol, Taipa, Macau, Peoples R China 2.Westlake Univ, Hangzhou 310024, Peoples R China 3.Natl Engn Lab Deep Learning Technol & Applicat, Beijing 100193, Peoples R China 4.Baidu Res, Inst Deep Learning, Beijing 100193, Peoples R China 5.Univ Paris Saclay, F-91190 St Aubin, France 6.ChaLearn, San Francisco, CA 94115 USA 7.Hasan Kalyoncu Univ, Fac Engn, TR-27100 Gaziantep, Turkey 8.PwC Finland, Helsinki 00180, Finland 9.Univ Tartu, Inst Technol, iCV Lab, EE-50090 Tartu, Estonia 10.Univ Barcelona, Comp Vis Ctr, Barcelona 08007, Spain
推荐引用方式 GB/T 7714	Wan, Jun,Lin, Chi,Wen, Longyin,et al. ChaLearn Looking at People: IsoGD and ConGD Large-Scale RGB-D Gesture Recognition[J]. IEEE TRANSACTIONS ON CYBERNETICS,2022,52(5):3422-3433.
APA	Wan, Jun.,Lin, Chi.,Wen, Longyin.,Li, Yunan.,Miao, Qiguang.,...&Li, Stan Z..(2022).ChaLearn Looking at People: IsoGD and ConGD Large-Scale RGB-D Gesture Recognition.IEEE TRANSACTIONS ON CYBERNETICS,52(5),3422-3433.
MLA	Wan, Jun,et al."ChaLearn Looking at People: IsoGD and ConGD Large-Scale RGB-D Gesture Recognition".IEEE TRANSACTIONS ON CYBERNETICS 52.5(2022):3422-3433.