Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera

doi:10.1109/TIP.2017.2740624

CORC > 计算技术研究所 > 中国科学院计算技术研究所 > 中国科学院计算技术研究所期刊论文 > 英文

	Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera
	Wang, Kangkan 2,3; Zhang, Guofeng 1; Xia, Shihong 2
刊名	IEEE TRANSACTIONS ON IMAGE PROCESSING
	2017-12-01
卷号	26 期号:12 页码:5966-5979
关键词	Templateless non-rigid reconstruction motion tracking
ISSN号	1057-7149
DOI	10.1109/TIP.2017.2740624
英文摘要	We present a novel templateless approach for nonrigid reconstruction and motion tracking using a single RGB-D camera. Without any template prior, our system achieves accurate reconstruction and tracking for considerably deformable objects. To robustly register the input sequence of partial depth scans with dynamic motion, we propose an efficient local-to-global hierarchical optimization framework inspired by the idea of traditional structure-from-motion. Our proposed framework mainly consists of two stages, local nonrigid bundle adjustment and global optimization. To eliminate error accumulation during the nonrigid registration of loop motion sequences, we split the full sequence into several segments and apply local nonrigid bundle adjustment to align each segment locally. Global optimization is then adopted to combine all segments and handle the drift problem through loop-closure constraint. By fitting to the input partial data, a deforming 3D model sequence of dynamic objects is finally generated. Experiments on both synthetic and real test data sets and comparisons with state of the art demonstrate that our approach can handle considerable motions robustly and efficiently, and reconstruct high-quality 3D model sequences without drift.
资助项目	Natural Science Foundation of China[61602444] ; Natural Science Foundation of China[61672457] ; Knowledge Innovation Program of the Institute of Computing Technology of the Chinese Academy of Sciences[ICT20166040] ; Science and Technology Service Network Initiative of Chinese Academy of Sciences[KFJ-STS-ZDTP-017]
WOS研究方向	Computer Science ; Engineering
语种	英语
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号	WOS:000412433000026
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/6765]
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Wang, Kangkan
作者单位	1.Zhejiang Univ, State Key Lab CAD&CG, Hangzhou 310058, Zhejiang, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China 3.Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China
推荐引用方式 GB/T 7714	Wang, Kangkan,Zhang, Guofeng,Xia, Shihong. Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2017,26(12):5966-5979.
APA	Wang, Kangkan,Zhang, Guofeng,&Xia, Shihong.(2017).Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera.IEEE TRANSACTIONS ON IMAGE PROCESSING,26(12),5966-5979.
MLA	Wang, Kangkan,et al."Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera".IEEE TRANSACTIONS ON IMAGE PROCESSING 26.12(2017):5966-5979.