Utterance independent bimodal emotion recognition in spontaneous communication

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 人机语音交互团队

	Utterance independent bimodal emotion recognition in spontaneous communication
	Tao, Jianhua; Pan, Shifeng; Yang, Minghao; Li, Ya; Mu, Kaihui; Che, Jianfeng
刊名	EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING
	2011
关键词	Bimodal emotion recognition Utterance Independent Multistream Hidden Markov Model Fused Hidden Markov Model Inversion
英文摘要	Emotion expressions sometimes are mixed with the utterance expression in spontaneous face-to-face communication, which makes difficulties for emotion recognition. This article introduces the methods of reducing the utterance influences in visual parameters for the audio-visual-based emotion recognition. The audio and visual channels are first combined under a Multistream Hidden Markov Model (MHMM). Then, the utterance reduction is finished by finding the residual between the real visual parameters and the outputs of the utterance related visual parameters. This article introduces the Fused Hidden Markov Model Inversion method which is trained in the neutral expressed audio-visual corpus to solve the problem. To reduce the computing complexity the inversion model is further simplified to a Gaussian Mixture Model (GMM) mapping. Compared with traditional bimodal emotion recognition methods (e.g., SVM, CART, Boosting), the utterance reduction method can give better results of emotion recognition. The experiments also show the effectiveness of our emotion recognition system when it was used in a live environment.
WOS标题词	Science & Technology ; Technology
类目[WOS]	Engineering, Electrical & Electronic
研究领域[WOS]	Engineering
关键词[WOS]	FACIAL EXPRESSION ANALYSIS ; AUDIOVISUAL AFFECT RECOGNITION ; HIDDEN MARKOV-MODELS ; IMAGE SEQUENCES ; SPEECH ; DATABASES
收录类别	SCI
语种	英语
WOS记录号	WOS:000294848600001
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/3238]
专题	自动化研究所_模式识别国家重点实验室_人机语音交互团队
作者单位	Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Tao, Jianhua,Pan, Shifeng,Yang, Minghao,et al. Utterance independent bimodal emotion recognition in spontaneous communication[J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING,2011.
APA	Tao, Jianhua,Pan, Shifeng,Yang, Minghao,Li, Ya,Mu, Kaihui,&Che, Jianfeng.(2011).Utterance independent bimodal emotion recognition in spontaneous communication.EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING.
MLA	Tao, Jianhua,et al."Utterance independent bimodal emotion recognition in spontaneous communication".EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING (2011).