Sensing Micro-Motion Human Patterns using Multimodal mmRadar and Video Signal for Affective and Psychological Intelligence | |
Ru, Yiwei; Li, Peipei; Sun, Muyi; Wang, Yunlong; Zhang, Kunbo; Li, Qi; He, Zhaofeng; Sun, Zhenan | |
2023-10 | |
会议日期 | 2023-10 |
会议地点 | Canada |
英文摘要 | Affective and psychological perception are pivotal in human-machine interaction and essential domains within artificial intelligence. Existing physiological signal-based affective and psychological datasets primarily rely on contact-based sensors, potentially introducing extraneous affectives during the measurement process. Consequently, creating accurate non-contact affective and psychological perception datasets is crucial for overcoming these limitations and advancing affective intelligence. In this paper, we introduce the Remote Multimodal Affective and Psychological (ReMAP) dataset, for the first time, apply head micro-tremor (HMT) signals for affective and psychological perception. ReMAP features 68 participants and comprises two sub-datasets. The stimuli videos utilized for affective perception undergo rigorous screening to ensure the efficacy and universality of affective elicitation. Additionally, we propose a novel remote affective and psychological perception framework, leveraging multimodal complementarity and interrelationships to enhance affective and psychological perception capabilities. Extensive experiments demonstrate HMT as a "small yet powerful" physiological signal in psychological perception. Our method outperforms existing state-of-the-art approaches in remote affective recognition and psychological perception. The ReMAP dataset is publicly accessible at https://remap-dataset.github.io/ReMAP. |
内容类型 | 会议论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/55264] |
专题 | 自动化研究所_智能感知与计算研究中心 |
通讯作者 | He, Zhaofeng; Sun, Zhenan |
作者单位 | 1.Institute of Automation, Chinese Academy of Sciences 2.Beijing University of Posts and Telecommunications |
推荐引用方式 GB/T 7714 | Ru, Yiwei,Li, Peipei,Sun, Muyi,et al. Sensing Micro-Motion Human Patterns using Multimodal mmRadar and Video Signal for Affective and Psychological Intelligence[C]. 见:. Canada. 2023-10. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论