On the role of sparsity in feature selection and an innovative method LRMI | |
Yuchun Fang; Qiulong Yuan; Zhaoxiang Zhang | |
刊名 | Neurocomputing |
2018 | |
期号 | 321页码:237-250 |
关键词 | Feature Selection L1 Regularization Information Theory Mutual Information |
英文摘要 | Feature selection is used in many applications in machine learning and bioinformatics. As a popular approach, feature selection can be implemented in the filter-manner based on the sparse solution of the l1 regularization. Most study of the l1 regularization concentrates on investigating the iteration solution of the problem or focuses on adapting sparsity to different applications. It is necessary to explore more deeply about how the sparsity learned with the l1 regularization contributes to feature selection. In this paper, we make an effort to analyze the role of the l1 regularization in feature selection from the perspective of information theory. We discover that the l1 regularization contributes to minimizing the redundancy in feature selection. To avoid the complex computation of the l1 optimization, we propose a novel feature selection algorithm, i.e. the Laplacian regularization based on mutual information (LRMI), which realizes the minimization of the redundancy in a new way, and incorporates the l2 norm to achieve automatic grouping. Extensive experimental results demonstrate the superiority of LRMI over several traditional l1 regularization based feature selection algorithms with less time consumption. |
语种 | 英语 |
内容类型 | 期刊论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/23226] |
专题 | 自动化研究所_个人空间 |
推荐引用方式 GB/T 7714 | Yuchun Fang,Qiulong Yuan,Zhaoxiang Zhang. On the role of sparsity in feature selection and an innovative method LRMI[J]. Neurocomputing,2018(321):237-250. |
APA | Yuchun Fang,Qiulong Yuan,&Zhaoxiang Zhang.(2018).On the role of sparsity in feature selection and an innovative method LRMI.Neurocomputing(321),237-250. |
MLA | Yuchun Fang,et al."On the role of sparsity in feature selection and an innovative method LRMI".Neurocomputing .321(2018):237-250. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论