Margin optimization based pruning for random forest | |
Yang, Fan ; Yang F(杨帆) ; Lu, Wei-hang ; Luo, Lin-kai ; Li, Tao | |
2012-10-01 | |
关键词 | Random forests Ensemble pruning Margin optimization |
英文摘要 | This article introduces a margin optimization based pruning algorithm which is able to reduce the ensemble size and improve the performance of a random forest. A key element of the proposed algorithm is that it directly takes into account the margin distribution of the random forest model on the training set. Four different metrics based on the margin distribution are used to evaluate the generalization ability of subensembles and the importance of individual classification trees in an ensemble. After a forest is built, the trees in the ensemble are first ranked according to the margin metrics and subensembles with decreasing sizes are then built by recursively removing the least important trees one by one. Experiments on 10 benchmark datasets demonstrate that our proposed algorithm can significantly improve the generalization performance while reducing the ensemble size at the same time. Furthermore, empirical comparison with other pruning methods indicates that the margin distribution plays an important role in evaluating the performance of a random forest, and can be directly used to select the near-optimal subensembles. (C) 2012 Elsevier B.V. All rights reserved.; Fundamental Research Funds for the Central Universities [2010121065]; Natural Science Foundations of Fujian Province of China [2011J01373]; Natural Science Foundations of China [60975052, 61102136] |
语种 | 英语 |
出版者 | ELSEVIER SCIENCE BV |
内容类型 | 期刊论文 |
源URL | [http://dx.doi.org/10.1016/j.neucom.2012.04.007] ![]() |
专题 | 信息技术-已发表论文 |
推荐引用方式 GB/T 7714 | Yang, Fan,Yang F,Lu, Wei-hang,et al. Margin optimization based pruning for random forest[J],2012. |
APA | Yang, Fan,杨帆,Lu, Wei-hang,Luo, Lin-kai,&Li, Tao.(2012).Margin optimization based pruning for random forest.. |
MLA | Yang, Fan,et al."Margin optimization based pruning for random forest".(2012). |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论