CORC  > 厦门大学  > 信息技术-已发表论文
Margin optimization based pruning for random forest
Yang, Fan ; Yang F(杨帆) ; Lu, Wei-hang ; Luo, Lin-kai ; Li, Tao
2012-10-01
关键词Random forests Ensemble pruning Margin optimization
英文摘要This article introduces a margin optimization based pruning algorithm which is able to reduce the ensemble size and improve the performance of a random forest. A key element of the proposed algorithm is that it directly takes into account the margin distribution of the random forest model on the training set. Four different metrics based on the margin distribution are used to evaluate the generalization ability of subensembles and the importance of individual classification trees in an ensemble. After a forest is built, the trees in the ensemble are first ranked according to the margin metrics and subensembles with decreasing sizes are then built by recursively removing the least important trees one by one. Experiments on 10 benchmark datasets demonstrate that our proposed algorithm can significantly improve the generalization performance while reducing the ensemble size at the same time. Furthermore, empirical comparison with other pruning methods indicates that the margin distribution plays an important role in evaluating the performance of a random forest, and can be directly used to select the near-optimal subensembles. (C) 2012 Elsevier B.V. All rights reserved.; Fundamental Research Funds for the Central Universities [2010121065]; Natural Science Foundations of Fujian Province of China [2011J01373]; Natural Science Foundations of China [60975052, 61102136]
语种英语
出版者ELSEVIER SCIENCE BV
内容类型期刊论文
源URL[http://dx.doi.org/10.1016/j.neucom.2012.04.007]  
专题信息技术-已发表论文
推荐引用方式
GB/T 7714
Yang, Fan,Yang F,Lu, Wei-hang,et al. Margin optimization based pruning for random forest[J],2012.
APA Yang, Fan,杨帆,Lu, Wei-hang,Luo, Lin-kai,&Li, Tao.(2012).Margin optimization based pruning for random forest..
MLA Yang, Fan,et al."Margin optimization based pruning for random forest".(2012).
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace