自动化学报2013，Vol.39Issue(6)：745-758,14.DOI:10.3724/SP.J.1004.2013.00745
AdaBoost算法研究进展与展望
Advance and Prospects of AdaBoost Algorithm
摘要
Abstract
AdaBoost is one of the most excellent Boosting algorithms.It has a solid theoretical basis and has made great success in practical applications.AdaBoost can boost a weak learning algorithm with an accuracy slightly better than random guessing into an arbitrarily accurate strong learning algorithm,bringing about a new method and a new design idea to the design of learning algorithm.This paper first introduces how Boosting,just a conjecture when proposed,was proved right,and how this proof led to the origin of AdaBoost algorithm.Second,training and generalization error of AdaBoost are analyzed to explain why AdaBoost can successfully improve the accuracy of a weak learning algorithm.Third,different theoretical models to analyze AdaBoost are given.Meanwhile,many variants derived from these models are presented.Fourth,extensions of binary-class AdaBoost to multiclass AdaBoost are described.Besides,applications of AdaBoost algorithm are also introduced.Finally,interested directions which need to be further studied are discussed.For Boosting theory,these directions include deducing a tighter generalization error bound and figuring out a more precise weak learning condition in a multiclass problem.For AdaBoost,the stopping conditions,the way to enhance anti-noise capability and how to improve the accuracy by optimizing the diversity of the base classifiers,are good questions to be in-depth researched.关键词
集成学习/Boosting/AdaBoost/泛化误差/分类间隔/多分类Key words
Ensemble learning/Boosting/AdaBoost/generalization error/classification margin/multiclass classification引用本文复制引用
曹莹,苗启广,刘家辰,高琳..AdaBoost算法研究进展与展望[J].自动化学报,2013,39(6):745-758,14.基金项目
国家自然科学基金(61072109,61272280,41271447,61272195),教育部新世纪优秀人才支持计划(NCET-12-0919),中央高校基本科研业务费专项资金(K5051203020,K5051203001,K5051303018)资助 （61072109,61272280,41271447,61272195）
Supported by National Natural Science Foundation of China (61072109,61272280,41271447,61272195),the Program for New Century Excellent Talents in University (NCET-12-0919),and the Fundamental Research Funds for the Central Universities (K5051203020,K5051203001,K5051303018) （61072109,61272280,41271447,61272195）
