AdaBoost-SAMME swMATH ID: 19134 Software Authors: Zhu, Ji; Zou, Hui; Rosset, Saharon; Hastie, Trevor Description: Multi-class AdaBoost. Boosting has been a very successful technique for solving the two-class classification problem. In going from two-class to multi-class classification, most algorithms have been restricted to reducing the multi-class classification problem to multiple two-class problems. We develop a new algorithm that directly extends the AdaBoost algorithm to the multi-class case without reducing it to multiple two-class problems. We show that the proposed multi-class AdaBoost algorithm is equivalent to a forward stagewise additive modeling algorithm that minimizes a novel exponential loss for multi-class classification. Furthermore, we show that the exponential loss is a member of a class of Fisher-consistent loss functions for multi-class classification. As shown in this paper, the new algorithm is extremely easy to implement and is highly competitive in terms of misclassification error rate. Homepage: http://www.intlpress.com/site/pub/files/_fulltext/journals/sii/2009/0002/0003/SII-2009-0002-0003-a008.pdf Dependencies: R Related Software: AdaBoost.MH; UCI-ml; ElemStatLearn; rpart; XGBoost; StatLib Datasets Archive; R; adabag; mlbench; Scikit; glmnet; LIBSVM; SIFT; gbm; caret; CRAN Task Views; ada; mboost; digeR; gss Cited in: 24 Publications all top 5 Cited by 81 Authors 3 Kim, Hyunjoong 2 Ahn, Hongshik 1 Al-Rawabdeh, Wasfi A. 1 Ali, Wafa Bel Haj 1 Aravkin, Aleksandr Y. 1 Barlaud, Michel 1 Baumela, Luis 1 Bauvin, Baptiste 1 Bottegal, Giulio 1 Cai, Tianxi 1 Capponi, Cécile 1 Carrizosa, Emilio 1 Chang, Xiangyu 1 Chen, Cheng 1 Chen, Yu-Chuan 1 Dai, Guang 1 Dalalah, Doraid M. 1 Drotár, Peter 1 Fei, Shumin 1 Feng, Chen 1 Fernández-Baldera, Antonio 1 Furlan, John M. 1 Gazda, Matej 1 Ge, Yubin 1 Geist, Matthieu 1 Ghosh, Anil Kumar 1 Godtliebsen, Fred 1 Guo, Yuxuan 1 Ha, Hyejung 1 Han, Sunwoo 1 Hastie, Trevor John 1 Hilgeman, Michiel Jurgen 1 Hu, Runshan 1 Jiang, Hui 1 Jin, Lizuo 1 Kethireddy, Shravan 1 Kim, Hyeuk 1 Laviolette, François 1 Lee, Yung-Seop 1 Li, Wujun 1 Li, Zhen 1 Lu, Ziyao 1 Luo, Jiebo 1 Mei, Yajun 1 Molero-Río, Cristina 1 Moon, Hojin 1 Neykov, Matey 1 Nie, Qingfeng 1 Nielsen, Frank 1 Nock, Richard 1 Pagalthivarthi, Krishnan V. 1 Pillonetto, Gianluigi 1 Piro, Paolo 1 Rhuggenaath, Jason 1 Romero Morales, Dolores 1 Rosset, Saharon 1 Roy, Jean-Francis 1 Song, Linfeng 1 Su, Jinsong 1 Sun, Jing 1 Sun, Le 1 Tang, Jialong 1 Verwer, Sicco 1 Visintainer, Robert J. 1 Vokorokos, Liberios 1 Wang, Xin 1 Wang, Yan 1 Wu, Wei 1 Wu, Yichao 1 Xie, Yunxin 1 Xiong, Deyi 1 Yang, Yi 1 Ye, Qing Chuan 1 Yeung, Dit-Yan 1 Zhang, Hao Helen 1 Zhang, Yingqian 1 Zhang, Zhihua 1 Zhu, Chenyang 1 Zhu, Ji 1 Zhu, Zhengwei 1 Zou, Hui all top 5 Cited in 17 Serials 4 Machine Learning 3 Pattern Recognition 2 Artificial Intelligence 1 Computer Methods in Applied Mechanics and Engineering 1 Information Sciences 1 Computational Statistics 1 Computational Statistics and Data Analysis 1 International Journal of Computer Vision 1 Top 1 Annals of Mathematics and Artificial Intelligence 1 Journal of Applied Statistics 1 RAIRO. Operations Research 1 Journal of Machine Learning Research (JMLR) 1 Journal of the Korean Statistical Society 1 Mathematical Geosciences 1 Statistics and Its Interface 1 Journal of Computational and Graphical Statistics all top 5 Cited in 7 Fields 16 Computer science (68-XX) 14 Statistics (62-XX) 4 Game theory, economics, finance, and other social and behavioral sciences (91-XX) 3 Operations research, mathematical programming (90-XX) 1 Numerical analysis (65-XX) 1 Fluid mechanics (76-XX) 1 Geophysics (86-XX) Citations by Year