Multinomial regression with elastic net penalty and its grouping effect in gene selection. (English) Zbl 1468.62304

Summary: For the multiclass classification problem of microarray data, a new optimization model named multinomial regression with the elastic net penalty was proposed in this paper. By combining the multinomial likeliyhood loss and the multiclass elastic net penalty, the optimization model was constructed, which was proved to encourage a grouping effect in gene selection for multiclass classification.


62H30 Classification and discrimination; cluster analysis (statistical aspects)
62P10 Applications of statistics to biology and medical sciences; meta analysis
90C90 Applications of mathematical programming


vbmp; glmnet
Full Text: DOI


[1] Guyon, I.; Weston, J.; Barnhill, S.; Vapnik, V., Gene selection for cancer classification using support vector machines, Machine Learning, 46, 1-3, 389-422 (2002) · Zbl 0998.68111
[2] Tibshirani, R., Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society B, 58, 1, 267-288 (1996) · Zbl 0850.62538
[3] Wang, L.; Zhu, J.; Zou, H., Hybrid huberized support vector machines for microarray classification and gene selection, Bioinformatics, 24, 3, 412-419 (2008)
[4] Wang, L.; Zhu, J.; Zou, H., The doubly regularized support vector machine, Statistica Sinica, 16, 2, 589-615 (2006) · Zbl 1126.68070
[5] Zhu, J.; Rosset, R.; Hastie, T., 1-norm support vector machine, Advances in Neural Information Processing Systems, 16, 49-56 (2004), New York, NY, USA: MIT Press, New York, NY, USA
[6] Cawley, G. C.; Talbot, N. L. C., Gene selection in cancer classification using sparse logistic regression with Bayesian regularization, Bioinformatics, 22, 19, 2348-2355 (2006)
[7] Zou, H.; Hastie, T., Regularization and variable selection via the elastic net, Journal of the Royal Statistical Society B, 67, 2, 301-320 (2005) · Zbl 1069.62054
[8] Li, J.; Jia, Y.; Zhao, Z., Partly adaptive elastic net and its application to microarray classification, Neural Computing and Applications, 22, 6, 1193-1200 (2013)
[9] Lee, Y.; Lin, Y.; Wahba, G., Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data, Journal of the American Statistical Association, 99, 465, 67-81 (2004) · Zbl 1089.62511
[10] Zhou, X.; Tuck, D. P., MSVM-RFE: extensions of SVM-RFE for multiclass gene selection on DNA microarray data, Bioinformatics, 23, 9, 1106-1114 (2007)
[11] Student, S.; Fujarewicz, K., Stable feature selection and classification algorithms for multiclass microarray data, Biology Direct, 7, 33, 133-140 (2012)
[12] Wang, L.; Shen, X., On \(L_1\)-norm multiclass support vector machines: methodology and theory, Journal of the American Statistical Association, 102, 478, 583-594 (2007) · Zbl 1172.62317
[13] Zhang, H. H.; Liu, Y.; Wu, Y.; Zhu, J., Variable selection for the multicategory SVM via adaptive sup-norm regularization, Electronic Journal of Statistics, 2, 149-167 (2008) · Zbl 1135.62056
[14] Li, J.-T.; Jia, Y.-M., Huberized multiclass support vector machine for microarray classification, Acta Automatica Sinica, 36, 3, 399-405 (2010) · Zbl 1240.68189
[15] You, M.; Li, G.-Z., Feature selection for multi-class problems by using pairwise-class and all-class techniques, International Journal of General Systems, 40, 4, 381-394 (2011)
[16] Park, M. Y.; Hastie, T., Penalized logistic regression for detecting gene interactions, Biostatistics, 9, 1, 30-50 (2008) · Zbl 1274.62853
[17] Koh, K.; Kim, S.-J.; Boyd, S., An interior-point method for large-scale \(L_1\)-regularized logistic regression, Journal of Machine Learning Research, 8, 1519-1555 (2007) · Zbl 1222.62092
[18] Xu, C.; Peng, Z. M.; Jing, W. F., Sparse kernel logistic regression based on \(L_{1 / 2}\) regularization, Science China Information Sciences, 56, 4, 1-16 (2013) · Zbl 1488.62119
[19] Yang, Y.; Kenneth, N.; Kim, S., A novel k-mer mixture logistic regression for methylation susceptibility modeling of CpG dinucleotides in human gene promoters, BMC Bioinformatics, 13, 1471-1480 (2012)
[20] Cawley, G. C.; Talbot, N. L. C.; Girolami, M., Sparse multinomial logistic regression via Bayesian L1 regularization, Advances in Neural Information Processing Systems, 19, 209-216 (2007), New York, NY, USA: MIT Press, New York, NY, USA
[21] Lama, N.; Girolami, M., vbmp: variational Bayesian multinomial probit regression for multi-class classification in R, Bioinformatics, 24, 1, 135-136 (2008)
[22] Sreekumar, J.; ter Braak, C. J. F.; van Ham, R. C. H. J.; van Dijk, A. D. J., Correlated mutations via regularized multinomial regression, BMC Bioinformatics, 12, article 444 (2011)
[23] Friedman, J.; Hastie, T.; Tibshirani, R., Regularization paths for generalized linear models via coordinate descent, Journal of Statistical Software, 33, 1, 1-22 (2010)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.