OBOE swMATH ID: 35832 Software Authors: Chengrun Yang, Yuji Akimoto, Dae Won Kim, Madeleine Udell Description: OBOE: Collaborative Filtering for AutoML Model Selection. Algorithm selection and hyperparameter tuning remain two of the most challenging tasks in machine learning. Automated machine learning (AutoML) seeks to automate these tasks to enable widespread use of machine learning by non-experts. This paper introduces OBOE, a collaborative filtering method for time-constrained model selection and hyperparameter tuning. OBOE forms a matrix of the cross-validated errors of a large number of supervised learning models (algorithms together with hyperparameters) on a large number of datasets, and fits a low rank model to learn the low-dimensional feature vectors for the models and datasets that best predict the cross-validated errors. To find promising models for a new dataset, OBOE runs a set of fast but informative algorithms on the new dataset and uses their cross-validated errors to infer the feature vector for the new dataset. OBOE can find good models under constraints on the number of models fit or the total time budget. To this end, this paper develops a new heuristic for active learning in time-constrained matrix completion based on optimal experiment design. Our experiments demonstrate that OBOE delivers state-of-the-art performance faster than competing approaches on a test bed of supervised learning problems. Moreover, the success of the bilinear model used by OBOE suggests that AutoML may be simpler than was previously understood. Homepage: https://arxiv.org/abs/1808.03233 Keywords: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML) Related Software: Pyglrm; LowRankModels; GloVe; PMA; ADADELTA; PRMLT; AlexNet; Hyperband; auto-sklearn; Adam; AdaGrad; ImageNet; MNIST; CoSaMP; Regularization tools; Eigenstrat; ePCA; denoiseR; softImpute Cited in: 4 Publications all top 5 Cited by 12 Authors 1 Boyer, Claire 1 De Loera, Jesús A. 1 Haddock, Jamie 1 Josse, Julie 1 Ma, Anna 1 Morozov, Sergey 1 Needell, Deanna 1 Sportisse, Aude 1 Townsend, Alex 1 Tyrtyshnikov, Evgeniĭ Evgen’evich 1 Udell, Madeleine 1 Zamarashkin, Nikolai L. Cited in 4 Serials 1 Computational Mathematics and Mathematical Physics 1 Annals of Mathematics and Artificial Intelligence 1 Statistics and Computing 1 SIAM Journal on Mathematics of Data Science Cited in 4 Fields 3 Numerical analysis (65-XX) 2 Computer science (68-XX) 1 Statistics (62-XX) 1 Operations research, mathematical programming (90-XX) Citations by Year