PLANET swMATH ID: 15434 Software Authors: Biswanath Panda, Joshua S. Herbach, Sugato Basu, Roberto J. Bayardo Description: Planet: Massively parallel learning of tree ensembles with mapreduce. Classification and regression tree learning on massive datasets is a common data mining task at Google, yet many state of the art tree learning algorithms require training data to reside in memory on a single machine. While more scalable implementations of tree learning have been proposed, they typically require specialized parallel computing architectures. In contrast, the majority of Google’s computing infrastructure is based on commodity hardware. In this paper, we describe PLANET: a scalable distributed framework for learning tree models over large datasets. PLANET defines tree learning as a series of distributed computations, and implements each one using the MapReduce model of distributed computation. We show how this framework supports scalable construction of classification and regression trees, as well as ensembles of such models. We discuss the benefits and challenges of using a MapReduce compute cluster for tree learning, and demonstrate the scalability of this approach by applying it to a real world learning task from the domain of computational advertising. Homepage: http://dl.acm.org/citation.cfm?id=1687569 Related Software: MapReduce; SPRINT; CUDA; Apache Spark; GitHub; MLbase; GraphX; Breeze; MLlib; pmml; Scikit; Mahout; NumPy; C4.5; UCI-ml; Amazon EC2; TelegraphCQ; Hive; DryadLINQ; SLIQ Cited in: 3 Documents all top 5 Cited by 26 Authors 1 Amde, Manish 1 Bradley, Joseph 1 Chow, Chi-Yin 1 Franklin, Michael J. 1 Freeman, Jeremy 1 He, Yulin 1 Kollios, George 1 Koudas, Nick 1 Liu, Davies 1 Meng, Xiangrui 1 Mishra, Chaitanya 1 Nykiel, Tomasz 1 Ou, Fang-Fang 1 Owen, Sean W. 1 Potamias, Michalis 1 Sparks, Evan 1 Talwalkar, Ameet 1 Tsai, Db 1 Venkataraman, Shivaram 1 Wang, Ran 1 Xin, Doris 1 Xin, Reynold 1 Yavuz, Burak 1 Zadeh, Reza 1 Zaharia, Matei 1 Zhang, Jian Cited in 3 Serials 1 ACM Transactions on Database Systems 1 Fuzzy Sets and Systems 1 Journal of Machine Learning Research (JMLR) Cited in 1 Field 3 Computer science (68-XX) Citations by Year