Dryad swMATH ID: 8916 Software Authors: Isard, M.; Budiu, M.; Yu, Y.; Birrell, A.; Fetterly, D. Description: Dryad: distributed data-parallel programs from sequential building blocks. Dryad is a general-purpose distributed execution engine for coarse-grain data-parallel applications. A Dryad application combines computational ”vertices” with communication ”channels” to form a dataflow graph. Dryad runs the application by executing the vertices of this graph on a set of available computers, communicating as appropriate through flies, TCP pipes, and shared-memory FIFOs. The vertices provided by the application developer are quite simple and are usually written as sequential programs with no thread creation or locking. Concurrency arises from Dryad scheduling vertices to run simultaneously on multiple computers, or on multiple CPU cores within a computer. The application can discover the size and placement of data at run time, and modify the graph as the computation progresses to make efficient use of the available resources. Dryad is designed to scale from powerful multi-core single computers, through small clusters of computers, to data centers with thousands of computers. The Dryad execution engine handles all the difficult problems of creating a large distributed, concurrent application: scheduling the use of computers and their CPUs, recovering from communication or computer failures, and transporting data between vertices. Homepage: http://dl.acm.org/citation.cfm?id=1273005 Related Software: MapReduce; Hadoop; Spark; DryadLINQ; Pregel; Java CoG Kit; Pegasus; Apache Spark; Bigtable; Haskell; Condor-G; Globus Toolkit; Ray; Drizzle; MuJoCo; Redis; Horovod; ELF; GraphLab; Caffe Cited in: 13 Documents all top 5 Cited by 39 Authors 2 Czumaj, Artur 2 Fan, Jianxi 2 Jia, Xiaohua 2 Lin, Cheng-Kuan 2 Montealegre, Pedro 2 Rapaport, Ivan 2 Todinca, Ioan 1 Becker, Florent 1 Burrows, Eva 1 Cheng, Baolei 1 Chou, Jerry 1 Chung, Yeh-Ching 1 Convolbo, Moïse W. 1 Davies, Peter A. 1 Fotakis, Dimitris A. 1 Haller, Philipp 1 Hao, Rongxia 1 Haveraaen, Magne 1 Hsu, Ching-Hsien 1 Łącki, Jakub 1 Lee, Anthony J. T. 1 Li, Xiaoyan 1 Mądry, Aleksander 1 Milis, Ioannis 1 Miller, Heather 1 Mitrović, Slobodan 1 Müller, Normen 1 Nanongkai, Danupon 1 Onak, Krzysztof 1 Papadigenopoulos, Orestis 1 Parter, Merav 1 Perez-Salazar, Sebastian 1 Sankowski, Piotr 1 Scquizzato, Michele 1 Tian, Zengxian 1 Vassalos, Vasilis 1 Wang, Xi 1 Whiteley, Nick 1 Zois, Georgios all top 5 Cited in 10 Serials 3 Theoretical Computer Science 2 SIAM Journal on Computing 1 Computing 1 Journal of Computer and System Sciences 1 Information and Computation 1 Distributed Computing 1 Journal of Functional Programming 1 Theory of Computing Systems 1 The Journal of Logic and Algebraic Programming 1 Statistical Analysis and Data Mining Cited in 4 Fields 13 Computer science (68-XX) 5 Combinatorics (05-XX) 1 Statistics (62-XX) 1 Operations research, mathematical programming (90-XX) Citations by Year