TensorFuzz swMATH ID: 41846 Software Authors: Augustus Odena, Ian Goodfellow Description: TensorFuzz: Debugging Neural Networks with Coverage-Guided Fuzzing. Machine learning models are notoriously difficult to interpret and debug. This is particularly true of neural networks. In this work, we introduce automated software testing techniques for neural networks that are well-suited to discovering errors which occur only for rare inputs. Specifically, we develop coverage-guided fuzzing (CGF) methods for neural networks. In CGF, random mutations of inputs to a neural network are guided by a coverage metric toward the goal of satisfying user-specified constraints. We describe how fast approximate nearest neighbor algorithms can provide this coverage metric. We then discuss the application of CGF to the following goals: finding numerical errors in trained neural networks, generating disagreements between neural networks and quantized versions of those networks, and surfacing undesirable behavior in character level language models. Finally, we release an open source library called TensorFuzz that implements the described techniques. Homepage: https://arxiv.org/abs/1807.10875 Source Code: https://github.com/brain-research/tensorfuzz Related Software: DeepXplore; DeepGauge; DLFuzz; DeepMutation; Adam; Python; AI2; Reluplex; DeepFool; DeepHunter; Scikit; PyTorch; ImageNet; ML4ML; AUTOTRAINER; DeepTest; Theano; CRADLE; Storm; DeepStellar Cited in: 2 Publications all top 5 Cited by 11 Authors 1 Deshmukh, Jyotirmoy V. 1 Huang, Xiaowei 1 Kröning, Daniel 1 Mohammadinejad, Sara 1 Paulsen, Brandon 1 Ruan, Wenjie 1 Sharp, James D. 1 Sun, Youcheng 1 Thamo, Emese 1 Wang, Chao 1 Yi, Xinping Cited in 1 Serial 1 Computer Science Review Cited in 1 Field 2 Computer science (68-XX) Citations by Year