Captum swMATH ID: 35075 Software Authors: Narine Kokhlikyan, Vivek Miglani, Miguel Martin, Edward Wang, Bilal Alsallakh, Jonathan Reynolds, Alexander Melnikov, Natalia Kliushkina, Carlos Araya, Siqi Yan, Orion Reblitz-Richardson Description: Captum: A unified and generic model interpretability library for PyTorch. In this paper we introduce a novel, unified, open-source model interpretability library for PyTorch [12]. The library contains generic implementations of a number of gradient and perturbation-based attribution algorithms, also known as feature, neuron and layer importance algorithms, as well as a set of evaluation metrics for these algorithms. It can be used for both classification and non-classification models including graph-structured models built on Neural Networks (NN). In this paper we give a high-level overview of supported attribution algorithms and show how to perform memory-efficient and scalable computations. We emphasize that the three main characteristics of the library are multimodality, extensibility and ease of use. Multimodality supports different modality of inputs such as image, text, audio or video. Extensibility allows adding new algorithms and features. The library is also designed for easy understanding and use. Besides, we also introduce an interactive visualization tool called Captum Insights that is built on top of Captum library and allows sample-based model debugging and visualization using feature importance metrics. Homepage: https://arxiv.org/abs/2009.07896 Dependencies: PyTorch Keywords: Machine Learning; arXiv_cs.LG; Artificial Intelligence; arXiv_cs.AI; arXiv_stat.ML; PyTorch; Interpretability; Attribution; Multi-Modal; Model Understanding Related Software: Alibi Explain; Python; PyTorch; InterpretML; tf-explain; iNNvestigate; Alibi; AI Explainability 360; GitHub; TensorFlow; TSViz; TSInterpret; DistilBERT; jiant; RoBERTa; BERT; diagNNose; SmoothGrad; Grad-CAM; Seldon Core Cited in: 2 Publications Standard Articles 1 Publication describing the Software Year Captum: A unified and generic model interpretability library for PyTorch Narine Kokhlikyan, Vivek Miglani, Miguel Martin, Edward Wang, Bilal Alsallakh, Jonathan Reynolds, Alexander Melnikov, Natalia Kliushkina, Carlos Araya, Siqi Yan, Orion Reblitz-Richardson 2020 all top 5 Cited by 24 Authors 1 Arya, Vijay 1 Bellamy, Rachel K. E. 1 Chen, Pin-Yu 1 Coca, Alexandru 1 Dhurandhar, Amit 1 Hind, Michael 1 Hoffman, Samuel C. 1 Houde, Stephanie 1 Klaise, Janis 1 Liao, Q. Vera 1 Luss, Ronny 1 Mojsilović, Aleksandra 1 Mourad, Sami 1 Pedemonte, Pablo 1 Raghavendra, Ramya 1 Richards, John T. 1 Sattigeri, Prasanna 1 Shanmugam, Karthikeyan 1 Singh, Moninder 1 Vacanti, Giovanni 1 van Looveren, Arnaud 1 Varshney, Kush R. 1 Wei, Dennis 1 Zhang, Yunfeng Cited in 1 Serial 2 Journal of Machine Learning Research (JMLR) Cited in 1 Field 2 Computer science (68-XX) Citations by Year