LargeVis swMATH ID: 34905 Software Authors: Jian Tang, Jingzhou Liu, Ming Zhang, Qiaozhu Mei Description: LargeVis: Visualizing Large-scale and High-dimensional Data. We study the problem of visualizing large-scale and high-dimensional data in a low-dimensional (typically 2D or 3D) space. Much success has been reported recently by techniques that first compute a similarity structure of the data points and then project them into a low-dimensional space with the structure preserved. These two steps suffer from considerable computational costs, preventing the state-of-the-art methods such as the t-SNE from scaling to large-scale and high-dimensional data (e.g., millions of data points and hundreds of dimensions). We propose the LargeVis, a technique that first constructs an accurately approximated K-nearest neighbor graph from the data and then layouts the graph in the low-dimensional space. Comparing to t-SNE, LargeVis significantly reduces the computational cost of the graph construction step and employs a principled probabilistic model for the visualization step, the objective of which can be effectively optimized through asynchronous stochastic gradient descent with a linear time complexity. The whole procedure thus easily scales to millions of high-dimensional data points. Experimental results on real-world data sets demonstrate that the LargeVis outperforms the state-of-the-art methods in both efficiency and effectiveness. The hyper-parameters of LargeVis are also much more stable over different data sets. Homepage: https://arxiv.org/abs/1602.00370 Source Code: https://github.com/lferry007/LargeVis Related Software: largeVis; UMAP; t-SNE; Scikit; UCI-ml; openTSNE; TriMap; MNIST; FIt-SNE; word2vec; DeepWalk; node2vec; PPINN; GOSDT; InfoGAN; CLEVR; IMLI; BEAMES; Entropy-SGD; MLIC Cited in: 5 Publications all top 5 Cited by 17 Authors 1 Chen, Chaofan 1 Chen, Zhi 1 De Bie, Tijl 1 García-García, Darío 1 Gentner, Timothy Q. 1 Huang, Haiyang 1 Kang, Bo 1 Kefato, Zekarias 1 Lijffijt, Jefrey 1 McInnes, Leland 1 Montresor, Alberto 1 Rudin, Cynthia 1 Sainburg, Tim 1 Santos-Rodríguez, Raúl 1 Semenova, Lesia 1 Sheikh, Nasrullah 1 Zhong, Chudi Cited in 5 Serials 1 Computing 1 Machine Learning 1 Neural Computation 1 Cybernetics and Systems Analysis 1 Statistics Surveys Cited in 2 Fields 5 Computer science (68-XX) 1 Statistics (62-XX) Citations by Year