GPT-3 swMATH ID: 42135 Software Authors: Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Description: Generative Pre-trained Transformer 3 (GPT-3) (stylized GPT·3) is an autoregressive language model that uses deep learning to produce human-like text. Homepage: https://en.wikipedia.org/wiki/GPT-3 Source Code: https://github.com/openai/gpt-3 Keywords: arXiv_s.CL; Generative Pre-trained Transformer; GPT-3; autoregressive language model; deep learning; human-like text; NLP Related Software: BERT; Tensor2Tensor; ImageNet; AlexNet; Adam; RoBERTa; PyTorch; XLNet; GloVe; Transformers; SuperGLUE; BART; BLEU; Transformer-XL; word2vec; Seq2SQL; DeBERTa; Python; TensorFlow; Penn Treebank Cited in: 16 Documents Standard Articles 1 Publication describing the Software Year Language Models are Few-Shot Learners Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 all top 5 Cited by 65 Authors 1 Bakhtin, Anton 1 Belkin, Mikhail 1 Bihlo, Alex 1 Bradley, Tai-Danae 1 Camacho-Collados, José 1 Celledoni, Elena 1 Cruz, Meenalosini Vimal 1 Deng, Yuntian 1 Derczynski, Leon 1 Dobriban, Edgar 1 Doran, Derek 1 Ehrhardt, Matthias Joachim 1 Etmann, Christian 1 Fang, Tianqing 1 Grabovoy, Andrey Valerievich 1 Gross, Sam 1 Jia, Chenyan 1 Jorge, Alípio Mário 1 Jurewicz, Mateusz 1 Ke, Haowen 1 Li, Chong 1 Limet, Sébastien 1 Lin, Licong 1 Liu, Chaoyue 1 Liu, Ruibo 1 Liu, Xin 1 Loureiro, Daniel 1 Namburu, Anupama 1 Ott, Myle 1 Ou, Jiefu 1 Owren, Brynjulf 1 P., Mangalraj 1 Pan, Haojie 1 Popovych, Roman O. 1 Precup, Doina 1 R., Nandha Kumar 1 Ranzato, Marc’Aurelio 1 Ras, Gabrielle 1 Robert, Sophie 1 S., Sudhakar Ilango 1 Schönlieb, Carola-Bibiane 1 Sethuraman, Sibi Chakkaravarthy 1 Sherry, Ferdia 1 Silver, David M. 1 Singh, Satinder Pal 1 Song, Yangqiu 1 Strijov, Vadim V. 1 Sutton, Richard S. 1 Szlam, Arthur D. 1 Tachon, Thibaut 1 Terilla, John 1 Tripathy, Jatin Karthik 1 van Gerven, Marcel A. J. 1 Vijayakumar, Vaidehi 1 Vlassopoulos, Yiannis 1 Vosoughi, Soroush 1 Wang, Haoran 1 Wang, Hongxing 1 Wei, Jason Z. 1 Xie, Ning 1 Xu, Guangxuan 1 Yang, Sheng 1 Ye, Jong Chul 1 Zhang, Hongming 1 Zhu, Libin all top 5 Cited in 10 Serials 4 Artificial Intelligence 2 The Journal of Artificial Intelligence Research (JAIR) 2 Journal of Machine Learning Research (JMLR) 1 Inverse Problems 1 Journal of Computational Physics 1 Automation and Remote Control 1 Applied and Computational Harmonic Analysis 1 Mathematics in Industry 1 Computer Science Review 1 La Matematica all top 5 Cited in 8 Fields 15 Computer science (68-XX) 2 Numerical analysis (65-XX) 2 Biology and other natural sciences (92-XX) 2 Information and communication theory, circuits (94-XX) 1 Category theory; homological algebra (18-XX) 1 Calculus of variations and optimal control; optimization (49-XX) 1 Statistics (62-XX) 1 Fluid mechanics (76-XX) Citations by Year