×

BERT

swMATH ID: 30756
Software Authors: Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
Description: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers. As a result, the pre-trained BERT model can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks, such as question answering and language inference, without substantial task-specific architecture modifications. BERT is conceptually simple and empirically powerful. It obtains new state-of-the-art results on eleven natural language processing tasks, including pushing the GLUE score to 80.5
Homepage: https://arxiv.org/abs/1810.04805
Related Software: Tensor2Tensor; Adam; GloVe; RoBERTa; word2vec; PyTorch; Python; Transformers; XLNet; ImageNet; TensorFlow; GitHub; SQuAD; AlexNet; ALBERT; BLEU; GLUE; GPT-3; DistilBERT; MNIST
Referenced in: 77 Publications
all top 5

Referenced by 259 Authors

2 Baskerville, Nicholas P.
2 Grabovoy, A. V.
2 Keating, Jonathan Peter
2 Lim, Suryani
2 Mezzadri, Francesco
2 Mues, Christophe
2 Najnudel, Joseph
2 Prade, Henri M.
2 Richard, Gilles
2 Song, Linfeng
2 Strijov, Vadim V.
2 Su, Jinsong
2 Sun, Le
2 Tang, Jialong
2 Xiong, Deyi
2 Ying, Lexing
1 Adedoyin-Olowe, Mariam
1 Afantenos, Stergos
1 Aghahadi, Zeinab
1 Antonyrajah, Denvar
1 Avetisyan, Karen L.
1 Bahri, Yasaman
1 Bakhtin, Anton
1 Baldwin, Timothy
1 Barceló, Pablo
1 Beise, Hans-Peter
1 Beygelzimer, Alina
1 Bhogal, Jagdev
1 Blumberg, Stefano B.
1 Bošnjak, Matko
1 Bravo, Cristián
1 Büsing, Lars
1 Camacho-Collados, José
1 Chan, Raymond Hon-Fu
1 Chen, Jiaoyan
1 Chen, Lihan
1 Chen, Yunwen
1 Cohen, Trevor
1 Costa, Gianni
1 Cruz, Meenalosini Vimal
1 d’Alché-Buc, Florence
1 Darchuk, N.
1 De Matos, David Martins
1 Dede’, Luca
1 Deng, Yuntian
1 Dercole, Fabio
1 Derczynski, Leon
1 Ding, Xiaofeng
1 Doran, Derek
1 Draelos, Rachel Lea
1 Durlofsky, Louis J.
1 E, Weinan
1 Ellis, Kevin
1 Esuli, Andrea
1 Fan, Jian-sheng
1 Fan, Yangyang
1 Fan, Yuwei
1 Fang, Tianqing
1 Farbmacher, Helmut
1 Feinauer, Christoph
1 Feliu-Fabà, Jordi
1 Firoozye, Nick
1 Fitzpatrick, Trevor
1 Flennerhag, Sebastian
1 Frady, E. Paxon
1 Fraser, Kathleen C.
1 Fresca, Stefania
1 Fu, Guohong
1 Gaber, Mohamed Medhat
1 Gao, Yi
1 Ge, Yubin
1 Ghukasyan, Tsolak
1 Gillingham, Matt
1 Glavaš, Goran
1 Gross, Sam
1 Gurevych, Iryna
1 Han, Xianpei
1 Hettiarachchi, Hansi
1 Hoherchak, H.
1 Holter, Ole Magnus
1 Hommel, Björn E.
1 Horrocks, Ian
1 Hu, Changwei
1 Hu, Hui
1 Hu, Pan
1 Hu, Yifan
1 Jia, Chenyan
1 Jiang, Chao
1 Jiang, Hui
1 Jiménez-Ruiz, Ernesto
1 Jin, Ke
1 Jones, Ilenna Simone
1 Jorge, Alípio Mário
1 Joseph, Elizabeth
1 Ju, Yuqi
1 Jurewicz, Mateusz
1 Kadioglu, Serdar
1 Kaprielova, M. S.
1 Kasturi, Tejaswi
1 Ke, Haowen
...and 159 more Authors

Referencing Publications by Year