SciBERT: A Pretrained Language Model for Scientific Text

Iz Beltagy , Kyle Lo , Arman Cohan Iz Beltagy , Kyle Lo , Arman Cohan
2019 Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) 2,777 citations

Abstract

Iz Beltagy, Kyle Lo, Arman Cohan. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.

Keywords

Computer scienceNatural language processingLanguage modelArtificial intelligenceProgramming language

Affiliated Institutions

Related Publications

Publication Info

Year
2019
Type
article
Pages
3613-3618
Citations
2777
Access
Closed

External Links

Download PDF (Free) View on DOI.org arXiv Semantic Scholar

Social Impact

Altmetric
PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

2777
OpenAlex
565
Influential
1638
CrossRef

Cite This

Iz Beltagy, Kyle Lo, Arman Cohan (2019). SciBERT: A Pretrained Language Model for Scientific Text. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 3613-3618. https://doi.org/10.18653/v1/d19-1371

Identifiers

DOI
10.18653/v1/d19-1371
arXiv
1903.10676

Data Quality

Data completeness: 84%