Arabic Bidirectional Encoder Representations from Transformers
Journal: Workshop on Open-Source Arabic Corpora and Processing Tools
Programming languages: Python
In this paper, we develop an Arabic language representation model to improve the state-of-the-art in several Arabic NLU tasks. We create ARABERT based on the BERT model, a stacked Bidirectional Transformer Encoder.