1. Pre-training BERT on Arabic tweets: Practical considerations;Abdelali,2021
2. Abdul-Mageed, M., Elmadany, A., Nagoudi, E.M.B., 2021. ARBERT & MARBERT: Deep bidirectional transformers for Arabic. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Online, pp. 7088–7105. http://dx.doi.org/10.18653/v1/2021.acl-long.551.
3. BERT models for Arabic text classification: a systematic review;Alammary;Appl. Sci.,2022
4. Antoun, W., Baly, F., Hajj, H., 2020. Arabert: Transformer-based model for Arabic language understanding. In: Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection. pp. 9–15,.
5. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., et al., 2020. Unsupervised Cross-lingual Representation Learning at Scale. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. ACL,.