---
license: apache-2.0
language:
- ar
pipeline_tag: fill-mask
tags:
- 'Arabic ROBERTA '
- Kuwaiti Dialect
- Masked Language Model
- safetensors
- transformers
widget:
- text: منو جاينا <mask>.
---

**Q8BERTA** is the first language model specifically trained on Kuwaiti dialect text. This model was pre-trained on datasets collected from various sources such as several social medias platforms, websites, and books.

**BibTex** If you utilize the Q8BERT model in your scientific publication, or if you find the resources in this repository beneficial, please cite our paper using the following details (citation information to be updated):