---
license: apache-2.0
language:
- vi
metrics:
- perplexity
pipeline_tag: fill-mask
---

 # <a name="introduction"></a> Bkcare-base-pretrained: Pre-trained Language Models for Vietnamese in Health Text Mining
  
bkcare-bert-pretrained is the a strong baseline language models for Vietnamese in Healthcare domain.

### Example usage <a name="usage1"></a>

```python
import torch
from transformers import AutoModel, AutoTokenizer

vihealthbert = AutoModel.from_pretrained("BookingCare/bkcare-bert-pretrained")
tokenizer = AutoTokenizer.from_pretrained("BookingCare/bkcare-bert-pretrained")

line = "Bệnh viện chợ rẫy ở Thành phố Hồ Chí Minh"

input_ids = torch.tensor([tokenizer.encode(line)])
with torch.no_grad():
    features = vihealthbert(input_ids)  # Models outputs are now tuples
```