File size: 297 Bytes
b2a1a8b 46ecb34 b2a1a8b 46ecb34 b2a1a8b 46ecb34 |
1 2 3 4 5 6 7 8 |
---
library_name: transformers
tags: [Danish, BPE Tokenization, LLaMA]
---
### DA-BPE-LLAMA3.2
Built on the LLaMA-3.2 architecture, this model uses a standard Byte-Pair-Encoding (BPE) tokenizer optimized for Danish. It serves as a baseline for evaluating the performance of subword tokenization. |