library_name: transformers | |
tags: [Danish, BPE Tokenization, LLaMA] | |
### DA-BPE-LLAMA3.2 | |
Built on the LLaMA-3.2 architecture, this model uses a standard Byte-Pair-Encoding (BPE) tokenizer optimized for Danish. It serves as a baseline for evaluating the performance of subword tokenization. |