metadata
library_name: transformers
tags:
- Danish
- BPE Tokenization
- LLaMA
Built on the LLaMA-3.2 architecture, this model uses a standard Byte-Pair-Encoding (BPE) tokenizer optimized for Danish. It serves as a baseline for evaluating the performance of subword tokenization.