DA-BPE-LLAMA3.2 / README.md
MikkelWK's picture
Update README.md
46ecb34 verified
metadata
library_name: transformers
tags:
  - Danish
  - BPE Tokenization
  - LLaMA

DA-BPE-LLAMA3.2

Built on the LLaMA-3.2 architecture, this model uses a standard Byte-Pair-Encoding (BPE) tokenizer optimized for Danish. It serves as a baseline for evaluating the performance of subword tokenization.