BOS Token
#1
by
1AH
- opened
Is this correct?
llm_load_print_meta: BOS token = 151643 '<|endoftext|>'
Weirdly yes π€·ββοΈ in theory it can be anything, the model just sees the token ID, but this is the correct ID which maps to <|endoftext|>
haha
Thanks for the sanity check (and the quant.) Model works great, but that sure looks weird at the start of a prompt.
1AH
changed discussion status to
closed