Hugging Face's logo

TeeZee
/
Orca-2-13b_flat

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
TeeZee commited on
Commit
7eb5756
·
verified ·
1 Parent(s): 27318f5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -4,7 +4,7 @@ license_name: microsoft
4
  license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
5
  ---
6
 
7
- Lost of good models use Orca for their merges, however vanilla Orca has vocabulary size of 32003,
8
  3 last tokens are ChatML tokens and a PAD token. This causes errors during a merge with models with standard 32000 vocabulary size.
9
 
10
  I've removed those tokens from volabulary and resized model embeddings to mach 32000 standard size. So this model is ready to be used
 
4
  license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
5
  ---
6
 
7
+ Lots of good models use Orca for their merges, however vanilla Orca has vocabulary size of 32003,
8
  3 last tokens are ChatML tokens and a PAD token. This causes errors during a merge with models with standard 32000 vocabulary size.
9
 
10
  I've removed those tokens from volabulary and resized model embeddings to mach 32000 standard size. So this model is ready to be used