royleibov
/

Phi-3.5-mini-instruct-ZipNN-Compressed

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

royleibov commited on Sep 19

Commit

d3f9ed0

•

1 Parent(s): 1e47f46

Fix small mistake

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -56,7 +56,7 @@ model = AutoModelForCausalLM.from_pretrained(
     torch_dtype="auto",
     trust_remote_code=True,
 )
-tokenizer = AutoTokenizer.from_pretrained("microsoft/Phi-3.5-mini-instruct")
 ```
 ### ZipNN
 ZipNN also allows you to seemlessly save local disk space in your cache after the model is downloaded.

     torch_dtype="auto",
     trust_remote_code=True,
 )
+tokenizer = AutoTokenizer.from_pretrained("royleibov/Phi-3.5-mini-instruct-ZipNN-Compressed")
 ```
 ### ZipNN
 ZipNN also allows you to seemlessly save local disk space in your cache after the model is downloaded.