aloobun commited on
Commit
4f8c71a
·
verified ·
1 Parent(s): 8ffaca1

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ ## Example:
6
+ ```
7
+ from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
8
+
9
+ tokenizer = AutoTokenizer.from_pretrained("Qwen-1_8B-m4-LDJnr-combined", trust_remote_code=True)
10
+ model = AutoModelForCausalLM.from_pretrained("Qwen-1_8B-m4-LDJnr-combined", device_map="auto", trust_remote_code=True).eval()
11
+ response, _ = model.chat(tokenizer, "What kind of a noise annoys a noisy oyster?", history=None)
12
+ print(response)
13
+ ```