Safetensors
English
ramy21 commited on
Commit
cb9ad67
·
1 Parent(s): 4b1ecc9

Delete README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -40
README.md DELETED
@@ -1,40 +0,0 @@
1
- ---
2
- tags:
3
- - autotrain
4
- - text-generation
5
- widget:
6
- - text: "I love AutoTrain because "
7
- license: other
8
- ---
9
-
10
- # Model Trained Using AutoTrain
11
-
12
- This model was trained using AutoTrain. For more information, please visit [AutoTrain](https://hf.co/docs/autotrain).
13
-
14
- # Usage
15
-
16
- ```python
17
-
18
- from transformers import AutoModelForCausalLM, AutoTokenizer
19
-
20
- model_path = "PATH_TO_THIS_REPO"
21
-
22
- tokenizer = AutoTokenizer.from_pretrained(model_path)
23
- model = AutoModelForCausalLM.from_pretrained(
24
- model_path,
25
- device_map="auto",
26
- torch_dtype='auto'
27
- ).eval()
28
-
29
- # Prompt content: "hi"
30
- messages = [
31
- {"role": "user", "content": "hi"}
32
- ]
33
-
34
- input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
35
- output_ids = model.generate(input_ids.to('cuda'))
36
- response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
37
-
38
- # Model response: "Hello! How can I assist you today?"
39
- print(response)
40
- ```