Hugging Face's logo

allstax
/
CodeExplainer-7b-v0.1

Text Generation
Transformers
Safetensors
mistral
text-generation-inference
8-bit precision
bitsandbytes
Model card Files Community
allstax commited on
Commit
4756927
·
1 Parent(s): 61b895b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -24,8 +24,9 @@ Prompt Template for alpaca style
24
  ```
25
 
26
  # Loading the model
27
-
28
  from transformers import AutoModelForCausalLM, AutoTokenizer, GPTQConfig
29
  model_id = "allstax/CodeExplainer-7b-v0.1"
30
  tokenizer = AutoTokenizer.from_pretrained(model_id)
31
- quant_model = AutoModelForCausalLM.from_pretrained(model_id, device_map='auto')
 
 
24
  ```
25
 
26
  # Loading the model
27
+ ```
28
  from transformers import AutoModelForCausalLM, AutoTokenizer, GPTQConfig
29
  model_id = "allstax/CodeExplainer-7b-v0.1"
30
  tokenizer = AutoTokenizer.from_pretrained(model_id)
31
+ quant_model = AutoModelForCausalLM.from_pretrained(model_id, device_map='auto')
32
+ ```