Hugging Face's logo

nm-testing
/
mistral-7b-dpo-merge-v1.1-pruned50-quant-ds

Text Generation
Transformers
ONNX
mistral
deepsparse
Model card Files Community
mwitiderrick commited on
Commit
4d33f79
·
verified ·
1 Parent(s): acbff27

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -27,7 +27,7 @@ from deepsparse import TextGeneration
27
  prompt = "How to make banana bread?"
28
  formatted_prompt = f"<|user|>\n{prompt}\n<|assistant|>\n"
29
 
30
- model = TextGeneration(model_path="hf:nm-testing/SOLAR-10.7B-Instruct-v1.0-pruned50-quant")
31
 
32
  print(model(formatted_prompt, max_new_tokens=200).generations[0].text)
33
  """
 
27
  prompt = "How to make banana bread?"
28
  formatted_prompt = f"<|user|>\n{prompt}\n<|assistant|>\n"
29
 
30
+ model = TextGeneration(model_path="hf:nm-testing/mistral-7b-dpo-merge-v1.1-pruned50-quant-dst")
31
 
32
  print(model(formatted_prompt, max_new_tokens=200).generations[0].text)
33
  """