| tags: | |
| - deepsparse | |
| # Sparse MPT-7B-GSM8k - DeepSparse | |
| Sparse finetuned MPT 7b model on GSM8k, pruned to 50% and quantized for inference with DeepSparse | |
| ```python | |
| from deepsparse import TextGeneration | |
| model = TextGeneration(model="hf:neuralmagic/mpt-7b-gsm8k-pruned50-quant") | |
| model("There are twice as many boys as girls at Dr. Wertz's school. If there are 60 girls and 5 students to every teacher, how many teachers are there?", max_new_tokens=50) | |
| ``` |