Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ tags:
|
|
| 8 |
- sparse
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# Llama-2-7b-
|
| 12 |
|
| 13 |
This repo contains model files for a [Llama 2 7B](https://huggingface.co/meta-llama/Llama-2-7b-hf) model that has had 70% of the parameters pruned in one-shot with [SparseGPT](https://arxiv.org/abs/2301.00774), then retrained by [Cerebras](https://huggingface.co/cerebras) with XXB [UPDATE] tokens from SlimPajama while maintaining sparsity.
|
| 14 |
|
|
|
|
| 8 |
- sparse
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Llama-2-7b-pruned70-retrained
|
| 12 |
|
| 13 |
This repo contains model files for a [Llama 2 7B](https://huggingface.co/meta-llama/Llama-2-7b-hf) model that has had 70% of the parameters pruned in one-shot with [SparseGPT](https://arxiv.org/abs/2301.00774), then retrained by [Cerebras](https://huggingface.co/cerebras) with XXB [UPDATE] tokens from SlimPajama while maintaining sparsity.
|
| 14 |
|