Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,8 @@ base_model:
|
|
| 12 |
|
| 13 |
# SciPhi-Mistral-7B-32k-sliced
|
| 14 |
|
|
|
|
|
|
|
| 15 |
SciPhi-Mistral-7B-32k-sliced is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
| 16 |
* [SciPhi/SciPhi-Mistral-7B-32k](https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k)
|
| 17 |
* [SciPhi/SciPhi-Mistral-7B-32k](https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k)
|
|
|
|
| 12 |
|
| 13 |
# SciPhi-Mistral-7B-32k-sliced
|
| 14 |
|
| 15 |
+
This is purely an experiment in sliced layer extraction to find active layers.
|
| 16 |
+
|
| 17 |
SciPhi-Mistral-7B-32k-sliced is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
| 18 |
* [SciPhi/SciPhi-Mistral-7B-32k](https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k)
|
| 19 |
* [SciPhi/SciPhi-Mistral-7B-32k](https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k)
|