Update README.md
Browse files
README.md
CHANGED
@@ -27,8 +27,8 @@ slices:
|
|
27 |
layer_range: [56,59]
|
28 |
|
29 |
merge_method: passthrough
|
30 |
-
dtype: bfloat16
|
31 |
-
|
32 |
|
33 |
[PruneMe](https://github.com/arcee-ai/PruneMe) has been utilized using the AgentWaller/dutch-oasst1 dataset by investigating layer similarity with 4000 samples. The layer ranges for pruning were determined based on this analysis to maintain performance while reducing model size.
|
34 |
|
|
|
27 |
layer_range: [56,59]
|
28 |
|
29 |
merge_method: passthrough
|
30 |
+
dtype: bfloat16
|
31 |
+
```
|
32 |
|
33 |
[PruneMe](https://github.com/arcee-ai/PruneMe) has been utilized using the AgentWaller/dutch-oasst1 dataset by investigating layer similarity with 4000 samples. The layer ranges for pruning were determined based on this analysis to maintain performance while reducing model size.
|
34 |
|