Update README.md
Browse files
README.md
CHANGED
@@ -31,14 +31,13 @@ The following YAML configuration was used to produce this model:
|
|
31 |
|
32 |
|
33 |
```yaml
|
34 |
-
|
35 |
slices:
|
36 |
- sources:
|
37 |
- model: tiiuae/falcon-11B
|
38 |
-
layer_range: [0,
|
39 |
- sources:
|
40 |
- model: tiiuae/falcon-11B
|
41 |
-
layer_range: [
|
42 |
merge_method: passthrough
|
43 |
dtype: bfloat16
|
44 |
```
|
|
|
31 |
|
32 |
|
33 |
```yaml
|
|
|
34 |
slices:
|
35 |
- sources:
|
36 |
- model: tiiuae/falcon-11B
|
37 |
+
layer_range: [0, 24]
|
38 |
- sources:
|
39 |
- model: tiiuae/falcon-11B
|
40 |
+
layer_range: [55, 59]
|
41 |
merge_method: passthrough
|
42 |
dtype: bfloat16
|
43 |
```
|