Update README.md
Browse files
README.md
CHANGED
@@ -25,7 +25,7 @@ docker run --rm -it --device=/dev/kfd --device=/dev/dri --group-add video --ipc=
|
|
25 |
python merge.py
|
26 |
```
|
27 |
|
28 |
-
4. once the merged llama.safetensors is created, move this file and llama.json to the saved directory of [Meta-Llama-3.1-405B-Instruct] by this command. Model snapshot commit# 069992c75aed59df00ec06c17177e76c63296a26 can be different.
|
29 |
```sh
|
30 |
cp llama.json ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
|
31 |
cp llama.safetensors ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
|
@@ -79,7 +79,7 @@ result = model.generate(prompt, sampling_params=sampling_params)
|
|
79 |
print(result)
|
80 |
```
|
81 |
## fp8 gemm_tuning
|
82 |
-
|
83 |
|
84 |
#### License
|
85 |
Copyright (c) 2018-2024 Advanced Micro Devices, Inc. All Rights Reserved.
|
|
|
25 |
python merge.py
|
26 |
```
|
27 |
|
28 |
+
4. once the merged llama.safetensors is created, move this file and llama.json to the saved directory of [Meta-Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct) by this command. Model snapshot commit# 069992c75aed59df00ec06c17177e76c63296a26 can be different.
|
29 |
```sh
|
30 |
cp llama.json ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
|
31 |
cp llama.safetensors ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
|
|
|
79 |
print(result)
|
80 |
```
|
81 |
## fp8 gemm_tuning
|
82 |
+
Will update soon.
|
83 |
|
84 |
#### License
|
85 |
Copyright (c) 2018-2024 Advanced Micro Devices, Inc. All Rights Reserved.
|