seungrok81 commited on
Commit
972b266
·
verified ·
1 Parent(s): 88cb12c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -25,7 +25,7 @@ docker run --rm -it --device=/dev/kfd --device=/dev/dri --group-add video --ipc=
25
  python merge.py
26
  ```
27
 
28
- 4. once the merged llama.safetensors is created, move this file and llama.json to the saved directory of [Meta-Llama-3.1-405B-Instruct] by this command. Model snapshot commit# 069992c75aed59df00ec06c17177e76c63296a26 can be different.
29
  ```sh
30
  cp llama.json ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
31
  cp llama.safetensors ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
@@ -79,7 +79,7 @@ result = model.generate(prompt, sampling_params=sampling_params)
79
  print(result)
80
  ```
81
  ## fp8 gemm_tuning
82
-
83
 
84
  #### License
85
  Copyright (c) 2018-2024 Advanced Micro Devices, Inc. All Rights Reserved.
 
25
  python merge.py
26
  ```
27
 
28
+ 4. once the merged llama.safetensors is created, move this file and llama.json to the saved directory of [Meta-Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct) by this command. Model snapshot commit# 069992c75aed59df00ec06c17177e76c63296a26 can be different.
29
  ```sh
30
  cp llama.json ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
31
  cp llama.safetensors ~/models--meta-llama--Meta-Llama-3.1-405B-Instruct/snapshots/069992c75aed59df00ec06c17177e76c63296a26/.
 
79
  print(result)
80
  ```
81
  ## fp8 gemm_tuning
82
+ Will update soon.
83
 
84
  #### License
85
  Copyright (c) 2018-2024 Advanced Micro Devices, Inc. All Rights Reserved.