Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ This is a Llama3 8B based model trained using [torchtune](https://pytorch.org/to
|
|
20 |
|
21 |
The exact training script (`lora_finetune_distributed`) and config (`8B_lora.yaml`) are both included in this repository.
|
22 |
|
23 |
-
**Training command**:
|
24 |
|
25 |
> Yes I used 8 GPUs :)
|
26 |
|
|
|
20 |
|
21 |
The exact training script (`lora_finetune_distributed`) and config (`8B_lora.yaml`) are both included in this repository.
|
22 |
|
23 |
+
**Training command**: ``tune run --nproc_per_node 8 lora_finetune_distributed --config 8B_lora.yaml``
|
24 |
|
25 |
> Yes I used 8 GPUs :)
|
26 |
|