Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ datasets:
|
|
4 |
- c-s-ale/alpaca-gpt4-data
|
5 |
---
|
6 |
|
7 |
-
This repo provides the training checkpoint of LLaMA on the alpaca_data_gpt4 dataset via LoRA [MLP].
|
8 |
|
9 |
He et al. 2022 gave an insight that FFN can better utilize modification at larger capacities.
|
10 |
|
|
|
4 |
- c-s-ale/alpaca-gpt4-data
|
5 |
---
|
6 |
|
7 |
+
This repo provides the training checkpoint of LLaMA on the alpaca_data_gpt4 dataset via LoRA [MLP] on 8xA100(80G).
|
8 |
|
9 |
He et al. 2022 gave an insight that FFN can better utilize modification at larger capacities.
|
10 |
|