iamplus
/

bloomz-7b1-v1

Text Generation

text-generation-inference

Model card Files Files and versions Community

manojpreveen commited on Mar 15, 2023

Commit

cf5b212

·

1 Parent(s): c8c8d62

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -8,8 +8,9 @@ First Version of Instruction Tuned Bloomz-7B1 model on ChatGPT dataset (85k data
 **Base Model:** bigscience/bloomz-7b1
 **Training Details :**
-Epochs: 5
 **Dataset Details :**

 **Base Model:** bigscience/bloomz-7b1
 **Training Details :**
+* Epochs: 5
+* Batch Size : 5 instantaneous per device x 2 gradient accumulation steps x 8 gpus = 80
+* Machine : 8xA100 80GB
 **Dataset Details :**