Training cost estimates?
#22
by
egorulz
- opened
What's a rough range for training cost with the dolly dataset or something similar?
To produce the 12B param model was on the order of 5-6 hours and $4000 or so, I believe. Don't quote me on that but I think that's in the ballpark. Of course, YMMV if you fine-tune on another dataset. May need fewer or more epochs, etc.
srowen
changed discussion status to
closed