Add intermediate checkpoints?
#4
by
ethanc8
- opened
In order to improve transparency, LLM360's K2 model release also included 360 intermediate checkpoints from during pretraining. Would it be possible for you to upload intermediate checkpoints in a similar manner?
Hey @ethanc8 , the process of uploading checkpoints is ongoing. We will release intermediate stage-2 checkpoints shortly.