|
--- |
|
datasets: |
|
- breadlicker45/toast-midi-dataset |
|
tags: |
|
- music |
|
- midi |
|
- music generation |
|
- midi generation |
|
--- |
|
## Training Details |
|
|
|
### Training Data |
|
|
|
- [breadlicker45/toast-midi-dataset](https://huggingface.co/datasets/breadlicker45/toast-midi-dataset) |
|
|
|
#### Training Hyperparameters |
|
|
|
- model: phi3 |
|
- config: tv2o-medium |
|
- max-len: 2048 |
|
- lr: 1e-4 then 2e-5 |
|
- weight-decay: 0.01 |
|
- batch-size-per-gpu: 8 |
|
- GPUs: 2 A100 80gb |
|
- bfloat16 precision |
|
|
|
#### Loss |
|
- val loss: 0.2740 |
|
|
|
## Files |
|
|
|
- model.ckpt: latest model checkpoint |
