asigalov61 commited on
Commit
4c47348
·
verified ·
1 Parent(s): 2228b52

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +63 -3
README.md CHANGED
@@ -1,3 +1,63 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - projectlosangeles/Monster-MIDI-Dataset
5
+ language:
6
+ - en
7
+ base_model:
8
+ - skytnt/midi-model
9
+ tags:
10
+ - music
11
+ - llama
12
+ - music llama
13
+ - midi
14
+ - music ai
15
+ ---
16
+
17
+ # Music Llama
18
+
19
+ ## Llama for MIDI music generation
20
+
21
+ ![Music-Llama.webp](https://cdn-uploads.huggingface.co/production/uploads/5f57ea2d3f32f12a3c0692e6/x5xKq1QKsBWuzOlJLWVTc.webp)
22
+
23
+ ***
24
+
25
+ ## Model Details
26
+
27
+ ### Model Description
28
+
29
+ - **Developed by:** SkyTNT
30
+ - **Trained by:** asigalov61
31
+ - **Model type:** Llama Transformer
32
+ - **License:** apache-2.0
33
+
34
+ ### Model Sources
35
+
36
+ - **Code Repository:** https://github.com/SkyTNT/midi-model
37
+ - **Demo:** https://huggingface.co/spaces/skytnt/midi-composer
38
+
39
+
40
+ ## Training Details
41
+
42
+ ### Training Data
43
+
44
+ - [projectlosangeles/Monster-MIDI-Dataset](https://huggingface.co/datasets/projectlosangeles/Monster-MIDI-Dataset)
45
+
46
+ #### Training Hyperparameters
47
+
48
+ - config: tv2o-large
49
+ - max-len: 4096
50
+ - layers: 24
51
+ - acc-grad: 8
52
+ - lr: 1e-4
53
+ - weight-decay: 0.01
54
+ - batch: 8x2x8
55
+ - fp16 mixed precision
56
+
57
+ #### Loss
58
+ - train loss: 0.32
59
+
60
+ ***
61
+
62
+ ### Project Los Angeles
63
+ ### Tegridy Code 2024