Update README.md
Browse files
README.md
CHANGED
@@ -55,6 +55,8 @@ More information needed
|
|
55 |
|
56 |
## Training procedure
|
57 |
|
|
|
|
|
58 |
### Training hyperparameters
|
59 |
|
60 |
The following hyperparameters were used during training:
|
@@ -68,11 +70,27 @@ The following hyperparameters were used during training:
|
|
68 |
|
69 |
### Training results
|
70 |
|
71 |
-
|
72 |
|
73 |
### Framework versions
|
74 |
|
75 |
- Transformers 4.33.3
|
76 |
- Pytorch 2.0.1+cu117
|
77 |
- Datasets 2.14.5
|
78 |
-
- Tokenizers 0.13.3
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
## Training procedure
|
57 |
|
58 |
+
Dedicated Byte Level BPE tokenizer vocabulary size 2**16, min frequency 2
|
59 |
+
|
60 |
### Training hyperparameters
|
61 |
|
62 |
The following hyperparameters were used during training:
|
|
|
70 |
|
71 |
### Training results
|
72 |
|
73 |
+
Coming soon
|
74 |
|
75 |
### Framework versions
|
76 |
|
77 |
- Transformers 4.33.3
|
78 |
- Pytorch 2.0.1+cu117
|
79 |
- Datasets 2.14.5
|
80 |
+
- Tokenizers 0.13.3
|
81 |
+
|
82 |
+
### Infrastructure
|
83 |
+
|
84 |
+
- **Hardware Type:** 4 x GPUs 24GB
|
85 |
+
- **Hours used:** 60
|
86 |
+
- **Cloud Provider:** EuroHPC
|
87 |
+
- **Compute Region:** Meluxina
|
88 |
+
|
89 |
+
|
90 |
+
# Model Card Authors [optional]
|
91 |
+
|
92 |
+
Sebastien Campion
|
93 |
+
|
94 |
+
# Model Card Contact
|
95 |
+
|
96 |