Lingo-IITGN
commited on
Commit
•
a45c8cb
1
Parent(s):
b4774e5
Update README.md
Browse files
README.md
CHANGED
@@ -82,6 +82,12 @@ print(result)
|
|
82 |
|
83 |
## Technical Specifications 🤖
|
84 |
|
|
|
|
|
|
|
|
|
|
|
|
|
85 |
### Model Architecture and Objective
|
86 |
|
87 |
|
|
|
82 |
|
83 |
## Technical Specifications 🤖
|
84 |
|
85 |
+
- **Precision**: *Float32*
|
86 |
+
- **Context Length**: *2,048*
|
87 |
+
- **Learning Rate**: *4e-4*
|
88 |
+
- **Optimizer**: *AdamW*
|
89 |
+
- **LR Scheduler**: *Cosine*
|
90 |
+
|
91 |
### Model Architecture and Objective
|
92 |
|
93 |
|