Update README.md
Browse files
README.md
CHANGED
@@ -35,7 +35,7 @@ We release two adapted model versions:
|
|
35 |
These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
36 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
37 |
|------|--------|---------|-------------|-----------------|----------------|
|
38 |
-
| [OLMo 1.7 7B](https://huggingface.co/allenai/OLMo-1.7-7B-hf) |
|
39 |
|
40 |
|
41 |
### Model Description
|
@@ -59,9 +59,7 @@ These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
|
59 |
- Evaluation code: https://github.com/allenai/OLMo-Eval
|
60 |
- Further fine-tuning code: https://github.com/allenai/open-instruct
|
61 |
- **Paper:** [Link](https://arxiv.org/abs/2402.00838)
|
62 |
-
|
63 |
-
- **W&B Logs:** ?
|
64 |
-
<!-- - **Press release:** TODO -->
|
65 |
|
66 |
### Inference
|
67 |
|
|
|
35 |
These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
36 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
37 |
|------|--------|---------|-------------|-----------------|----------------|
|
38 |
+
| [OLMo 1.7 7B](https://huggingface.co/allenai/OLMo-1.7-7B-hf) | 2.7T |32 | 4096 | 32 | 4096 |
|
39 |
|
40 |
|
41 |
### Model Description
|
|
|
59 |
- Evaluation code: https://github.com/allenai/OLMo-Eval
|
60 |
- Further fine-tuning code: https://github.com/allenai/open-instruct
|
61 |
- **Paper:** [Link](https://arxiv.org/abs/2402.00838)
|
62 |
+
|
|
|
|
|
63 |
|
64 |
### Inference
|
65 |
|