Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
## LLaMA-265M
|
2 |
|
3 |
[💻 Code](https://github.com/JuncaiL/SpecMoE/)
|
@@ -101,4 +108,4 @@ $$ p = 1 + \frac{1-\sqrt{1+4N}}{2N}$$
|
|
101 |
|
102 |
If you have any interest or question about this project, please feel free to contact me.
|
103 |
|
104 |
-
`[email protected]` (before June 30, 2024) or `[email protected]` (After June 30, 2024)
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- wikipedia
|
4 |
+
- allenai/c4
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
---
|
8 |
## LLaMA-265M
|
9 |
|
10 |
[💻 Code](https://github.com/JuncaiL/SpecMoE/)
|
|
|
108 |
|
109 |
If you have any interest or question about this project, please feel free to contact me.
|
110 |
|
111 |
+
`[email protected]` (before June 30, 2024) or `[email protected]` (After June 30, 2024)
|