Commit
•
eaa5f55
1
Parent(s):
ce99c0a
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: llama2
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
Training is currently still underway, but this is the first epoch of a 32k context fine-tuning run of Mistral-7b over the following datasets:
|
| 6 |
+
|
| 7 |
+
- emrgnt-cmplxty/sciphi-textbooks-are-all-you-need
|
| 8 |
+
- open-phi/rag-textbook-instruct-full
|
| 9 |
+
- open-phi/programming_books_llama
|
| 10 |
+
- open-phi/textbooks
|
| 11 |
+
- Open-Orca/SlimOrca
|
| 12 |
+
- WizardLM/WizardLM_evol_instruct_70k
|