Commit
·
652d5f6
1
Parent(s):
8e34ec7
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- not-for-all-audiences
|
4 |
+
---
|
5 |
+
|
6 |
+
Eileithyia-7B is an unaligned, roleplay oriented model created by merging [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) with [a bespoke LORA](https://huggingface.co/athirdpath/Eileithyia-7B-LORA) trained directly on OpenHermes.
|
7 |
+
|
8 |
+
Eileithyia, as is the current trend, is named after a Greek goddess; in this case it is the goddess of childbirth and pregnancy.
|
9 |
+
|
10 |
+
The private ~400k token dataset used to train the LORA was Alpaca formatted and focused on 4 primary categories:
|
11 |
+
|
12 |
+
- Medical texts (on pregnancy, reproductive organs, and impregnation). These are formatted so the model, in character as a doctor, answers a patient's question in short to medium form.
|
13 |
+
- Excerpts from short stories and novellas (erotic, romantic, and platonic) centered around both realistic and fantastic pregnancy. These are sliced into ~2048 token chunks, and these long-form responses are all tied to the command “Enter narrator mode.” in the instructions.
|
14 |
+
- A selection from [PIPPA](https://huggingface.co/datasets/PygmalionAI/PIPPA), using a wide keyword search for related terms then human curated (...the things I’ve seen…). These are converted to Alpaca with “Enter RP mode.” in all the instruction fields.
|
15 |
+
- ~60k tokens of GPT-4 generated data on pregnancy from various characters’ perspectives, focusing on different responses and stages. Also includes a synopsis for each week in various styles.
|
16 |
+
|
17 |
+
Testing is still in progress.
|