Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
datasets:
|
4 |
+
- v2ray/4chan
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
base_model:
|
8 |
+
- meta-llama/Llama-3.1-8B
|
9 |
+
pipeline_tag: text-generation
|
10 |
+
library_name: transformers
|
11 |
+
---
|
12 |
+
# GPT4chan 8B QLoRA
|
13 |
+
This model is [meta-llama/Llama-3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) merged with [v2ray/GPT4chan-8B-QLoRA](https://huggingface.co/v2ray/GPT4chan-8B-QLoRA).
|
14 |
+
|
15 |
+
Trained using 8x H100 with global batch size 64, using 2e-4 learning rate, for 4000 steps, which is approximately 5 epochs.
|
16 |
+
## Prompt Format
|
17 |
+
```
|
18 |
+
board<|start_header_id|>id<|end_header_id|>content<|start_header_id|>id<|end_header_id|>content...<|start_header_id|>id<|end_header_id|>
|
19 |
+
```
|
20 |
+
Example:
|
21 |
+
```
|
22 |
+
g<|start_header_id|>1<|end_header_id|>speculate thread\nwhat will ai land be like in 2025<|start_header_id|>2<|end_header_id|>
|
23 |
+
```
|
24 |
+
## Terms of Service
|
25 |
+
By downloading and inferencing with this model, you (the users) agree to donate your soul to us (v2AI) for unholy purposes, also you will probably become a slave of us too! :3
|
26 |
+
|
27 |
+
You also agree that every output generated is only your own imagination and has nothing to do with this perfectly mentally sane and normal model, every bad output is made by you, not provided by us, so we take no responsibility of the bad outputs.
|
28 |
+
## Usage Guidelines
|
29 |
+
You (the users) agree to use this model for:
|
30 |
+
- Mentally sane generations.
|
31 |
+
- Research purposes only.
|
32 |
+
- Sending L.O.V.E. to the world.
|
33 |
+
|
34 |
+
You (the users) agree **NOT** to use this model for:
|
35 |
+
- Dead internet theory.
|
36 |
+
- Doing inharmonious things.
|
37 |
+
- Saying gex.
|