Text Generation
GGUF
English
mixture of experts
Mixture of Experts
4x8B
Llama3 MOE
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
mergekit
Inference Endpoints
conversational
Update README.md
Browse files
README.md
CHANGED
@@ -35,7 +35,7 @@ tags:
|
|
35 |
pipeline_tag: text-generation
|
36 |
---
|
37 |
|
38 |
-
(quants uploading, examples below
|
39 |
|
40 |
<B><font color="red">WARNING:</font> NSFW. Vivid prose. INTENSE. Visceral Details. Violence. HORROR. GORE. Swearing. UNCENSORED. </B>
|
41 |
|
@@ -48,11 +48,11 @@ models of 8B each into one massive powerhouse at 25B parameters (equal to 32B -
|
|
48 |
|
49 |
This model's instruction following, and output generation for creative writing, prose, fiction and role play are off the scale.
|
50 |
|
51 |
-
(examples below, including 2, 3 and 4 experts)
|
52 |
|
53 |
And it is fast: 34 t/s (2 experts) on a low end 16GB card, Q3KS.
|
54 |
|
55 |
-
Double this speed for mid-range
|
56 |
|
57 |
Model can be used also for all genres.
|
58 |
|
|
|
35 |
pipeline_tag: text-generation
|
36 |
---
|
37 |
|
38 |
+
(quants uploading, LOTS of examples below)
|
39 |
|
40 |
<B><font color="red">WARNING:</font> NSFW. Vivid prose. INTENSE. Visceral Details. Violence. HORROR. GORE. Swearing. UNCENSORED. </B>
|
41 |
|
|
|
48 |
|
49 |
This model's instruction following, and output generation for creative writing, prose, fiction and role play are off the scale.
|
50 |
|
51 |
+
(lots of different examples below, including 2, 3 and 4 experts)
|
52 |
|
53 |
And it is fast: 34 t/s (2 experts) on a low end 16GB card, Q3KS.
|
54 |
|
55 |
+
Double this speed for standard/mid-range video cards.
|
56 |
|
57 |
Model can be used also for all genres.
|
58 |
|