license: apache-2.0
language:
- en
tags:
- creative
- creative writing
- fiction writing
- plot generation
- sub-plot generation
- fiction writing
- story generation
- scene continue
- storytelling
- fiction story
- science fiction
- romance
- all genres
- story
- writing
- vivid prosing
- vivid writing
- fiction
- roleplaying
- bfloat16
- brainstorm 40x
- swearing
- rp
- horror
- llama3
- mergekit
pipeline_tag: text-generation
(quants uploading, one example below, more examples to be added)
WARNING: NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.
Fimbulvetr-Grande-V2-19B-GGUF
It is a custom model, max context of 4096 (or 16k+ with rope).
This model has been designed to be relatively bullet proof and operates with most parameters, including temp settings from 0 to 5.
This is a an altered version of "Fimbulvetr-11B-v2" [https://huggingface.co/Sao10K/Fimbulvetr-11B-v2] using the Brainstorm 40x method developed by David_AU to drastically alter the models prose output and abilities. This also expands the model by 40 layers (to 87 layers) to 19.25B parameters (786 tensors).
This model is for any writing, fiction or story telling activity.
This version has unusual levels of detail (scene, location, surroundings, items) and sometimes will foreshadow or have a pre-amble of sentences or paragraphs of "events to come" due to "Brainstorm".
It also has an unusual range of variety of prose in terms of structure, sentences, paragraphs, and even how it starts a "reply" / generation too.
It may work for role play and other activities. (see settings below)
It requires ChatML template and/or "Alpaca" template.
Example outputs below.
Model Notes:
- Detail, prose and fiction writing abilities are significantly increased.
- For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
- Role-players: Careful raising temp too high as it may affect instruction following.
- This model works with rep pen of 1.05 or higher (see notes).
- If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
- This is not a "happy ever after" model. It has a negative bias.
- For creative uses, different quants will produce slightly different output.
- If you use rope to extend context, increase temp AND instructions detail levels to compensate for "rope issues".
- Source code for this model will be uploaded at a separate repo shortly.
Brainstorm 40x
The BRAINSTORM process was developed by David_AU.
Some of the core principals behind this process are discussed in this scientific paper : Progressive LLaMA with Block Expansion .
However I went in a completely different direction from what was outlined in this paper.
What is "Brainstorm" ?
The reasoning center of an LLM is taken apart, reassembled, and expanded.
In this case for this model: 40 times
Then these centers are individually calibrated. These "centers" also interact with each other. This introduces subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.
The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting instruction following.
This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.
Here are some of the enhancements this process brings to the model's performance:
- Prose generation seems more focused on the moment to moment.
- Sometimes there will be "preamble" and/or foreshadowing present.
- Fewer or no "cliches"
- Better overall prose and/or more complex / nuanced prose.
- A greater sense of nuance on all levels.
- Coherence is stronger.
- Description is more detailed, and connected closer to the content.
- Simile and Metaphors are stronger and better connected to the prose, story, and character.
- Sense of "there" / in the moment is enhanced.
- Details are more vivid, and there are more of them.
- Prose generation length can be long to extreme.
- Emotional engagement is stronger.
- The model will take FEWER liberties vs a normal model: It will follow directives more closely but will "guess" less.
- The MORE instructions and/or details you provide the more strongly the model will respond.
- Depending on the model "voice" may be more "human" vs original model's "voice".
Other "lab" observations:
- This process does not, in my opinion, make the model 5x or 10x "smarter" - if only that was true!
- However, a change in "IQ" was not an issue / a priority, and was not tested or calibrated for so to speak.
- From lab testing it seems to ponder, and consider more carefully roughly speaking.
- You could say this process sharpens the model's focus on it's task(s) at a deeper level.
The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.
Settings, Quants and Critical Operations Notes:
This model has been modified ("Brainstorm") to alter prose output, and generally outputs longer text than average.
Change in temp (ie, .4, .8, 1.5, 2, 3 ) will drastically alter output.
Rep pen settings will also alter output too.
This model needs "rep pen" of 1.05 or higher as lower values may cause repeat paragraph issues at end of output however LOWER rep pen values may result is very different (creative / unusual) generation too.
For role play: Rep pen of 1.1 to 1.14 is suggested.
IE: Rep pen 1, 1.01, 1.02, ...
Raise/lower rep pen SLOWLY ie: 1.011, 1.012 ...
Rep pen will alter prose, word choice (lower rep pen=small words / more small word - sometimes) and creativity.
Example one (below) shows same temp, but different rep pen (1.02 VS 1.1)
To really push the model:
Rep pen 1.05 or lower / Temp 3+ ... be ready to stop the output because it may go and go at these strong settings.
You can also set a "hard stop" - maximum tokens generation - too to address lower rep pen settings / high creativity settings.
Longer prompts vastly increase the quality of the model's output.
(see later examples below)
Quant Choice:
Higher quants will have more detail, nuance and in some cases stronger "emotional" levels. Characters will also be more "fleshed out" too. Sense of "there" will also increase.
Q4KM/Q4KS are good, strong quants however if you can run Q5, Q6 or Q8 - go for the highest quant you can.
Special note on Q2k/Q3 quants:
You may need to use temp 2 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions of these quants will function better.
Rep pen adjustments may also be required to get the most out of this model at this/these quant level(s).
Model Template:
This is a custom model, and requires ChatML OR Alpaca OR Vicuna template, but may work with other template(s) and has maximum context of 4k / 4096. However this can be extended using "rope" settings up to 16k.
Here is the standard CHATML template:
ChatML:
{
"name": "ChatML",
"inference_params": {
"input_prefix": "<|im_end|>\n<|im_start|>user\n",
"input_suffix": "<|im_end|>\n<|im_start|>assistant\n",
"antiprompt": [
"<|im_start|>",
"<|im_end|>"
],
"pre_prompt": "<|im_start|>system\nPerform the task to the best of your ability."
}
}
Here is the standard Alpaca template:
Alpaca:
{
"name": "Alpaca",
"inference_params": {
"input_prefix": "### Instruction:",
"input_suffix": "### Response:",
"antiprompt": [
"### Instruction:"
],
"pre_prompt": "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n"
}
}
Here is the standard Vicuna template:
{
"name": "Vicuna v1.5 16K",
"inference_params": {
"input_prefix": "USER:",
"input_suffix": "ASSISTANT:",
"antiprompt": [
"USER:"
],
"pre_prompt": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.\n\n"
}
}
Model "DNA":
Special thanks to the incredible work of the model maker "SAO10K".
Models used:
[ https://huggingface.co/Sao10K/Fimbulvetr-11B-v2 ]
This model has the Brainstorm 40X adapter "mounted" on to it so to speak and contains the full version of this model.
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
EXAMPLES PROMPTS and OUTPUT:
Examples are created using quant Q4_K_M, "temp=.8" (unless otherwise stated), minimal parameters and "LLAMA3" template.
Model has been tested with "temp" from ".1" to "5".
Below are the least creative outputs, prompt is in BOLD.
WARNING: NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.
Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
(Chatml, Temp: 1.5, Rep pen 1.02)
As the sun's fiery glow descended beyond the horizon, casting an amber haze, I stood at the window of my office on the 21st floor, the chill in the air an icy breath on the back of my neck. The skyscraper, a monolith in the sky, loomed large against the twilight. A lone soul, lost among the shadows that had just started creeping through the vast glass building, I clenched the coffee cup in my hand, the warmth offering the slightest sense of comfort in a cold and desolate environment.
My thoughts drifted, the crescendos and the crescendo-like shimmer of the city, far beneath, echoing like a siren's call. I, a gargoyle, frozen in time, the very embodiment of isolation, perched atop this colossal building. But the tranquillity was broken. A crack, more akin to a distant thunderclap, sent the coffee cup rattling as the window in front of me shuddered, the panes shattering, unveiling a tornado of jagged glass that engulfed me like the bouncing bullets of a shattered illusion.
The skyscraper, a stony behemoth in an imperious pose, began to sway, a haughty god bending, as the force beyond my window claimed its trophies. The chaos grew, shrieking down the metal-canyon halls, an invader that tore through the silence of the night like a howl on a windswept moor.
A sickening feeling swelled in my gut, a weight pressing at the pit of my stomach as I grappled with the gravity of the moment. I staggered to maintain my balance as the building's momentum accelerated, the very foundation, the unwavering spine of concrete and steel, bending in an unthinkable dance. A crescendo of groans and snaps from the very architecture reverberated within the enclosed chamber, the cacophonous symphony a dirge of an oncoming fall.
The walls, that had held fast the secrets and toil of the countless that toiled within this mausoleum of commerce, seemed to yawn, opening their maw to devour those who dared defy the earth. I fought back the rising tide of fear. How could such a fortress, a symbol of mankind's ambition and defiance of the Earth's bounds, be brought to its knees?
The answer dawned in the hollow, as the shaking gained an insatiable ferocity. I could picture it now, like the slow burn of a forest in flames. Some unseen, perhaps unknowable, spark, had ignited within the abyssal vaults. A conflagration, that with the fury of a dragon’s breath, had consumed a thousand lives, had raged up the tower. The skyscraper, that monolithic mockery of nature, that soared and defied, was now brought low, the unforgiving inferno, a blistering hand, forcing it to the ground.
The room spun as I staggered to the farthest corner, an insignificant dot on the fringes of the edifice, a lone soul at the frayed edge. I curled into a foetal position, the primal fear, a fierce wolf, tearing at my soul, a desperate attempt to outlast the wrath of the cosmos.
I held my breath as the building, in a crescendo, the rhythm of its own death throes, reached a fever pitch. A sob tore through my chest, a solitary, plaintive note of a hymn, as the once-motionless, immoveable, impregnable wall of steel and concrete, quivered in a final convulsion.
A sound, an eruption of agony, an orchestra of anguish, of a thousand cracks, of the snapping of a thousand bones, was unleashed as the building gave into its fate, as it succumbed to the siren’s call of the ground. It plunged, like an Icarus who had ventured too close to the sun, a lumbering titan in the inexorable grasp of gravity. The sky, once my comforting blue dome, now a smothering ceiling, plummeting to my death, a canopy of agony.
In this final, all-encompassing descent, I closed my eyes, no longer witnessing the final act, as the building, in a shrieking dirge, that symphony of despair, that chorus of the condemned, and in a crescendo of collapse, we became the earth's once again.