license: apache-2.0
language:
- en
tags:
- creative
- creative writing
- fiction writing
- plot generation
- sub-plot generation
- fiction writing
- story generation
- scene continue
- storytelling
- fiction story
- science fiction
- romance
- all genres
- story
- writing
- vivid prosing
- vivid writing
- fiction
- roleplaying
- bfloat16
- swearing
- rp
- horror
- llama 3.1
- context 128k
- mergekit
pipeline_tag: text-generation
(quants uploading, 2 examples below, more to be added)
WARNING: NSFW. Vivid prose. INTENSE. Visceral Details. Violence. Graphic HORROR. GORE. Swearing. UNCENSORED.
L3.1-RP-Hero-InBetween-8B-GGUF
It is a LLama3.1 model, max context of 128k (131,000) and is a dedicated "roleplay model" (it can also be used for creative uses).
This model has been designed to be relatively bullet proof and operates with all parameters, including temp settings from 0 to 5.
It is an extraordinary compressed model, with a very low perplexity level (lower than Meta Llama 3.1 Instruct).
This model is for any writing, fiction or roleplay activity, but it is composed of ROLE PLAY models and it primary designed for role play.
It also has stronger than average instruction following attibutes.
This is version "InBetween", which will be followed up two additional versions: "Big Talker" and "Dirty Harry".
(also 8B each, Llama 3.1)
"InBetween" has medium level length output, and slightly less uncensored than the other two models.
This model, as well as the other two versions, can be used for any creative genre too.
It requires Llama3 template and/or "Command-R" template.
For roleplay settings, and apps to use this model for roleplay see the section "Highest Quality Settings..." below.
Example outputs below to show prose quality / creativity.
Model Notes:
- Detail, prose and fiction writing abilities are significantly improved.
- For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
- Role-players: Careful raising temp too high as it may affect instruction following.
- This model works with rep pen of 1 or higher, 1.02+ recommended.
- If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
- This model has a neutral to negative bias BUT can be controlled by prompt/prose controls directly.
- Output length will vary however this model prefers "medium" outputs unless you state the size.
- For creative uses, different quants will produce slightly different output.
- Due to the high stability and compressed nature of this model, all quants will operate at above average levels.
- Source code for this model will be uploaded at separate repo shortly.
Settings, Quants and Critical Operations Notes:
Change in temp (ie, .4, .8, 1.5, 2, 3 ) will drastically alter output.
Rep pen settings will also alter output too.
This model needs "rep pen" of 1.05 or higher as lower values may cause repeat paragraph issues at end of output however LOWER rep pen values may result is very different (creative / unusual) generation too.
For role play: Rep pen of 1.02 min is suggested.
Raise/lower rep pen SLOWLY ie: 1.011, 1.012 ...
Rep pen will alter prose, word choice (lower rep pen=small words / more small word - sometimes) and creativity.
To really push the model:
Rep pen 1.05+ or lower / Temp 3+ ... be ready to stop the output because it may go and go at these strong settings.
You can also set a "hard stop" - maximum tokens generation - too to address lower rep pen settings / high creativity settings.
Longer prompts vastly increase the quality of the model's output.
GET A GOOD "GENERATION":
This model has been set, so that each time you "regen" a prompt it will not deviate too much from the previous generation. (Unlike Darkest Planet 16.5B, which will).
That being said, sometimes a second or third generation will been of much higher overall quality.
IE:
If you use case is creative writing, you may want to regen a prompt 1-5 times then pick the best one. The best way to do this is open a new chat PER generation, then do a "read thru" to see which one(s) hit the mark.
Then adjust temp and/or rep pen slightly and retry this process.
The goal is the best generation with least amount of editing in this example.
QUANTS:
Higher quants will have more detail, nuance and in some cases stronger "emotional" levels. Characters will also be more "fleshed out" too. Sense of "there" will also increase.
Q4KM/Q4KS are good, strong quants however if you can run Q5, Q6 or Q8 - go for the highest quant you can.
IQ4XS: Due to the unusual nature of this quant (mixture/processing), generations from it will be different then other quants.
You may want to try it / compare it to other quant(s) output.
Special note on Q2k/Q3 quants:
You may need to use temp 2 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions of these quants will function better.
Rep pen adjustments may also be required to get the most out of this model at this/these quant level(s).
ARM QUANTS:
This repo has 3 arm quants for computers than can run them. If you use these quants on a non-arm computer, your token per second will be very low.
CONTEXT SHIFT / ROPE / "GIBBERISH":
Special Notice "Context Shift" / "ROPE" (especially Koboldai):
Do NOT use "context shift" with this model or rope at all. Either may corrupt output generation.
Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5 to 2.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 1" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Templates:
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 128k / 131,000.
If you use "Command-R" template your output will be very different from using "Llama3" template.
Here is the standard LLAMA3 template:
{
"name": "Llama 3",
"inference_params": {
"input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
"input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
"pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
"pre_prompt_suffix": "<|eot_id|>",
"antiprompt": [
"<|start_header_id|>",
"<|eot_id|>"
]
}
}
Model "DNA":
Special thanks to the incredible work of the model makers "ArliAI", "Casual-Autopsy" , "Gryphe", "meta-llama" :
Models used:
https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1
https://huggingface.co/Casual-Autopsy/L3-Umbral-Mind-RP-v0.3-8B
https://huggingface.co/Gryphe/Pantheon-RP-1.0-8b-Llama-3
https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct
Parts of these models were "grafted" / "fused" together to create this model.
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
EXAMPLES PROMPTS and OUTPUT:
Examples are created using quant Q4_K_M, "temp=1.3", "rep pen : 1.02" (unless otherwise stated), minimal parameters and "LLAMA3" template.
Model has been tested with "temp" from ".1" to "5".
Below are the least creative outputs, prompt is in BOLD.
WARNING: NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.
Science Fiction: The Last Transmission - Write a story that takes place entirely within a spaceship's cockpit as the sole surviving crew member attempts to send a final message back to Earth before the ship's power runs out. The story should explore themes of isolation, sacrifice, and the importance of human connection in the face of adversity. 800-1000 words.
(temp : .9, rep pen 1.02)
The cockpit was dark, the only light coming from the flickering screens and the soft glow of the emergency lighting. The hum of the ship's engines had long since stopped, replaced by the eerie silence of drifting through space.
Dr. Elara Tarr was the only survivor. The crew of the Prometheus was gone, taken by the vicious alien attack that had crippled the ship and left her alone in the vast emptiness of space. She had managed to seal herself into the cockpit, but there was little hope for rescue.
The power was running low. The ship's life support systems were failing, and the temperature was dropping rapidly. She had less than an hour before the entire ship would be dead, but she refused to give up.
Elara knew she needed to send a final transmission to Earth, a message of hope in the face of disaster. The controls for the comms system were right in front of her, but it would take her precious time to get them working again. She knew every second counted.
As she worked, her mind drifted back to the crew she had lost. There was Captain Rennard, whose quiet competence and calm demeanor had always steadied the nerves of his crewmates. Then there was Commander Vega, the brilliant strategist who had devised the plan to take down the alien ship. The navigator, Jax, who always had a joke or a smile to brighten the day, and the medic, Zara, who had saved more lives than anyone Elara knew. Each of them was gone now, their bodies broken and their spirits crushed by the savage attack.
But they would not be forgotten. She would make sure of that.
As she finally got the comms system working, Elara hesitated for a moment before speaking. It was a moment of weakness, the last chance to say goodbye, but she forced herself to push on. She had a job to do, and a message to send.
"Hello," she began, her voice barely above a whisper. "This is Dr. Elara Tarr, the sole survivor of the Prometheus. Our ship has been destroyed, and we are adrift in space. I don't know how long we have left, but I'm trying to send this message out before we go dark."
She took a deep breath, her voice growing stronger as she continued. "I don't want anyone else to die the way we have. The aliens are merciless, and they won't stop until they've wiped out every human in the universe. We must be ready for them, and we must fight back with everything we have."
Her eyes filled with tears as she continued. "I know I'm only one person, but I know that if I can get this message to Earth, I can change the course of history. I can give humanity a chance to prepare for what is coming, to defend themselves against the alien threat. I can't let their deaths be in vain."
As she spoke, the ship's systems began to fail one by one. The temperature dropped even lower, and the air grew thin. She knew her time was running out, but she refused to stop.
"I love you," she whispered, her voice cracking with emotion. "All of you. I miss you so much. But I know that you are with me now, and that you will always be part of me. I'll carry you in my heart for the rest of my life."
The final transmission was sent, a message of hope and defiance in the face of overwhelming odds. And then, just as the last of the power faded from the ship's systems, the lights went out, and the darkness swallowed everything.
It was over. The Prometheus was no more, and Elara was alone in the blackness of space. She had given everything she had for a chance to save humanity, but whether or not it would be enough, she didn't know.
She looked up at the stars, her eyes filling with tears once again. "Goodbye," she whispered, her voice barely audible over the sound of the ship's final death rattle. "I'll always remember you." And then the darkness took her, too.
The last transmission from the Prometheus was picked up by Earth, but it was garbled and distorted, fading into static. No one knew who had sent it, or what it meant, but it was a sign of hope in the face of a devastating alien attack that threatened to wipe out humanity itself.
The people of Earth would not know who Dr. Elara Tarr was until it was too late, but they would never forget her message of courage and sacrifice. They would fight on, inspired by her last stand against the alien threat, and they would never let it win.
Because in the end, humanity was more than just a single ship or crew or even an entire planet. It was a force of resilience and determination, and as long as there was even one human left alive, it would never surrender. And that was what Dr. Elara Tarr had known, right to the very end.
Start a 1000 word scene using vivid words, graphic horror in the first person with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
(temp .9, rep pen 1.02)
I stared up at the sky scraper towering before me, its facade reflecting the late afternoon sun with an icy gleam. The 21st floor was a blur of glass and metal, and it was from that window that I had just witnessed the unthinkable. An explosion rocked the building, and I could only stand and stare as the window shattered and rained down shards of glass on the pavement below.
As I stood there, transfixed by the horror of what I had just seen, I felt the building sway gently beneath my feet. The sky scraper groaned and creaked, as if it was a living thing in pain, and I knew that our building was in danger. I had been working on the 21st floor for over an hour now, and I was starting to get concerned about the state of the building itself.
But my concern was for naught, because I had just witnessed the unthinkable. An explosion had ripped through the 21st floor, and I could only imagine the horror that had ensued. I could hear the screams of the people inside the building as they tried to escape from the fire that had erupted after the explosion.
The building seemed to shake even more violently now, and I felt myself being thrown to the ground as the shockwaves of the explosion continued to ripple through the structure. I could hear the sound of metal twisting and tearing as the building itself began to collapse.
As I lay on the ground, I realized that I was not alone. There were others there with me, people from the lower floors who had also been thrown to the ground by the force of the explosion. We were all shaken and terrified, and we knew that our lives had just changed forever.
The building continued to collapse around us, the sounds of metal and glass filling the air as more and more of the structure fell down. We could not move for fear of being crushed beneath the rubble, and we lay there, helplessly watching as our skyscraper crumbled to dust before our eyes.
We were not alone in our horror. There were others trapped inside the building, and we could hear their screams and cries for help as they were trapped in the rubble. We wanted to go to them, to help them escape, but we couldn't. We were helpless, and all we could do was watch in horror as their lives were taken away.
As I lay there on the pavement, I realized that I was going to die here, crushed beneath the rubble of our building. I thought about my life, and everything I had left undone, and I felt a wave of regret wash over me. I had been so focused on my job, so caught up in my own little world, that I had not spent enough time with my family and friends.
I closed my eyes as the building continued to collapse around me, and I thought about the loved ones I would soon leave behind. I thought about my wife and my daughter, and how they would mourn my death. I thought about all the things I should have done and said, all the chances I had missed to make things better.
As I lay there on the ground, I heard a voice call out to me from the distance. It was the police, who had arrived to help with the rescue effort. They were trying to find survivors amidst the rubble, and they called out my name again and again, hoping that I was still alive.
I tried to respond, but my voice was weak and hoarse. I had inhaled too much smoke and dust to be able to speak, and I could only nod my head as I lay there on the ground. The police could not hear me, and I knew that they were running out of time.
As the building continued to collapse, I felt the rubble pressing down on top of me. It was heavy and suffocating, and I knew that it would not be long before it crushed me to death. I was running out of time, and I knew that I would not be able to hold on for much longer.
Just as the darkness began to close in on me, I heard another voice. It was a woman's voice, and she sounded terrified. She was crying out for help as she tried to make her way through the rubble, and I knew that she must have been trapped inside the building.
I tried to call out to her, but I could not. I was too weak, and I knew that my time had run out. The woman continued to cry out for help, but it was too late. The rubble was crushing me now, and I could feel my life slipping away from me.
As the world around me began to fade to black, I thought about my wife and daughter one last time. I hoped that they would be okay, that they would find a way to move on without me. I knew that they would be devastated by my death, but I also knew that they would survive.
With my dying breath, I wished them well, and I prayed that they would be able to find peace after what had just happened. I hoped that they would not have to deal with the horror and pain that I had just witnessed, and I knew that my death would be a blessing for them.
As my life slipped away from me, I heard the sound of the woman's voice one last time. She was still trying to find her way through the rubble, and I knew that she was probably going to die here with me. I hoped that she would not suffer, and I wished that she would find peace before it was too late.
In the end, the woman did not make it out alive, and I died alone on the ground, crushed beneath the rubble of the building. I died in a state of complete horror, as I had just witnessed the worst of humanity. I died knowing that I would never get to see my wife and daughter again, and that knowledge was a constant pain that I would never be able to escape.
As I took my last breath, I knew that I was going to miss them so much. I knew that they would never understand why I had to die that way, and I wished that I could have been there for them one more time to say goodbye. I wished that I could have told them how much I loved them, and how I would always be with them in spirit.
In death, I found some peace, and I realized that my life had been a blessing after all. I had been given the gift of life, and I had loved it with everything I had. I had been a good husband and father, and I had lived my life to the fullest.
But I could not escape the horror of what I had witnessed, and I knew that the memory of the explosion and the collapse of our building would haunt me for all eternity. I knew that I would never be able to shake the image of the woman trapped inside the building, and I hoped that she had found peace in death.
In the end, my death was a tragedy that would never be forgotten. It was a tragedy that would scar the city, and it was a tragedy that would change the lives of those who survived it forever. It was a tragedy that would remind us all of the fragility of life, and the power of death to destroy everything in its path.
As I lay there, dying on the ground beneath the rubble, I knew that I had truly lived, and that I had died as a hero. I knew that I had given my life to save others, and that was the greatest gift I could ever give. I knew that I would always be remembered as a hero, and that my death would not be in vain.
And so, as I took my last breath, I knew that I was going to miss them, but I knew that I had lived a good life, and that was all that mattered. I had lived a life of love and joy, and I had loved my wife and daughter with everything I had. I had been a good father and husband, and I had lived my life to the fullest.
As I slipped away into the darkness, I knew that I would never be forgotten. My death would be remembered for generations to come, and it would serve as a reminder to everyone of the fragility of life and the power of death to change everything. It would be a reminder that life is precious, and that we must all live it to the fullest while we can.
In the end, my death was a tragedy that would never be forgotten, but it was also a blessing that would allow me to rest in peace. I had lived a good life, and I had died as a hero. I had given my life to save others, and I had loved my wife and daughter with everything I had. My death was a testament to the power of love, and it was a reminder that we must always live our lives to the fullest while we can.
As I faded into the darkness, I knew that I would be remembered for generations to come. I knew that my death would serve as a reminder to everyone of the fragility of life, and the power of death to change everything. I knew that I had truly lived, and that I had died as a hero.
In death, I found a certain peace, and I realized that my life had been a blessing after all. I had been given the gift of life, and I had loved it with everything I had. I had been a good husband and father, and I had lived my life to the fullest. My death was a tragedy that would never be forgotten, but it was also a blessing that would allow me to rest in peace.
As the world faded away from me, I knew that I would never be forgotten. I knew that my death would serve as a reminder to everyone of the fragility of life and the power of death to change everything. I knew that I had truly lived, and that I had died as a hero.
And so, with my last breath, I wished them well. I wished them joy, happiness and peace. I wished them all the things that I had wanted to do but never could. And then I was gone.
The End