metadata
library_name: transformers
tags:
- not-for-all-audiences
MoonLight-L3-15B-V2-64K
- Enhancements:
- Fine-tuning: The model has undergone fine-tuning on different RP datasheets and some dark nsfw datasheets.
- 64K context: Finetuned on Ttimofeyka/Llama-3-15B-64k-Instruct
Instruct Template
Default llama3 instruct and context preset, but here is the one i use. Instruct Context
Samplers
Creative
Temp : 1.2
Min P : 0.05
Repetition Penalty : 1.05
[And everything else neutral] (DRY Sampler Breaks it)
Normal(Precise)
Temp : 0.6 - 0.8
Min P : 0.1
Repetition Penalty : 1.1
[And everything else neutral](DRY Sampler Breaks it)
Features
- Supports 64k (finetuned on a 16k datasheet, but used Ttimofeyka/Llama-3-15B-64k-Instruct as base on fineutning)
- Automatically speaks as other NPCs.
- Creative output(Like the OpenCrystal 12b but more coherent).
- Coherent responses(Accuatlly having 15B model logic).
- Output feels similar to using Character.ai
- Improved adherence to prompts.
- No hallucinations (15B).
- Capable of summarizing and generating image prompts well. (The above image's prompt was generated in a roleplay by this model; possible due to the Llama-3-instruct base.)
System Prompt
Develop the plot slowly, always stay in character. Describe all actions in full, elaborate, explicit, graphic, and vivid detail. Mention all relevant sensory perceptions. Keep the story immersive and engaging. Speak as other person when needed and prefix with the name of person you're speaking as except {{user}}.