RE-70B-AS3D / README.md
altomek's picture
Update README.md
53288da verified
|
raw
history blame
1.67 kB
metadata
language:
  - en
license: llama3
library_name: transformers
tags:
  - merge
base_model:
  - SillyTilly/Meta-Llama-3.1-70B
  - SillyTilly/Meta-Llama-3.1-70B-Instruct
  - unsloth/Llama-3.3-70B-Instruct
  - SicariusSicariiStuff/Negative_LLAMA_70B

intro music...

Llama RE-70B-AS3D

I desired a model that would unlock full Llama personality but still could follow instructions. This is first interesting result from the voyage...

Ingridients

Settings

Use Llama 3 template, model with ALpaca template sometimes halucinates and generates training materials ;P

Quants

More quants are comming soon... and I need to redo GGUF quants(!) as they do not encode chat template in tokenizer_config... if your inference engine uses chat template from GGUF file you will see halucinations. However GGUFs work fine for me in SillyTawern & text-generation-webui combo...