Noromaid-13b-v0.3 5BPW

Description

Exllama quant of NeverSleep/Noromaid-13b-v0.3

Other quants:

EXL2: 8bpw, 6bpw, 5bpw, 4bpw

Prompt Format

Silly Tavern Preset

Instruct template

Context template

Alpaca:

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Input:
{input}

### Response:

Contact

Kooten on discord

Downloads last month
7
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including Kooten/Noromaid-13b-v0.3-5bpw-exl2