Model name:
T.E-8.1

Brief description:
Qwen2.5-7B based model trained for roleplay uses.

Presets:
You can use the built in ChatML presets within SillyTavern and adjust from there.
Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.

Request page:
https://huggingface.co/Lewdiculous/Model-Requests/discussions/76

Model link:
https://huggingface.co/Cran-May/T.E-8.1

Quantized with llama.cpp:
b3837

1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16)
2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants)

image/png

Downloads last month
108
GGUF
Model size
7.62B params
Architecture
qwen2

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API
Inference API (serverless) has been turned off for this model.

Model tree for Lewdiculous/T.E-8.1-GGUF-IQ-Imatrix-Request

Base model

Qwen/Qwen2.5-7B
Finetuned
Cran-May/T.E-8.1
Quantized
(5)
this model