GGUF
English
Not-For-All-Audiences
Inference Endpoints
conversational
Edit model card

QuantFactory Banner

QuantFactory/Nymph_8B-GGUF

This is quantized version of ResplendentAI/Nymph_8B created using llama.cpp

Original Model Card

Nymph 8B

image/jpeg

GGUF here: https://huggingface.co/mradermacher/Nymph_8B-i1-GGUF

Nymph is the culmination of everything I have learned with the T-series project. This model aims to be a unique and full featured RP juggernaut.

The finetune incorporates 1.6 Million tokens of RP data sourced from Bluemoon, FreedomRP, Aesir-Preview, and Claude Opus logs. I made sure to use the multi-turn sharegpt datasets this time instead of alpaca conversions. I have also included three of my personal datasets. The final touch is an ORPO based upon Openhermes Roleplay preferences.

Downloads last month
112
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .

Datasets used to train QuantFactory/Nymph_8B-GGUF