📟 Relay v0.1 (Mistral Nemo 2407): 4-bit (bnb)

This model page includes the 4-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.

Downloads last month: 4

Safetensors

Model size

6.97B params

Tensor type

F32

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for danlou/relay-v0.1-Mistral-Nemo-2407-4bit

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

danlou/relay-v0.1-Mistral-Nemo-2407

Quantized

(4)

this model

Dataset used to train danlou/relay-v0.1-Mistral-Nemo-2407-4bit

Collection including danlou/relay-v0.1-Mistral-Nemo-2407-4bit

📟 Relay

Collection

Turning base LLMs into IRCs, for more natural and versatile chat applications. • 5 items • Updated Dec 13, 2024