Hugging Face's logo

itdainb
/
Phi-3-mini-4k-instruct-bnb-4bit

Text Generation
Transformers
Safetensors
English
mistral
text-generation-inference
unsloth
trl
conversational
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Uploaded model

  • Developed by: itdainb
  • License: apache-2.0
  • Finetuned from model : microsoft/Phi-3-mini-4k-instruct

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
9
Safetensors
Model size
2.07B params
Tensor type
F32
·
FP16
·
U8
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for itdainb/Phi-3-mini-4k-instruct-bnb-4bit

Base model

microsoft/Phi-3-mini-4k-instruct
Quantized
(99)
this model

Collection including itdainb/Phi-3-mini-4k-instruct-bnb-4bit