README.md

---
base_model: microsoft/Phi-3-mini-128k-instruct
license: other
license_name: mit
license_link: https://huggingface.co/microsoft/Phi-3-mini-128k-instruct/raw/main/LICENSE
inference: false
model_creator: Microsoft
model_name: Phi-3-mini-128k-instruct
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
- Phi-3-mini-128k-instruct
---
# Phi-3-mini-128k-instruct - bnb 4bit
- Model creator: [Microsoft](https://huggingface.co/microsoft)
- Original model: [Phi-3-mini-128k-instruct](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct)

## Description

This model is 4bit quantized version of [Phi-3-mini-128k-instruct](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct) using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".