Upload folder using huggingface_hub

Phi-3.5-mini-instruct-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b397be11bd1d38abaff560567c58141e7b949f9ab3c4f53ce2d8209f9e03954b
-size 1416204288
+oid sha256:dd7aa5f3421a3ad4968ea415a348beaec8ed4f6f693f86c10bfefb7c72e017c6
+size 1446880352

Phi-3.5-mini-instruct-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9eeafb382e4c2c7cabde6d44b84377f1f89f4caa944ea4ec0a784f2071b36778
-size 2087597568
+oid sha256:5559cabf951a8990a7bd346f251e0a14deff271fa3358fe9b5cd37648f7482a5
+size 2045135456

Phi-3.5-mini-instruct-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8cd9eb2fa154806bed7c882e0e98240e98a4252d2962aee586aa9dcefb9b4a7e
-size 1955476992
+oid sha256:73fae63fac556605cd75677f8f8825518ebe17f67da5189052cdf8f15331084a
+size 1877625440

Phi-3.5-mini-instruct-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c2ddefc7e08593405527aa603503f9a3c428638a96b78de0265f08adce1d601b
-size 1681798656
+oid sha256:1b98f45193dd338812b31b70ccf3ffc91825093389835aa19981a32561b56298
+size 1681803872

Phi-3.5-mini-instruct-Q4_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f855670a663566ec9b3f7ed628db40f813e019008c2822b5efeda42b33be8d36
-size 2176177152
+oid sha256:f6f9ec6b1f7b373e59c0242b57c49525b17ba4c25e064e40406a63346b35f33b
+size 2176182368

Phi-3.5-mini-instruct-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:677fca7004b3f1a8503bc2b8fa4a644d9211b9534da25c13afd6950a09428358
-size 2393232384
+oid sha256:6edd985cc7e2ab5559cc64bf3a9cffd0d18bc700febacfb6a3f6f42faa2f0a2e
+size 2318919776

Phi-3.5-mini-instruct-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f6a38bd0a1baf99cb9084feb78f7bdd693d2a0187225d3436ca223796691271b
-size 2188760064
+oid sha256:5c4cb47335298dc78748cc1e4646b8f21ede113bb19428c4ad1029f1c4d55a2e
+size 2193483872

Phi-3.5-mini-instruct-Q5_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:66b6bec893d274a364ceb4140b8a64d2da80b17753888cb6e4b06229b00e9668
-size 2641474560
+oid sha256:ae0adf6fa12fc97bc96905f7588535185daa55b78f69f473d27f3430c279d3f3
+size 2641479776

Phi-3.5-mini-instruct-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e96636cdb5ad35516f050a89ffb3d1a24b673c61e9142fc603fedb9b72d0d96d
-size 2815276032
+oid sha256:c80fb3a13953278b19814effe268bbb0319e0bfdf1dd39b09b8c090985c58b6d
+size 2715011168

Phi-3.5-mini-instruct-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c25ce2b1d29730f1617fe0c7a4a375adf65414efa13b270c5cacbf35dd2c6dd1
-size 2641474560
+oid sha256:1bf8114b86541856c76ffceeadb6d32559179f343e29fd156c3af0314368a762
+size 2641479776

Phi-3.5-mini-instruct-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d74517ac8c384e0265b9322d0b39a6ae8e78c5dc3092c0a90d422ab193fb73ee
-size 3135853056
+oid sha256:3a900548b2ee6422e843285e9676631566f09ab7c85ea0dd6a7fbcab422a74b8
+size 3135858272

Phi-3.5-mini-instruct-Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0fec17b95a961dd1436ffe5b6aa21319fb530f502ff0fca762f4a862cbdb49f7
-size 4061222400
+oid sha256:1359192e2829717322c8ad6d67272d7af6e10b26facfacd36677dfc72fa0374f
+size 4061227616

README.md

@@ -1,20 +1,17 @@
 ---
-license: mit
 license_link: https://huggingface.co/microsoft/Phi-3.5-mini-instruct/resolve/main/LICENSE
 language:
 - multilingual
-pipeline_tag: text-generation
+library_name: transformers
+license: mit
 tags:
-- nlp
-- code
+- unsloth
+- transformers
+- phi3
+- phi
 - TensorBlock
 - GGUF
-widget:
-- messages:
-  - role: user
-    content: Can you provide ways to eat combinations of bananas and dragonfruits?
-library_name: transformers
-base_model: microsoft/Phi-3.5-mini-instruct
+base_model: unsloth/Phi-3.5-mini-instruct
 ---
 
 <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -28,9 +25,9 @@ base_model: microsoft/Phi-3.5-mini-instruct
     </div>
 </div>
 
-## microsoft/Phi-3.5-mini-instruct - GGUF
+## unsloth/Phi-3.5-mini-instruct - GGUF
 
-This repo contains GGUF format model files for [microsoft/Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct).
+This repo contains GGUF format model files for [unsloth/Phi-3.5-mini-instruct](https://huggingface.co/unsloth/Phi-3.5-mini-instruct).
 
 The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
 
@@ -48,16 +45,16 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 | Filename | Quant type | File Size | Description |
 | -------- | ---------- | --------- | ----------- |
-| [Phi-3.5-mini-instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q2_K.gguf) | Q2_K | 1.319 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Phi-3.5-mini-instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q2_K.gguf) | Q2_K | 1.348 GB | smallest, significant quality loss - not recommended for most purposes |
 | [Phi-3.5-mini-instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q3_K_S.gguf) | Q3_K_S | 1.566 GB | very small, high quality loss |
-| [Phi-3.5-mini-instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q3_K_M.gguf) | Q3_K_M | 1.821 GB | very small, high quality loss |
-| [Phi-3.5-mini-instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q3_K_L.gguf) | Q3_K_L | 1.944 GB | small, substantial quality loss |
+| [Phi-3.5-mini-instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q3_K_M.gguf) | Q3_K_M | 1.749 GB | very small, high quality loss |
+| [Phi-3.5-mini-instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q3_K_L.gguf) | Q3_K_L | 1.905 GB | small, substantial quality loss |
 | [Phi-3.5-mini-instruct-Q4_0.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q4_0.gguf) | Q4_0 | 2.027 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
-| [Phi-3.5-mini-instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q4_K_S.gguf) | Q4_K_S | 2.038 GB | small, greater quality loss |
-| [Phi-3.5-mini-instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q4_K_M.gguf) | Q4_K_M | 2.229 GB | medium, balanced quality - recommended |
+| [Phi-3.5-mini-instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q4_K_S.gguf) | Q4_K_S | 2.043 GB | small, greater quality loss |
+| [Phi-3.5-mini-instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q4_K_M.gguf) | Q4_K_M | 2.160 GB | medium, balanced quality - recommended |
 | [Phi-3.5-mini-instruct-Q5_0.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q5_0.gguf) | Q5_0 | 2.460 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
 | [Phi-3.5-mini-instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q5_K_S.gguf) | Q5_K_S | 2.460 GB | large, low quality loss - recommended |
-| [Phi-3.5-mini-instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q5_K_M.gguf) | Q5_K_M | 2.622 GB | large, very low quality loss - recommended |
+| [Phi-3.5-mini-instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q5_K_M.gguf) | Q5_K_M | 2.529 GB | large, very low quality loss - recommended |
 | [Phi-3.5-mini-instruct-Q6_K.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q6_K.gguf) | Q6_K | 2.920 GB | very large, extremely low quality loss |
 | [Phi-3.5-mini-instruct-Q8_0.gguf](https://huggingface.co/tensorblock/Phi-3.5-mini-instruct-GGUF/tree/main/Phi-3.5-mini-instruct-Q8_0.gguf) | Q8_0 | 3.782 GB | very large, extremely low quality loss - not recommended |