Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-audio-super-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,90 @@
+---
+language:
+- en
+license: mit
+tags:
+- convAI
+- conversational
+- ASR
+- TensorBlock
+- GGUF
+license_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE
+widget:
+- text: Hello who are you?
+  example_title: Identity
+- text: What can you do?
+  example_title: Capabilities
+- text: Create a fastapi endpoint to retrieve the weather given a zip code.
+  example_title: Coding
+pipeline_tag: text-generation
+base_model: Thytu/phi-2-audio-super
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## Thytu/phi-2-audio-super - GGUF
+
+This repo contains GGUF format model files for [Thytu/phi-2-audio-super](https://huggingface.co/Thytu/phi-2-audio-super).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+<|endoftext|>[INST] {prompt} [/INST]
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [phi-2-audio-super-Q2_K.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q2_K.gguf) | Q2_K | 1.110 GB | smallest, significant quality loss - not recommended for most purposes |
+| [phi-2-audio-super-Q3_K_S.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q3_K_S.gguf) | Q3_K_S | 1.251 GB | very small, high quality loss |
+| [phi-2-audio-super-Q3_K_M.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q3_K_M.gguf) | Q3_K_M | 1.426 GB | very small, high quality loss |
+| [phi-2-audio-super-Q3_K_L.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q3_K_L.gguf) | Q3_K_L | 1.575 GB | small, substantial quality loss |
+| [phi-2-audio-super-Q4_0.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q4_0.gguf) | Q4_0 | 1.602 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [phi-2-audio-super-Q4_K_S.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q4_K_S.gguf) | Q4_K_S | 1.619 GB | small, greater quality loss |
+| [phi-2-audio-super-Q4_K_M.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q4_K_M.gguf) | Q4_K_M | 1.738 GB | medium, balanced quality - recommended |
+| [phi-2-audio-super-Q5_0.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q5_0.gguf) | Q5_0 | 1.933 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [phi-2-audio-super-Q5_K_S.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q5_K_S.gguf) | Q5_K_S | 1.933 GB | large, low quality loss - recommended |
+| [phi-2-audio-super-Q5_K_M.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q5_K_M.gguf) | Q5_K_M | 2.003 GB | large, very low quality loss - recommended |
+| [phi-2-audio-super-Q6_K.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q6_K.gguf) | Q6_K | 2.285 GB | very large, extremely low quality loss |
+| [phi-2-audio-super-Q8_0.gguf](https://huggingface.co/tensorblock/phi-2-audio-super-GGUF/blob/main/phi-2-audio-super-Q8_0.gguf) | Q8_0 | 2.958 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/phi-2-audio-super-GGUF --include "phi-2-audio-super-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/phi-2-audio-super-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

phi-2-audio-super-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ec9f0ecda0018aada7dc02b5bb83fdf4e2e938bc4c241bb26095b3a248abec5
+size 1109720608

phi-2-audio-super-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a8638450fb6c9522b37d86e8d9606adfbcf89589cd9119e9177788bbd8f44ef
+size 1575231008

phi-2-audio-super-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:07cc1f2569a542c5acf0b11caa52908cf0b3752569ac0574893d3e47818d1956
+size 1426136608

phi-2-audio-super-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ac84aba6d05a69c0be99ec6add1195eb2ee14958b9a2d94b10e925c9545d4619
+size 1250827808

phi-2-audio-super-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ca712e474b94ff0deb532ce872d1f9ff6a50c1c8798c1ea9c9e96dcf276ae65
+size 1602469408

phi-2-audio-super-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b9fb36192b74b563e301345f13f74eefdb04fa3c19d5ab2dfb87b7f9f097f26
+size 1737637408

phi-2-audio-super-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e7108a1f0cf6b907293f5860c54c4b447034146b6b632688640e770ff73db6b
+size 1618853408

phi-2-audio-super-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:485bf90b9f0f08c2a763971b7f938237481704bee9402bff826e3f5d2ceb45d3
+size 1933426208

phi-2-audio-super-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:56aa1c8df451ceb2f82f82717e2b1e2aad7d79911aeda094e690a229b7ac3759
+size 2003058208

phi-2-audio-super-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:755ed044a9b56b6e3d90a0f8bb2afe088d326abe150ba48c01b14dd2a1f3942f
+size 1933426208

phi-2-audio-super-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc7fc8a8dac8434ff9de4d911a72fe039427c136bbfa376e6ab9e3ddc138771c
+size 2285067808

phi-2-audio-super-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd6eeba29b57fa797d2f2bf08a3c56ce7c1f08ddb223f8f711cc3bf5ada9e1a0
+size 2958040608