Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+MoE_13B_DPO-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

MoE_13B_DPO-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:222fb60cada73ccdc7cfbd8eb3a0d3e21ac5c7cf7b1d881833ef8fc94d9892b5
+size 4760823232

MoE_13B_DPO-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9ab1cdcd8aaed738f4aad23414e9a570efa9d74d80b00c1f938c592998f16a9
+size 6729729472

MoE_13B_DPO-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c8c660a72c8d8854a0b205477c813bfa71ac5ba0016b1dda7a06041a5bdc9a8
+size 6206490048

MoE_13B_DPO-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebd6bebe4ca34880c07f201acdc253af6ccb8989f2c8cf800338e986517ada41
+size 5587830208

MoE_13B_DPO-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:734667e59aaf98fa3f1069368a8617939b89189c6e9f5c8546407c9803f33136
+size 7280862656

MoE_13B_DPO-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:639d5ae8ee9bad01f4271891a13d0da4888ff18835474d3be24565dc7425e9ab
+size 7782606272

MoE_13B_DPO-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1bb74290846ddcd194b57ea5c8b16acb39e9eaabd417311031047e54b04d3d2
+size 7341680064

MoE_13B_DPO-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:032b6a9b4a16e05fb5d13b3556062d7b95609cff4bfe88eb2bfbd6668e96a8a8
+size 8874304960

MoE_13B_DPO-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c8cd347edb42a656e67b19f02da009261e9ecceabb1f89ec4122685c230346b4
+size 9132778944

MoE_13B_DPO-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:903473cd35443d69d577687086cb1ab6169eb587f5f738bb7517e084acce52ce
+size 8874304960

MoE_13B_DPO-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49c46fe6e1614eb812c17ff666c820c5fa150443321663ebb22460a0220ddf82
+size 10567337408

MoE_13B_DPO-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dbb2c7cb18b2485ac228be83a6ab5bf483caafdb7e9692df1b856f6aa90b6bd1
+size 13686375872

README.md

@@ -0,0 +1,73 @@
+---
+license: other
+tags:
+- moe
+- DPO
+- RL-TUNED
+- TensorBlock
+- GGUF
+base_model: yunconglong/MoE_13B_DPO
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## yunconglong/MoE_13B_DPO - GGUF
+
+This repo contains GGUF format model files for [yunconglong/MoE_13B_DPO](https://huggingface.co/yunconglong/MoE_13B_DPO).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [MoE_13B_DPO-Q2_K.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q2_K.gguf) | Q2_K | 4.434 GB | smallest, significant quality loss - not recommended for most purposes |
+| [MoE_13B_DPO-Q3_K_S.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q3_K_S.gguf) | Q3_K_S | 5.204 GB | very small, high quality loss |
+| [MoE_13B_DPO-Q3_K_M.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q3_K_M.gguf) | Q3_K_M | 5.780 GB | very small, high quality loss |
+| [MoE_13B_DPO-Q3_K_L.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q3_K_L.gguf) | Q3_K_L | 6.268 GB | small, substantial quality loss |
+| [MoE_13B_DPO-Q4_0.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q4_0.gguf) | Q4_0 | 6.781 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [MoE_13B_DPO-Q4_K_S.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q4_K_S.gguf) | Q4_K_S | 6.837 GB | small, greater quality loss |
+| [MoE_13B_DPO-Q4_K_M.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q4_K_M.gguf) | Q4_K_M | 7.248 GB | medium, balanced quality - recommended |
+| [MoE_13B_DPO-Q5_0.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q5_0.gguf) | Q5_0 | 8.265 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [MoE_13B_DPO-Q5_K_S.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q5_K_S.gguf) | Q5_K_S | 8.265 GB | large, low quality loss - recommended |
+| [MoE_13B_DPO-Q5_K_M.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q5_K_M.gguf) | Q5_K_M | 8.506 GB | large, very low quality loss - recommended |
+| [MoE_13B_DPO-Q6_K.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q6_K.gguf) | Q6_K | 9.842 GB | very large, extremely low quality loss |
+| [MoE_13B_DPO-Q8_0.gguf](https://huggingface.co/tensorblock/MoE_13B_DPO-GGUF/tree/main/MoE_13B_DPO-Q8_0.gguf) | Q8_0 | 12.746 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/MoE_13B_DPO-GGUF --include "MoE_13B_DPO-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/MoE_13B_DPO-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```