Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+llama3-pre1-pre2-inst3-lora3-mergkit-base-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,81 @@
+---
+library_name: transformers
+language:
+- en
+- ko
+pipeline_tag: translation
+license: mit
+datasets:
+- pre
+base_model: 4yo1/llama3-pre1-pre2-inst3-lora3-mergkit-base
+tags:
+- TensorBlock
+- GGUF
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## 4yo1/llama3-pre1-pre2-inst3-lora3-mergkit-base - GGUF
+
+This repo contains GGUF format model files for [4yo1/llama3-pre1-pre2-inst3-lora3-mergkit-base](https://huggingface.co/4yo1/llama3-pre1-pre2-inst3-lora3-mergkit-base).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+<|begin_of_text|><|start_header_id|>system<|end_header_id|>
+
+{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
+
+{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q2_K.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q2_K.gguf) | Q2_K | 2.980 GB | smallest, significant quality loss - not recommended for most purposes |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_S.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_S.gguf) | Q3_K_S | 3.428 GB | very small, high quality loss |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_M.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_M.gguf) | Q3_K_M | 3.741 GB | very small, high quality loss |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_L.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_L.gguf) | Q3_K_L | 4.021 GB | small, substantial quality loss |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_0.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_0.gguf) | Q4_0 | 4.340 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_S.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_S.gguf) | Q4_K_S | 4.362 GB | small, greater quality loss |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_M.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_M.gguf) | Q4_K_M | 4.566 GB | medium, balanced quality - recommended |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_0.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_0.gguf) | Q5_0 | 5.198 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_S.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_S.gguf) | Q5_K_S | 5.198 GB | large, low quality loss - recommended |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_M.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_M.gguf) | Q5_K_M | 5.315 GB | large, very low quality loss - recommended |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q6_K.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q6_K.gguf) | Q6_K | 6.110 GB | very large, extremely low quality loss |
+| [llama3-pre1-pre2-inst3-lora3-mergkit-base-Q8_0.gguf](https://huggingface.co/tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF/tree/main/llama3-pre1-pre2-inst3-lora3-mergkit-base-Q8_0.gguf) | Q8_0 | 7.911 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF --include "llama3-pre1-pre2-inst3-lora3-mergkit-base-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/llama3-pre1-pre2-inst3-lora3-mergkit-base-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:862e2791316e87d89fa044600270f22b6430f56ebf418e08399e6f160bd72a7e
+size 3199836576

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:297394f6d0681a8913df17bade840a64851334853850d45482b722a0d7a5599b
+size 4317438528

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:251667ce168f44d0e72c1acaca30df25eef24fe50183a3bd6848abc3d55524fa
+size 4017021504

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:12313a76c682a8aff84a819da887926afab7a38c7c33d8470f90623d8469d927
+size 3680526912

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67ba6238de857c6f2e3cae217912b756c1064c179ff2d278f27822b5937ebdeb
+size 4659810144

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2275cfd69a3407c836412efc2e434098c94da56cef413ea104dbf55e4750a4b3
+size 4903112544

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6445e9bd05119a98fbc08ea21e31b9293d2aecd61e0a487954fb6134596329b0
+size 4683927392

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b72739ad1fc2c00c625fc4779d42f1296f944486dd5c5a1b88fbd5d3118cca0f
+size 5581488480

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:348ecffd88e020e3dd0960786c167681bdcdc88656f63ee2cf9c2b9204993e89
+size 5706826080

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:920dd5d4131cb2e031cf5c0e19e9c5eae4a94c644158d29f1da8bb0bd2cfd720
+size 5581488480

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:526982a94de8239e8493f5bb952b103762d18f3673eeea85a32b232e68844991
+size 6560771712

llama3-pre1-pre2-inst3-lora3-mergkit-base-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b4e04765c27b81659b5c812fbb57f9ecedaccd1f6abda612fafb52802d16345
+size 8494792768