afrideva commited on
Commit
24b01f1
1 Parent(s): 4883d94

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -2,7 +2,7 @@
2
  base_model: habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3
3
  inference: false
4
  model_creator: habanoz
5
- model_name: TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF
6
  pipeline_tag: text-generation
7
  quantized_by: afrideva
8
  tags:
@@ -18,17 +18,17 @@ tags:
18
  ---
19
  # habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF
20
 
21
- Quantized GGUF model files for [TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3](https://huggingface.co/habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3) from [habanoz](https://huggingface.co/habanoz)
22
 
23
 
24
  | Name | Quant method | Size |
25
  | ---- | ---- | ---- |
26
- | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q2_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q2_k.gguf) | q2_k | None |
27
- | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q3_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q3_k_m.gguf) | q3_k_m | None |
28
- | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q4_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q4_k_m.gguf) | q4_k_m | None |
29
- | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q5_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q5_k_m.gguf) | q5_k_m | None |
30
- | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q6_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q6_k.gguf) | q6_k | None |
31
- | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q8_0.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q8_0.gguf) | q8_0 | None |
32
 
33
 
34
 
 
2
  base_model: habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3
3
  inference: false
4
  model_creator: habanoz
5
+ model_name: TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3
6
  pipeline_tag: text-generation
7
  quantized_by: afrideva
8
  tags:
 
18
  ---
19
  # habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF
20
 
21
+ Quantized GGUF model files for [TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3](https://huggingface.co/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3) from [habanoz](https://huggingface.co/habanoz)
22
 
23
 
24
  | Name | Quant method | Size |
25
  | ---- | ---- | ---- |
26
+ | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q2_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q2_k.gguf) | q2_k | 482.14 MB |
27
+ | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q3_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q3_k_m.gguf) | q3_k_m | 549.85 MB |
28
+ | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q4_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q4_k_m.gguf) | q4_k_m | 667.81 MB |
29
+ | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q5_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q5_k_m.gguf) | q5_k_m | 782.04 MB |
30
+ | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q6_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q6_k.gguf) | q6_k | 903.41 MB |
31
+ | [tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q8_0.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-instruct-V3-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-instruct-v3.q8_0.gguf) | q8_0 | 1.17 GB |
32
 
33
 
34