Models

CHE-72/Baichuan2-7B-Chat-Q2_K-GGUF

8B • Updated Jun 22, 2024 • 2

CHE-72-ZLab/Alibaba-Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Jun 23, 2024 • 25

CHE-72-ZLab/Alibaba-Qwen2-1_5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 23, 2024 • 29

CHE-72-ZLab/Alibaba-Qwen2-0_5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jun 23, 2024 • 51

CHE-72-ZLab/Microsoft-Phi3-14B-Instruct128K-GGUF

Text Generation • 14B • Updated Jun 23, 2024 • 3

qnixsynapse/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

7B • Updated Jun 22, 2024 • 18

CHE-72/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Jun 22, 2024 • 5

CHE-72/Phi-3-mini-128k-instruct-Q6_K-GGUF

Text Generation • 4B • Updated Jun 22, 2024 • 2

CHE-72/TAIDE-LX-7B-Chat-Q8_0-GGUF

7B • Updated Jun 22, 2024 • 2

CHE-72/TAIDE-LX-7B-Chat-Q6_K-GGUF

7B • Updated Jun 22, 2024 • 1

CHE-72/TAIDE-LX-7B-Chat-Q5_K_M-GGUF

7B • Updated Jun 22, 2024 • 2

CHE-72/TAIDE-LX-7B-Chat-Q5_K_S-GGUF

7B • Updated Jun 22, 2024 • 3

CHE-72/TAIDE-LX-7B-Chat-Q5_0-GGUF

7B • Updated Jun 22, 2024 • 19

Johnyquest7/medllama3-v20-Q4_K_M-GGUF

8B • Updated Jun 22, 2024 • 3 • 2

CHE-72/TAIDE-LX-7B-Chat-Q4_K_M-GGUF

7B • Updated Jun 22, 2024 • 2

CHE-72/TAIDE-LX-7B-Chat-Q4_K_S-GGUF

7B • Updated Jun 22, 2024 • 3

CHE-72/TAIDE-LX-7B-Chat-Q4_0-GGUF

7B • Updated Jun 22, 2024 • 3

CHE-72/TAIDE-LX-7B-Chat-Q3_K_L-GGUF

7B • Updated Jun 22, 2024 • 1

CHE-72/TAIDE-LX-7B-Chat-Q3_K_M-GGUF

7B • Updated Jun 22, 2024 • 1

CHE-72/TAIDE-LX-7B-Chat-Q3_K_S-GGUF

7B • Updated Jun 22, 2024 • 5

CHE-72/TAIDE-LX-7B-Chat-Q2_K-GGUF

7B • Updated Jun 22, 2024 • 6

CHE-72/Breeze-7B-Instruct-v1_0-Q8_0-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 4

CHE-72/Breeze-7B-Instruct-v1_0-Q6_K-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 4

CHE-72/Breeze-7B-Instruct-v1_0-Q5_K_M-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 3

CHE-72/Breeze-7B-Instruct-v1_0-Q5_0-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 3

CHE-72/Breeze-7B-Instruct-v1_0-Q4_K_M-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 2

CHE-72/Breeze-7B-Instruct-v1_0-Q4_K_S-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 2

CHE-72/Breeze-7B-Instruct-v1_0-Q4_0-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 4

CHE-72/Breeze-7B-Instruct-v1_0-Q3_K_L-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 6

CHE-72/Breeze-7B-Instruct-v1_0-Q3_K_M-GGUF

Text Generation • 7B • Updated Jun 22, 2024 • 3