Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2-1.5B-Instruct-GGUF
like
8
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
369f2b4
Qwen2-1.5B-Instruct-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
03e13749df7d6a028b16240dab2f1b73a99471386fbc528080769d17e29653da
369f2b4
verified
5 months ago
.gitattributes
2.4 kB
03e13749df7d6a028b16240dab2f1b73a99471386fbc528080769d17e29653da
5 months ago
Qwen2-1.5B-Instruct.IQ1_M.gguf
464 MB
LFS
1a00199528bcaa518112b9fb3713fe29f351e66c27af5d703d97361aceb990b5
5 months ago
Qwen2-1.5B-Instruct.IQ1_S.gguf
437 MB
LFS
1a00199528bcaa518112b9fb3713fe29f351e66c27af5d703d97361aceb990b5
5 months ago
Qwen2-1.5B-Instruct.IQ2_XS.gguf
550 MB
LFS
1a00199528bcaa518112b9fb3713fe29f351e66c27af5d703d97361aceb990b5
5 months ago
Qwen2-1.5B-Instruct.IQ3_XS.gguf
732 MB
LFS
d7b33f3b3a4c5822960c80b8e0aa102d5193b69d91f715218142b47f46dadcdf
5 months ago
Qwen2-1.5B-Instruct.IQ4_XS.gguf
896 MB
LFS
d7b33f3b3a4c5822960c80b8e0aa102d5193b69d91f715218142b47f46dadcdf
5 months ago
Qwen2-1.5B-Instruct.Q2_K.gguf
676 MB
LFS
1f11870748daf2ee4869f68ff8a4fc66ca8287bae85a773bddeae7ec64787d3a
5 months ago
Qwen2-1.5B-Instruct.Q3_K_L.gguf
880 MB
LFS
1f11870748daf2ee4869f68ff8a4fc66ca8287bae85a773bddeae7ec64787d3a
5 months ago
Qwen2-1.5B-Instruct.Q3_K_M.gguf
824 MB
LFS
b50ce61c3ea9bccc0966f9f2f6728c83fadb808784b4f3559e4facf4b26ab0ed
5 months ago
Qwen2-1.5B-Instruct.Q3_K_S.gguf
761 MB
LFS
b50ce61c3ea9bccc0966f9f2f6728c83fadb808784b4f3559e4facf4b26ab0ed
5 months ago
Qwen2-1.5B-Instruct.Q4_K_M.gguf
986 MB
LFS
266263bc39e40ca9fc5d16d03dba0b74ebfef5fb8ffae5b4e94b320c446ac6a3
5 months ago
Qwen2-1.5B-Instruct.Q4_K_S.gguf
940 MB
LFS
266263bc39e40ca9fc5d16d03dba0b74ebfef5fb8ffae5b4e94b320c446ac6a3
5 months ago
Qwen2-1.5B-Instruct.Q5_K_M.gguf
1.13 GB
LFS
dae1d38225723125a6bf56fa94c590519406b1be9595eb89fb7141ab2e8c51b2
5 months ago
Qwen2-1.5B-Instruct.Q5_K_S.gguf
1.1 GB
LFS
03e13749df7d6a028b16240dab2f1b73a99471386fbc528080769d17e29653da
5 months ago
