Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
bartowski
/
Phi-3.5-MoE-instruct-GGUF
like
7
Text Generation
GGUF
multilingual
nlp
code
Inference Endpoints
imatrix
conversational
License:
mit
Model card
Files
Files and versions
Community
Deploy
Use this model
ea84780
Phi-3.5-MoE-instruct-GGUF
1 contributor
History:
24 commits
bartowski
Upload Phi-3.5-MoE-instruct-IQ2_S.gguf with huggingface_hub
ea84780
verified
16 days ago
.gitattributes
3.09 kB
Upload Phi-3.5-MoE-instruct-IQ2_S.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-IQ2_M.gguf
13.8 GB
LFS
Upload Phi-3.5-MoE-instruct-IQ2_M.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-IQ2_S.gguf
12.5 GB
LFS
Upload Phi-3.5-MoE-instruct-IQ2_S.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-IQ3_M.gguf
18.4 GB
LFS
Upload Phi-3.5-MoE-instruct-IQ3_M.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-IQ3_XS.gguf
17.1 GB
LFS
Upload Phi-3.5-MoE-instruct-IQ3_XS.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-IQ4_NL.gguf
23.6 GB
LFS
Upload Phi-3.5-MoE-instruct-IQ4_NL.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-IQ4_XS.gguf
22.3 GB
LFS
Upload Phi-3.5-MoE-instruct-IQ4_XS.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q2_K.gguf
15.3 GB
LFS
Upload Phi-3.5-MoE-instruct-Q2_K.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q2_K_L.gguf
15.4 GB
LFS
Upload Phi-3.5-MoE-instruct-Q2_K_L.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q3_K_L.gguf
21.7 GB
LFS
Upload Phi-3.5-MoE-instruct-Q3_K_L.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q3_K_M.gguf
20 GB
LFS
Upload Phi-3.5-MoE-instruct-Q3_K_M.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q3_K_S.gguf
18.1 GB
LFS
Upload Phi-3.5-MoE-instruct-Q3_K_S.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q3_K_XL.gguf
21.8 GB
LFS
Upload Phi-3.5-MoE-instruct-Q3_K_XL.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q4_0.gguf
23.7 GB
LFS
Upload Phi-3.5-MoE-instruct-Q4_0.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q4_1.gguf
26.2 GB
LFS
Upload Phi-3.5-MoE-instruct-Q4_1.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q4_K_L.gguf
25.4 GB
LFS
Upload Phi-3.5-MoE-instruct-Q4_K_L.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q4_K_M.gguf
25.3 GB
LFS
Upload Phi-3.5-MoE-instruct-Q4_K_M.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q4_K_S.gguf
23.8 GB
LFS
Upload Phi-3.5-MoE-instruct-Q4_K_S.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q5_K_L.gguf
29.8 GB
LFS
Upload Phi-3.5-MoE-instruct-Q5_K_L.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q5_K_M.gguf
29.7 GB
LFS
Upload Phi-3.5-MoE-instruct-Q5_K_M.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q5_K_S.gguf
28.8 GB
LFS
Upload Phi-3.5-MoE-instruct-Q5_K_S.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q6_K.gguf
34.4 GB
LFS
Upload Phi-3.5-MoE-instruct-Q6_K.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q6_K_L.gguf
34.4 GB
LFS
Upload Phi-3.5-MoE-instruct-Q6_K_L.gguf with huggingface_hub
16 days ago
Phi-3.5-MoE-instruct-Q8_0.gguf
44.5 GB
LFS
Upload Phi-3.5-MoE-instruct-Q8_0.gguf with huggingface_hub
16 days ago