Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
FrankenLlama-3-12B-Instruct-GGUF
like
0
Transformers
GGUF
English
Merge
mergekit
lazymergekit
Inference Endpoints
conversational
License:
other
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
FrankenLlama-3-12B-Instruct-GGUF
1 contributor
History:
16 commits
mradermacher
auto-patch README.md
a14b03d
verified
28 days ago
.gitattributes
2.43 kB
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.IQ4_XS.gguf
6.37 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q2_K.gguf
4.46 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q3_K_L.gguf
6.15 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q3_K_M.gguf
5.7 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q3_K_S.gguf
5.16 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q4_0_4_4.gguf
6.62 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q4_K_M.gguf
7.01 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q4_K_S.gguf
6.67 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q5_K_M.gguf
8.2 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q5_K_S.gguf
8 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q6_K.gguf
9.46 GB
LFS
uploaded from kaos
28 days ago
FrankenLlama-3-12B-Instruct.Q8_0.gguf
12.2 GB
LFS
uploaded from kaos
28 days ago
README.md
3.9 kB
auto-patch README.md
28 days ago