Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
AlloyingotneoyYam-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mergekit
Merge
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
AlloyingotneoyYam-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
66db0da14932f80897fe5814c0a081896485e2817757e24c9dd447940fa14611
bce7483
verified
10 months ago
.gitattributes
Safe
2.27 kB
e2ff4445deb4aaf2273b0d211773c45830ddf11cd7a9b71aab236978b44e53fd
10 months ago
AlloyingotneoyYam-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
99ac2dcb114a2fd20740dcf2024c999e7cf447fb1d019fd09d0e19d92b4669d7
10 months ago
AlloyingotneoyYam-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
1a32e917f6f206b52b1d9ec9dd0aa8a2234fb544e6008ee82a8be5850d03e177
10 months ago
AlloyingotneoyYam-7B.Q2_K.gguf
Safe
2.72 GB
LFS
74fa92f305ac13c6e564dea430a66a495b88f9e16b543cc15eaadca2f804fd2d
10 months ago
AlloyingotneoyYam-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
0956e9bfdd6662b76c0e00271079e1a1d8fa7073f56e0ce2725940b420e95f50
10 months ago
AlloyingotneoyYam-7B.Q3_K_M.gguf
3.52 GB
LFS
ac77ddf40f09d0706e3083806531c204fa08e58eb89cad616a2b2dc95ad1f051
10 months ago
AlloyingotneoyYam-7B.Q3_K_S.gguf
3.16 GB
LFS
c75e797c2e96bc248ff6980c85d252158d09535bfd8aed22c8a511be59b02d78
10 months ago
AlloyingotneoyYam-7B.Q4_K_M.gguf
4.37 GB
LFS
89b13dd4fd01f5a723a5268bdcc0d2780240df4d23f4d7e557f7e51a9db1ec7f
10 months ago
AlloyingotneoyYam-7B.Q4_K_S.gguf
4.14 GB
LFS
907ef2785a10fdf98ef9bb42ad8549ae378488d95716777f71b9fa8a27d0f4da
10 months ago
AlloyingotneoyYam-7B.Q5_K_M.gguf
5.13 GB
LFS
eb68da009325df36918d28b853b708dd4bbc3ae82924edbb12c59d2dbb47138a
10 months ago
AlloyingotneoyYam-7B.Q5_K_S.gguf
5 GB
LFS
9dfe394ff8d1ea1ed6254b666fbf8b9aefa5355ff5b7e1050b73b94417360824
10 months ago
AlloyingotneoyYam-7B.Q6_K.gguf
5.94 GB
LFS
e2ff4445deb4aaf2273b0d211773c45830ddf11cd7a9b71aab236978b44e53fd
10 months ago
README.md
Safe
11 kB
66db0da14932f80897fe5814c0a081896485e2817757e24c9dd447940fa14611
10 months ago