Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Rombos-LLM-V2.5-Qwen-7b-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Rombos-LLM-V2.5-Qwen-7b-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
819b81c9cd33bcf10588758ae87892d3c0f1961d24c20eb881151999dba766f2
120ba83
verified
about 2 months ago
.gitattributes
Safe
1.95 kB
819b81c9cd33bcf10588758ae87892d3c0f1961d24c20eb881151999dba766f2
about 2 months ago
README.md
Safe
3.02 kB
819b81c9cd33bcf10588758ae87892d3c0f1961d24c20eb881151999dba766f2
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b-GGUF_imatrix.dat
4.54 MB
LFS
819b81c9cd33bcf10588758ae87892d3c0f1961d24c20eb881151999dba766f2
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q5_K_M.gguf
Safe
5.44 GB
LFS
3ebdb6af23b49f6ad5f070f8de30d0859c5fc0ed3d7fb3c691f8a278f1c310bb
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q5_K_S.gguf
Safe
5.32 GB
LFS
c8aa086ad13d9879d857b0236d3d8d5bea7e3bda656c1af8adb892bf0ead0d44
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q6_K.gguf
Safe
6.25 GB
LFS
01022f08b9b9e62d6368b39a0eb99100a46cf62bdd889cfe24ea79ecc1e657af
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.Q8_0.gguf
Safe
8.1 GB
LFS
7b1ddc9f702410c00ca316512eac70d37803570db81bb707615211d508975b2e
about 2 months ago
Rombos-LLM-V2.5-Qwen-7b.fp16.gguf
Safe
15.2 GB
LFS
449ced269d2bc2e21471200d591fe0c0cdc74d849bc08870aca77da4328a7f78
about 2 months ago
