Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Inex12Mergerix-7B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
Model card Files Files and versions Community
1
Inex12Mergerix-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
MaziyarPanahi's picture
MaziyarPanahi
2dfdbd737ffe578556954d0829b3b0ab208c6b4419fc9b7aae407b9911acfb30
b68db09 verified about 1 year ago
  • .gitattributes
    2.05 kB
    2dfdbd737ffe578556954d0829b3b0ab208c6b4419fc9b7aae407b9911acfb30 about 1 year ago
  • Inex12Mergerix-7B.Q2_K.gguf
    2.72 GB
    LFS
    24d13e2e29ca2605038a80370eda5f2e99909e180730c1a3b094c0ad446e0dba about 1 year ago
  • Inex12Mergerix-7B.Q3_K_L.gguf
    3.82 GB
    LFS
    bcd30cff64b714fcd7fcd1c085490b8d3506fcb44631249c6998f61d3b3db2ff about 1 year ago
  • Inex12Mergerix-7B.Q3_K_M.gguf
    3.52 GB
    LFS
    24c505c2dbc11572d0456dbee0a93f7ed4a8863ca48760bd51ca78e2982757a7 about 1 year ago
  • Inex12Mergerix-7B.Q3_K_S.gguf
    3.16 GB
    LFS
    22596078e4f53d742491c3ee2f84b07378302372b5be858c058724b32fa858df about 1 year ago
  • Inex12Mergerix-7B.Q4_K_M.gguf
    4.37 GB
    LFS
    d323137626c8fde35422fa9b4071a3df2ec1dc7b3aaeba272ff81dbfb5645b5d about 1 year ago
  • Inex12Mergerix-7B.Q4_K_S.gguf
    4.14 GB
    LFS
    bfb85fb17a726c2fd8ada7a7238d4c6808f4147982157e2aa77b9959c49b1d12 about 1 year ago
  • Inex12Mergerix-7B.Q5_K_M.gguf
    5.13 GB
    LFS
    d35485e5706eecdf142ecf231065aa4544a9ed3b688957213db8a2346aa0a64b about 1 year ago
  • Inex12Mergerix-7B.Q5_K_S.gguf
    5 GB
    LFS
    2dfdbd737ffe578556954d0829b3b0ab208c6b4419fc9b7aae407b9911acfb30 about 1 year ago