Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Hermes-2-Pro-Llama-3-13B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
conversational
text-generation-inference
Model card Files Files and versions Community
1
Hermes-2-Pro-Llama-3-13B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
MaziyarPanahi's picture
MaziyarPanahi
3ab22ad0a4eee948e1439ffb9414dc747dfbb52666985fbeeec15297fe034713
4c707b3 verified about 1 year ago
  • .gitattributes
    2.1 kB
    3ab22ad0a4eee948e1439ffb9414dc747dfbb52666985fbeeec15297fe034713 about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q2_K.gguf
    4.62 GB
    LFS
    6a201766a663da22b74547da1817a4025d59b422ae86d143975b7e4791999092 about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q3_K_L.gguf
    6.38 GB
    LFS
    39f750dae90cd03c874ad8b7b80b3c9a9dfaa501edd25269c7c180cccd0d492d about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q3_K_M.gguf
    5.9 GB
    LFS
    f6ffa93fdcf102158a8e7bdbfa6b28067fd4bda75abd5dc71d3735002bec47a6 about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q3_K_S.gguf
    5.35 GB
    LFS
    c887dc509effe920c14d6a87047d0982bc8e2aa6a760b429ff145266a4ee0568 about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q4_K_M.gguf
    7.28 GB
    LFS
    dd3d1ea7680d1fedcdb5760afc78ad4661aa66f0e964af3d1b514d4948352921 about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q4_K_S.gguf
    6.92 GB
    LFS
    31179cfcb7d7325404f4a983ac3f620a0ee5518a3045b3487ccf5727442d464c about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q5_K_M.gguf
    8.51 GB
    LFS
    9086465480a345a2e6f2a9c7994a4a7806dcbf85bb53159f22a108d3c3313a46 about 1 year ago
  • Hermes-2-Pro-Llama-3-13B.Q5_K_S.gguf
    8.3 GB
    LFS
    3ab22ad0a4eee948e1439ffb9414dc747dfbb52666985fbeeec15297fe034713 about 1 year ago