Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Hermes-2-Pro-Llama-3-13B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
conversational
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
5ce9103
Hermes-2-Pro-Llama-3-13B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
9ebab81e898696182aa38ce161005488e83512ab8a696ce7a7e7a6850d0e465c
5ce9103
verified
7 months ago
.gitattributes
Safe
2.24 kB
9ebab81e898696182aa38ce161005488e83512ab8a696ce7a7e7a6850d0e465c
7 months ago
Hermes-2-Pro-Llama-3-13B.Q2_K.gguf
Safe
4.62 GB
LFS
6a201766a663da22b74547da1817a4025d59b422ae86d143975b7e4791999092
7 months ago
Hermes-2-Pro-Llama-3-13B.Q3_K_L.gguf
Safe
6.38 GB
LFS
39f750dae90cd03c874ad8b7b80b3c9a9dfaa501edd25269c7c180cccd0d492d
7 months ago
Hermes-2-Pro-Llama-3-13B.Q3_K_M.gguf
Safe
5.9 GB
LFS
f6ffa93fdcf102158a8e7bdbfa6b28067fd4bda75abd5dc71d3735002bec47a6
7 months ago
Hermes-2-Pro-Llama-3-13B.Q3_K_S.gguf
Safe
5.35 GB
LFS
c887dc509effe920c14d6a87047d0982bc8e2aa6a760b429ff145266a4ee0568
7 months ago
Hermes-2-Pro-Llama-3-13B.Q4_K_M.gguf
Safe
7.28 GB
LFS
dd3d1ea7680d1fedcdb5760afc78ad4661aa66f0e964af3d1b514d4948352921
7 months ago
Hermes-2-Pro-Llama-3-13B.Q4_K_S.gguf
Safe
6.92 GB
LFS
31179cfcb7d7325404f4a983ac3f620a0ee5518a3045b3487ccf5727442d464c
7 months ago
Hermes-2-Pro-Llama-3-13B.Q5_K_M.gguf
Safe
8.51 GB
LFS
9086465480a345a2e6f2a9c7994a4a7806dcbf85bb53159f22a108d3c3313a46
7 months ago
Hermes-2-Pro-Llama-3-13B.Q5_K_S.gguf
Safe
8.3 GB
LFS
3ab22ad0a4eee948e1439ffb9414dc747dfbb52666985fbeeec15297fe034713
7 months ago
Hermes-2-Pro-Llama-3-13B.Q6_K.gguf
Safe
9.82 GB
LFS
bf1d14ea858f38d1deee3e5dee6e0a9b4ef043fbad899ffeac994ed0ef1cf067
7 months ago
Hermes-2-Pro-Llama-3-13B.Q8_0.gguf
Safe
12.7 GB
LFS
9ebab81e898696182aa38ce161005488e83512ab8a696ce7a7e7a6850d0e465c
7 months ago
