mradermacher
/

Azathoth-16x7B-bf16-GGUF

Mixture of Experts

Inference Endpoints

Model card Files Files and versions Community

Azathoth-16x7B-bf16-GGUF

1 contributor

History: 14 commits

mradermacher's picture

uploaded from nico1

f2c733e verified about 1 month ago

.gitattributes

2.55 kB

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q2_K.gguf

33.3 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q3_K_L.gguf

47.4 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q3_K_M.gguf

43.8 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q3_K_S.gguf

39.5 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q4_K_M.gguf.part1of2

27.9 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q4_K_M.gguf.part2of2

27.7 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q4_K_S.gguf.part1of2

26.8 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q4_K_S.gguf.part2of2

25.3 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q5_K_S.gguf.part1of2

32.2 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q5_K_S.gguf.part2of2

30.9 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q6_K.gguf.part1of2

38.7 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q6_K.gguf.part2of2

36.7 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q8_0.gguf.part1of2

49.4 GB
LFS

uploaded from nico1 about 1 month ago
Azathoth-16x7B-bf16.Q8_0.gguf.part2of2

48.2 GB
LFS

uploaded from nico1 about 1 month ago
README.md

2.65 kB

auto-patch README.md about 1 month ago