mradermacher
/

llama-3-typhoon-v1.5x-70b-instruct-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama-3-typhoon-v1.5x-70b-instruct-i1-GGUF

1 contributor

History: 15 commits

mradermacher's picture

uploaded from nico1

93d357a verified 13 days ago

.gitattributes

2.7 kB

uploaded from nico1 13 days ago
README.md

249 Bytes

uploaded from nico1 13 days ago
imatrix.dat

24.9 MB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-IQ1_M.gguf

16.8 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-IQ2_M.gguf

24.1 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-IQ3_M.gguf

31.9 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-IQ3_XXS.gguf

27.5 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-IQ4_XS.gguf

37.9 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q2_K.gguf

26.4 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q2_K_S.gguf

24.5 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q3_K_M.gguf

34.3 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q3_K_S.gguf

30.9 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q4_K_M.gguf

42.5 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q4_K_S.gguf

40.3 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q6_K.gguf.part1of2

29 GB
LFS

uploaded from nico1 13 days ago
llama-3-typhoon-v1.5x-70b-instruct.i1-Q6_K.gguf.part2of2

28.9 GB
LFS

uploaded from nico1 13 days ago