mradermacher
/

TinyLlama-1.1B-32k-Instruct-i1-GGUF

Model card Files Files and versions

TinyLlama-1.1B-32k-Instruct-i1-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 18 commits

mradermacher's picture

uploaded from rain

3f9f7ef verified 8 months ago

.gitattributes

2.75 kB

uploaded from rain 8 months ago
README.md

250 Bytes

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-IQ1_M.gguf

290 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-IQ2_M.gguf

400 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-IQ2_XS.gguf

352 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-IQ2_XXS.gguf

323 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-IQ3_M.gguf

516 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-IQ3_XXS.gguf

445 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-IQ4_XS.gguf

606 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q2_K.gguf

432 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q2_K_S.gguf

402 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q3_K_L.gguf

592 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q3_K_M.gguf

548 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q3_K_S.gguf

499 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q4_K_M.gguf

668 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q4_K_S.gguf

640 MB
xet

uploaded from rain 8 months ago
TinyLlama-1.1B-32k-Instruct.i1-Q6_K.gguf

903 MB
xet

uploaded from rain 8 months ago
imatrix.dat

1.58 MB
xet

uploaded from rain 8 months ago