Khetterman
/

DarkAtom-12B-v3-GGUF

Text Generation

creative-writing

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

Edit model card

DarkAtom-12B-v3 GGUF Quantizations 🗲

Something that shouldn't exist

This model was converted to GGUF format using llama.cpp.

For more information of the model, see the original model card: Khetterman/DarkAtom-12B-v3.

Available Quantizations (◕‿◕)

Type	Quantized GGUF Model	Size
Q2_K	Khetterman/DarkAtom-12B-v3-Q2_K.gguf	4.46 GiB
Q3_K_S	Khetterman/DarkAtom-12B-v3-Q3_K_S.gguf	5.15 GiB
Q3_K_M	Khetterman/DarkAtom-12B-v3-Q3_K_M.gguf	5.66 GiB
Q3_K_L	Khetterman/DarkAtom-12B-v3-Q3_K_L.gguf	6.11 GiB
Q4_0	Khetterman/DarkAtom-12B-v3-Q4_0.gguf	6.58 GiB
Q4_K_S	Khetterman/DarkAtom-12B-v3-Q4_K_S.gguf	6.63 GiB
Q4_K_M	Khetterman/DarkAtom-12B-v3-Q4_K_M.gguf	6.96 GiB
Q4_1	Khetterman/DarkAtom-12B-v3-Q4_1.gguf	7.25 GiB
Q5_K_S	Khetterman/DarkAtom-12B-v3-Q5_K_S.gguf	7.93 GiB
Q5_K_M	Khetterman/DarkAtom-12B-v3-Q5_K_M.gguf	8.12 GiB
Q6_K	Khetterman/DarkAtom-12B-v3-Q6_K.gguf	9.36 GiB
Q8_0	Khetterman/DarkAtom-12B-v3-Q8_0.gguf	12.1 GiB

Have a good time 🖤

Downloads last month: 404

GGUF

Model size

12.2B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for Khetterman/DarkAtom-12B-v3-GGUF

Base model

Khetterman/DarkAtom-12B-v3

Quantized

(3)

this model