Not-For-All-Audiences

Eval Results

Inference Endpoints

Model card Files Files and versions Community

Quantum-Citrus-9B-GGUF-IQ-Imatrix

1 contributor

History: 17 commits

ABX-AI

Update README.md

b9f2a4f verified 10 months ago

.gitattributes

3.01 kB

Rename Quantum-Citrus-v2-9B-Q6_K-imat.gguf to Quantum-Citrus-9B-Q6_K-imat.gguf 10 months ago
Quantum-Citrus-9B-IQ3_M-imat.gguf

4.06 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ3_M-imat.gguf to Quantum-Citrus-9B-IQ3_M-imat.gguf 10 months ago
Quantum-Citrus-9B-IQ3_S-imat.gguf

3.94 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ3_S-imat.gguf to Quantum-Citrus-9B-IQ3_S-imat.gguf 10 months ago
Quantum-Citrus-9B-IQ3_XXS-imat.gguf

3.5 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ3_XXS-imat.gguf to Quantum-Citrus-9B-IQ3_XXS-imat.gguf 10 months ago
Quantum-Citrus-9B-IQ4_NL-imat.gguf

5.11 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ4_NL-imat.gguf to Quantum-Citrus-9B-IQ4_NL-imat.gguf 10 months ago
Quantum-Citrus-9B-IQ4_XS-imat.gguf

4.84 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ4_XS-imat.gguf to Quantum-Citrus-9B-IQ4_XS-imat.gguf 10 months ago
Quantum-Citrus-9B-Q4_K_M-imat.gguf

5.42 GB
LFS

Rename Quantum-Citrus-v2-9B-Q4_K_M-imat.gguf to Quantum-Citrus-9B-Q4_K_M-imat.gguf 10 months ago
Quantum-Citrus-9B-Q4_K_S-imat.gguf

5.13 GB
LFS

Rename Quantum-Citrus-v2-9B-Q4_K_S-imat.gguf to Quantum-Citrus-9B-Q4_K_S-imat.gguf 10 months ago
Quantum-Citrus-9B-Q5_K_M-imat.gguf

6.36 GB
LFS

Rename Quantum-Citrus-v2-9B-Q5_K_M-imat.gguf to Quantum-Citrus-9B-Q5_K_M-imat.gguf 10 months ago
Quantum-Citrus-9B-Q5_K_S-imat.gguf

6.2 GB
LFS

Rename Quantum-Citrus-v2-9B-Q5_K_S-imat.gguf to Quantum-Citrus-9B-Q5_K_S-imat.gguf 10 months ago
Quantum-Citrus-9B-Q6_K-imat.gguf

7.37 GB
LFS

Rename Quantum-Citrus-v2-9B-Q6_K-imat.gguf to Quantum-Citrus-9B-Q6_K-imat.gguf 10 months ago
README.md

5.62 kB

Update README.md 10 months ago
imatrix.dat

6.24 MB
LFS

Upload 11 files 10 months ago