ABX-AI
/

phi-2-orange-v2-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

ABX-AI commited on Apr 18, 2024

Commit

17c9dde

·

verified ·

1 Parent(s): 1113201

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -125,7 +125,7 @@ model-index:
 >I like the Phi-2 variants, and noticed there isn't a single repo that offers GGUF with a full range of sizes.
 >I quantized this model for myself, but also for anyone else interested.
->It includes a good variety of small quants + Q6_K, Q8_0 + F16, all with importance matrix.
 ### ORIGINAL DESCRIPTION:

 >I like the Phi-2 variants, and noticed there isn't a single repo that offers GGUF with a full range of sizes.
 >I quantized this model for myself, but also for anyone else interested.
+>It includes a good variety of small quants + Q6_K, Q8_0, F16 + Imatrix.
 ### ORIGINAL DESCRIPTION: