rustformers
/

bloom-ggml

Text Generation

Transformers

llm-rs

ggml

Inference Endpoints

Model card Files Files and versions Community

LLukas22 commited on May 28, 2023

Commit

61024e1

•

1 Parent(s): 68cb7bf

Generated README.md

Browse files

Files changed (1) hide show

README.md +14 -11

README.md CHANGED Viewed

@@ -13,16 +13,19 @@ BLOOM is an autoregressive Large Language Model (LLM), trained to continue text
 ## Converted Models
-| Name                                                                                                         | Based on   | Type   | Container   | Version   |
-|:-------------------------------------------------------------------------------------------------------------|:-----------|:-------|:------------|:----------|
-| [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin)               | -          | F16    | GGML        | V2        |
-| [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin)   | -          | Q4_0   | GGJT        | V2        |
-| [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin)             | -          | Q4_0   | GGML        | V2        |
-| [bloom-3b-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-f16.bin)                 | -          | F16    | GGML        | V2        |
-| [bloom-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0-ggjt.bin)     | -          | Q4_0   | GGJT        | V2        |
-| [bloom-3b-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0.bin)               | -          | Q4_0   | GGML        | V2        |
-| [bloom-560m-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-f16.bin)             | -          | F16    | GGML        | V2        |
-| [bloom-560m-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0-ggjt.bin) | -          | Q4_0   | GGJT        | V2        |
-| [bloom-560m-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0.bin)           | -          | Q4_0   | GGML        | V2        |
 ## Usage

 ## Converted Models
+| Name                                                                                                         | Based on                                                              | Type   | Container   | GGML Version   |
+|:-------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------|:-------|:------------|:---------------|
+| [bloom-3b-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0.bin)               | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b)     | Q4_0   | GGML        | V3             |
+| [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin)             | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7)   | Q4_0   | GGML        | V3             |
+| [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin)   | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7)   | Q4_0   | GGJT        | V3             |
+| [bloom-560m-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q5_1-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q5_1   | GGJT        | V3             |
+| [bloom-560m-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-f16.bin)             | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | F16    | GGML        | V3             |
+| [bloom-560m-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0   | GGJT        | V3             |
+| [bloom-3b-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-f16.bin)                 | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b)     | F16    | GGML        | V3             |
+| [bloom-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0-ggjt.bin)     | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b)     | Q4_0   | GGJT        | V3             |
+| [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin)               | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7)   | F16    | GGML        | V3             |
+| [bloom-1b7-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q5_1-ggjt.bin)   | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7)   | Q5_1   | GGJT        | V3             |
+| [bloom-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q5_1-ggjt.bin)     | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b)     | Q5_1   | GGJT        | V3             |
+| [bloom-560m-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0.bin)           | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0   | GGML        | V3             |
 ## Usage