Text Generation
Transformers
llm-rs
ggml
Inference Endpoints
bloom-ggml / README.md
LLukas22's picture
Generated README.md
173d550
|
raw
history blame
2.42 kB
metadata
tags:
  - llm-rs
  - ggml
pipeline_tag: text-generation

GGML covnerted Models of BigScience's Bloom models

Description

BLOOM is an autoregressive Large Language Model (LLM), trained to continue text from a prompt on vast amounts of text data using industrial-scale computational resources. As such, it is able to output coherent text in 46 languages and 13 programming languages that is hardly distinguishable from text written by humans. BLOOM can also be instructed to perform text tasks it hasn't been explicitly trained for, by casting them as text generation tasks.

Converted Models

Name Based on Type Container Version
bloom-1b7-f16.bin - F16 GGML V2
bloom-1b7-q4_0-ggjt.bin - Q4_0 GGJT V2
bloom-1b7-q4_0.bin - Q4_0 GGML V2
bloom-3b-f16.bin - F16 GGML V2
bloom-3b-q4_0-ggjt.bin - Q4_0 GGJT V2
bloom-3b-q4_0.bin - Q4_0 GGML V2
bloom-560m-f16.bin - F16 GGML V2
bloom-560m-q4_0-ggjt.bin - Q4_0 GGJT V2
bloom-560m-q4_0.bin - Q4_0 GGML V2

Usage