Spaces:
Runtime error
Runtime error
matthoffner
commited on
Commit
•
f0b0d56
1
Parent(s):
fb6d780
Update demo.py
Browse files
demo.py
CHANGED
@@ -178,15 +178,9 @@ def get_demo():
|
|
178 |
gr.Markdown(
|
179 |
"""**Chat with [Falcon-7B-Instruct](https://huggingface.co/tiiuae/falcon-7b-instruct), brainstorm ideas, discuss your holiday plans, and more!**
|
180 |
|
181 |
-
✨ This demo is powered by [Falcon-7B](https://huggingface.co/tiiuae/falcon-7b), finetuned on the [Baize](https://github.com/project-baize/baize-chatbot) dataset, and running with [Text Generation Inference](https://github.com/huggingface/text-generation-inference).
|
182 |
|
183 |
-
🧪 This
|
184 |
-
|
185 |
-
👀 **Learn more about Falcon LLM:** [falconllm.tii.ae](https://falconllm.tii.ae/)
|
186 |
-
|
187 |
-
➡️️ **Intended Use**: this demo is intended to showcase an early finetuning of [Falcon-7B](https://huggingface.co/tiiuae/falcon-7b), to illustrate the impact (and limitations) of finetuning on a dataset of conversations and instructions. We encourage the community to further build upon the base model, and to create even better instruct/chat versions!
|
188 |
-
|
189 |
-
⚠️ **Limitations**: the model can and will produce factually incorrect information, hallucinating facts and actions. As it has not undergone any advanced tuning/alignment, it can produce problematic outputs, especially if prompted to do so. Finally, this demo is limited to a session length of about 1,000 words.
|
190 |
"""
|
191 |
)
|
192 |
|
|
|
178 |
gr.Markdown(
|
179 |
"""**Chat with [Falcon-7B-Instruct](https://huggingface.co/tiiuae/falcon-7b-instruct), brainstorm ideas, discuss your holiday plans, and more!**
|
180 |
|
181 |
+
✨ This demo is powered by [Falcon-7B](https://huggingface.co/tiiuae/falcon-7b), finetuned on the [Baize](https://github.com/project-baize/baize-chatbot) dataset, and running with [Text Generation Inference](https://github.com/huggingface/text-generation-inference).
|
182 |
|
183 |
+
🧪 This uses a quantized [ggml](https://github.com/ggerganov/ggml) optimized for CPU. Special thanks to [ggllm.cpp](https://github.com/cmp-nct/ggllm.cpp), [ctransformers](https://github.com/marella/ctransformers), and [TheBloke](https://huggingface.co/TheBloke).
|
|
|
|
|
|
|
|
|
|
|
|
|
184 |
"""
|
185 |
)
|
186 |
|