Update app.py
Browse files
app.py
CHANGED
@@ -337,33 +337,19 @@ def http_bot(
|
|
337 |
|
338 |
|
339 |
title_markdown = """
|
340 |
-
|
341 |
-
[[Project Page]](https://llava-vl.github.io) [[Paper]](https://arxiv.org/abs/2304.08485) [[Code]](https://github.com/haotian-liu/LLaVA) [[Model]](https://github.com/haotian-liu/LLaVA/blob/main/docs/MODEL_ZOO.md)
|
342 |
-
|
343 |
-
ONLY WORKS WITH GPU!
|
344 |
-
|
345 |
-
You can load the model with 4-bit or 8-bit quantization to make it fit in smaller hardwares. Setting the environment variable `bits` to control the quantization.
|
346 |
-
*Note: 8-bit seems to be slower than both 4-bit/16-bit. Although it has enough VRAM to support 8-bit, until we figure out the inference speed issue, we recommend 4-bit for A10G for the best efficiency.*
|
347 |
-
|
348 |
-
Recommended configurations:
|
349 |
-
| Hardware | T4-Small (16G) | A10G-Small (24G) | A100-Large (40G) |
|
350 |
-
|-------------------|-----------------|------------------|------------------|
|
351 |
-
| **Bits** | 4 (default) | 4 | 16 |
|
352 |
|
353 |
"""
|
354 |
|
355 |
tos_markdown = """
|
356 |
-
###
|
357 |
-
|
358 |
-
|
359 |
-
Please click the "Flag" button if you get any inappropriate answer! We will collect those to keep improving our moderator.
|
360 |
-
For an optimal experience, please use desktop computers for this demo, as mobile devices may compromise its quality.
|
361 |
"""
|
362 |
|
363 |
|
364 |
learn_more_markdown = """
|
365 |
-
|
366 |
-
The service is a research preview intended for non-commercial use only, subject to the model [License](https://github.com/facebookresearch/llama/blob/main/MODEL_CARD.md) of LLaMA, [Terms of Use](https://openai.com/policies/terms-of-use) of the data generated by OpenAI, and [Privacy Practices](https://chrome.google.com/webstore/detail/sharegpt-share-your-chatg/daiacboceoaocpibfodeljbdfacokfjb) of ShareGPT. Please contact us if you find any potential violation.
|
367 |
"""
|
368 |
|
369 |
block_css = """
|
|
|
337 |
|
338 |
|
339 |
title_markdown = """
|
340 |
+
Image to Text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
341 |
|
342 |
"""
|
343 |
|
344 |
tos_markdown = """
|
345 |
+
### Instructions
|
346 |
+
|
347 |
+
Upload an image and enter a task such as, "Describe the image in one paragraph".
|
|
|
|
|
348 |
"""
|
349 |
|
350 |
|
351 |
learn_more_markdown = """
|
352 |
+
|
|
|
353 |
"""
|
354 |
|
355 |
block_css = """
|