Spaces:
Runtime error
Runtime error
Update app.py
Browse files
app.py
CHANGED
@@ -338,19 +338,10 @@ def http_bot(
|
|
338 |
|
339 |
|
340 |
title_markdown = """
|
341 |
-
#
|
342 |
-
[[
|
343 |
|
344 |
ONLY WORKS WITH GPU!
|
345 |
-
|
346 |
-
You can load the model with 4-bit or 8-bit quantization to make it fit in smaller hardwares. Setting the environment variable `bits` to control the quantization.
|
347 |
-
*Note: 8-bit seems to be slower than both 4-bit/16-bit. Although it has enough VRAM to support 8-bit, until we figure out the inference speed issue, we recommend 4-bit for A10G for the best efficiency.*
|
348 |
-
|
349 |
-
Recommended configurations:
|
350 |
-
| Hardware | T4-Small (16G) | A10G-Small (24G) | A100-Large (40G) |
|
351 |
-
|-------------------|-----------------|------------------|------------------|
|
352 |
-
| **Bits** | 4 (default) | 4 | 16 |
|
353 |
-
|
354 |
"""
|
355 |
|
356 |
tos_markdown = """
|
|
|
338 |
|
339 |
|
340 |
title_markdown = """
|
341 |
+
# 👩🎨 LLaVA-Docent: Large Language and Vision Assistant
|
342 |
+
[[Paper]](Not published) [[Code]](https://github.com/codingchild2424/LLaVA-Docent-v1) [[Model]](https://huggingface.co/LLaVA-Docent/llava_docent_v2) [[Dataset]](https://huggingface.co/datasets/LLaVA-Docent/llava_docent_v2)
|
343 |
|
344 |
ONLY WORKS WITH GPU!
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
345 |
"""
|
346 |
|
347 |
tos_markdown = """
|