Update README.md
Browse files
README.md
CHANGED
@@ -12,6 +12,26 @@ tags: [green, llmware-rag, p1, ov]
|
|
12 |
|
13 |
[**bling-tiny-llama**](https://huggingface.co/llmware/bling-tiny-llama-v0) is a fact-based question-answering model, optimized for complex business documents.
|
14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
|
16 |
|
17 |
Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)
|
|
|
12 |
|
13 |
[**bling-tiny-llama**](https://huggingface.co/llmware/bling-tiny-llama-v0) is a fact-based question-answering model, optimized for complex business documents.
|
14 |
|
15 |
+
Get started right away
|
16 |
+
|
17 |
+
1. Install dependencies
|
18 |
+
|
19 |
+
`pip3 install llmware`
|
20 |
+
`pip3 install openvino`
|
21 |
+
`pip3 install openvino_genai`
|
22 |
+
|
23 |
+
2. Hello World
|
24 |
+
|
25 |
+
from llmware.models import ModelCatalog
|
26 |
+
|
27 |
+
model = ModelCatalog().load_model("bling-tiny-llama-ov")
|
28 |
+
|
29 |
+
response = model.inference("The stock price is $45.\nWhat is the stock price?")
|
30 |
+
|
31 |
+
print("response: ", response)
|
32 |
+
|
33 |
+
|
34 |
+
|
35 |
Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
|
36 |
|
37 |
Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)
|