doberst commited on
Commit
19ba147
·
verified ·
1 Parent(s): 595a3f3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -12,6 +12,26 @@ tags: [green, llmware-rag, p1, ov]
12
 
13
  [**bling-tiny-llama**](https://huggingface.co/llmware/bling-tiny-llama-v0) is a fact-based question-answering model, optimized for complex business documents.
14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
16
 
17
  Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)
 
12
 
13
  [**bling-tiny-llama**](https://huggingface.co/llmware/bling-tiny-llama-v0) is a fact-based question-answering model, optimized for complex business documents.
14
 
15
+ Get started right away
16
+
17
+ 1. Install dependencies
18
+
19
+ `pip3 install llmware`
20
+ `pip3 install openvino`
21
+ `pip3 install openvino_genai`
22
+
23
+ 2. Hello World
24
+
25
+ from llmware.models import ModelCatalog
26
+
27
+ model = ModelCatalog().load_model("bling-tiny-llama-ov")
28
+
29
+ response = model.inference("The stock price is $45.\nWhat is the stock price?")
30
+
31
+ print("response: ", response)
32
+
33
+
34
+
35
  Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
36
 
37
  Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)