doberst commited on
Commit
d0c3f53
1 Parent(s): 8576eea

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -21
README.md CHANGED
@@ -1,37 +1,29 @@
1
  ---
2
  license: apache-2.0
3
  inference: false
4
- tags: [green, llmware-rag, p3,onnx]
5
  ---
6
 
7
- # bling-phi-3-onnx
8
 
9
- <!-- Provide a quick summary of what the model is/does. -->
10
-
11
- **bling-phi-3-ov** is an ONNX int4 quantized version of BLING Phi-3, providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.
12
-
13
- [**bling-phi-3**](https://huggingface.co/llmware/bling-phi-3) is a fact-based question-answering model, optimized for complex business documents.
14
-
15
- Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
16
-
17
- Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)
18
 
 
19
 
20
  ### Model Description
21
 
22
  - **Developed by:** llmware
23
- - **Model type:** phi3
24
- - **Parameters:** 3.8 billion
25
- - **Model Parent:** llmware/bling-phi-3
 
26
  - **Language(s) (NLP):** English
27
  - **License:** Apache 2.0
28
- - **Uses:** Fact-based question-answering
29
- - **RAG Benchmark Accuracy Score:** 99.5
30
- - **Quantization:** int4
31
-
32
-
33
- ## Model Card Contact
34
 
 
 
 
35
  [llmware on hf](https://www.huggingface.co/llmware)
36
-
37
  [llmware website](https://www.llmware.ai)
 
1
  ---
2
  license: apache-2.0
3
  inference: false
4
+ tags: [green, llmware-rag, p3, ov]
5
  ---
6
 
7
+ # bling-phi-3-ov
8
 
9
+ **bling-phi-3-ov** is a fast and accurate fact-based question-answering model, designed for retrieval augmented generation (RAG) with complex business documents, quantized and packaged in OpenVino int4 for AI PCs using Intel GPU, CPU and NPU.
 
 
 
 
 
 
 
 
10
 
11
+ This model is one of the most accurate in the BLING/DRAGON model series, which is especially notable given the relatively small size and is ideal for use on AI PCs and local inferencing.
12
 
13
  ### Model Description
14
 
15
  - **Developed by:** llmware
16
+ - **Model type:** phi-3
17
+ - **Parameters:** 3.8 billion
18
+ - **Quantization:** int4
19
+ - **Model Parent:** [llmware/bling-phi-3](https://www.huggingface.co/llmware/bling-phi-3)
20
  - **Language(s) (NLP):** English
21
  - **License:** Apache 2.0
22
+ - **Uses:** Fact-based question-answering, RAG
23
+ - **RAG Benchmark Accuracy Score:** 99.5
 
 
 
 
24
 
25
+
26
+ ## Model Card Contact
27
+ [llmware on github](https://www.github.com/llmware-ai/llmware)
28
  [llmware on hf](https://www.huggingface.co/llmware)
 
29
  [llmware website](https://www.llmware.ai)