turingevo commited on
Commit
f96d48c
·
verified ·
1 Parent(s): bb4a659

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: BAAI/bge-base-zh-v1.5
3
+ language:
4
+ - zh
5
+ license: mit
6
+ tags:
7
+ - sentence-transformers
8
+ - feature-extraction
9
+ - sentence-similarity
10
+ - transformers
11
+ - openvino
12
+ - nncf
13
+ - 8-bit
14
+ ---
15
+
16
+ This model is a quantized version of [`BAAI/bge-base-zh-v1.5`](https://huggingface.co/BAAI/bge-base-zh-v1.5) and is converted to the OpenVINO format. This model was obtained via the [nncf-quantization](https://huggingface.co/spaces/echarlaix/nncf-quantization) space with [optimum-intel](https://github.com/huggingface/optimum-intel).
17
+
18
+ First make sure you have `optimum-intel` installed:
19
+
20
+ ```bash
21
+ pip install optimum[openvino]
22
+ ```
23
+
24
+ To load your model you can do as follows:
25
+
26
+ ```python
27
+ from optimum.intel import OVModelForFeatureExtraction
28
+
29
+ model_id = "turingevo/bge-base-zh-v1.5-openvino-8bit"
30
+ model = OVModelForFeatureExtraction.from_pretrained(model_id)
31
+ ```