add infinity example in the readme
#32
by
michaelfeil
- opened
README.md
CHANGED
@@ -5568,6 +5568,16 @@ print(similarities)
|
|
5568 |
# [0.31938642 0.7853526 ]]
|
5569 |
```
|
5570 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5571 |
# FAQ
|
5572 |
|
5573 |
Q: The details of training?
|
|
|
5568 |
# [0.31938642 0.7853526 ]]
|
5569 |
```
|
5570 |
|
5571 |
+
## Infinity
|
5572 |
+
|
5573 |
+
Usage with [Infinity](https://github.com/michaelfeil/infinity)
|
5574 |
+
|
5575 |
+
```bash
|
5576 |
+
docker run --gpus all -v $PWD/data:/app/.cache \
|
5577 |
+
michaelf34/infinity:0.0.69-trt-onnx \
|
5578 |
+
v2 --model-id dunzhang/stella_en_1.5B_v5 --batch-size 16 --device cuda --engine torch --port 7997
|
5579 |
+
```
|
5580 |
+
|
5581 |
# FAQ
|
5582 |
|
5583 |
Q: The details of training?
|