add infinity example in the readme

#32
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -5568,6 +5568,16 @@ print(similarities)
5568
  # [0.31938642 0.7853526 ]]
5569
  ```
5570
 
 
 
 
 
 
 
 
 
 
 
5571
  # FAQ
5572
 
5573
  Q: The details of training?
 
5568
  # [0.31938642 0.7853526 ]]
5569
  ```
5570
 
5571
+ ## Infinity
5572
+
5573
+ Usage with [Infinity](https://github.com/michaelfeil/infinity)
5574
+
5575
+ ```bash
5576
+ docker run --gpus all -v $PWD/data:/app/.cache \
5577
+ michaelf34/infinity:0.0.69-trt-onnx \
5578
+ v2 --model-id dunzhang/stella_en_1.5B_v5 --batch-size 16 --device cuda --engine torch --port 7997
5579
+ ```
5580
+
5581
  # FAQ
5582
 
5583
  Q: The details of training?