intfloat michaelfeil commited on
Commit
1a50ec2
·
verified ·
1 Parent(s): c9e87c7

Update instruction with infinity (#23)

Browse files

- Update instruction with infinity (12f5e10ae4575a6c3ef154c80e248ee3f24203c7)


Co-authored-by: Michael <[email protected]>

Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -5466,6 +5466,16 @@ print(scores.tolist())
5466
  # [[91.92853546142578, 67.5802993774414], [70.38143157958984, 92.13307189941406]]
5467
  ```
5468
 
 
 
 
 
 
 
 
 
 
 
5469
  ## Supported Languages
5470
 
5471
  This model is initialized from [xlm-roberta-large](https://huggingface.co/xlm-roberta-large)
 
5466
  # [[91.92853546142578, 67.5802993774414], [70.38143157958984, 92.13307189941406]]
5467
  ```
5468
 
5469
+ ### Infinity
5470
+
5471
+ Usage with [Infinity](https://github.com/michaelfeil/infinity):
5472
+
5473
+ ```bash
5474
+ docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" \
5475
+ michaelf34/infinity:0.0.68 \
5476
+ v2 --model-id intfloat/multilingual-e5-large-instruct --revision "main" --dtype float16 --batch-size 32 -engine torch --port 7997
5477
+ ```
5478
+
5479
  ## Supported Languages
5480
 
5481
  This model is initialized from [xlm-roberta-large](https://huggingface.co/xlm-roberta-large)