michaelfeil commited on
Commit
2371792
·
verified ·
1 Parent(s): 55611d7

Update Usage with Infinity section

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -414,6 +414,13 @@ async def main():
414
  asyncio.run(main())
415
  ```
416
 
 
 
 
 
 
 
 
417
  ## Evaluation
418
 
419
  `baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**
 
414
  asyncio.run(main())
415
  ```
416
 
417
+ For a docker based deployment:
418
+ ```bash
419
+ docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" \
420
+ michaelf34/infinity:0.0.68 \
421
+ v2 --model-id BAAI/bge-reranker-base --revision "main" --dtype float16 --batch-size 32 --engine torch --port 7997
422
+ ```
423
+
424
  ## Evaluation
425
 
426
  `baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**