jina-reranker-tiny-onnx

jina-reranker-tiny-onnx is an ONNX packaging of Jinaai/jina-reranker-v1-tiny-en, providing a very small, very fast inference implementation, optimized for AI PCs.

jina-reranker-tiny-onnx is a tiny specialized semantic reranker that ranks the similarity between a query and a text passage.

Model Description

  • Developed by: jinaai
  • Quantized by: llmware
  • Model type: jina-reranker-v1-tiny-en
  • Parameters: 65 million
  • Model Parent: jinaai/jina-reranker-v1-tiny-en
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Semantic similarity classification and ranking
  • RAG Benchmark Accuracy Score: NA
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
19
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for llmware/jina-reranker-tiny-onnx

Quantized
(3)
this model

Collection including llmware/jina-reranker-tiny-onnx