LuminaInc
/

jina-embeddings-v3

Feature Extraction

sentence-transformers

sentence-similarity

text-embeddings-inference

Model card Files Files and versions Community

Akhilesh Sharma commited on Jan 16

Commit

52fa9b8

·

1 Parent(s): 4cb41be

updated rotary

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -47,7 +47,7 @@
   "num_hidden_layers": 24,
   "output_past": true,
   "pad_token_id": 1,
-  "position_embedding_type": "rotary",
   "rotary_emb_base": 20000.0,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.2",

   "num_hidden_layers": 24,
   "output_past": true,
   "pad_token_id": 1,
+  "position_embedding_type": "rope",
   "rotary_emb_base": 20000.0,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.2",