Some weights of BertModel were not initialized from the model checkpoint at text_model/German_Semantic_V3b and are newly initialized: ['embeddings.position_embeddings.weight']

#2
by caochengchen - opened

Why does this warning appear?
from sentence_transformers import SentenceTransformer

model = SentenceTransformer("aari1995/German_Semantic_V3b", trust_remote_code=True)

sentences = [
"Ein Mann übt Boxen",
"Ein Affe praktiziert Kampfsportarten.",
"Eine Person faltet ein Blatt Papier.",
"Eine Frau geht mit ihrem Hund spazieren."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)

[4, 4]

Owner

Hi - feel free to ignore.
So generally it is because those are replaced by Alibi (and therefore are not used).

All the best

aari1995 changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment