Feature Extraction
Transformers
Safetensors
ModularStarEncoder
custom_code
andreagurioli1995 commited on
Commit
f7df524
·
verified ·
1 Parent(s): db673b3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -48,10 +48,10 @@ code_snippet = "your code to embed here"
48
  sentence = f"{tokenizer.sep_token}{instruction_code}{tokenizer.sep_token}{code_snippet)}{tokenizer.cls_token}"
49
 
50
  #Tokenizing your sentence
51
- tokenized_sensence = tokenizer(sentence, return_tensors="pt",truncation=True, max_length=2048)
52
 
53
  #Embedding the tokenized sentence
54
- embedded_sentence = model(**sentence)
55
  ```
56
 
57
  You will get as an output three elements:
 
48
  sentence = f"{tokenizer.sep_token}{instruction_code}{tokenizer.sep_token}{code_snippet)}{tokenizer.cls_token}"
49
 
50
  #Tokenizing your sentence
51
+ tokenized_sentence = tokenizer(sentence, return_tensors="pt",truncation=True, max_length=2048)
52
 
53
  #Embedding the tokenized sentence
54
+ embedded_sentence = model(**tokenized_sentence)
55
  ```
56
 
57
  You will get as an output three elements: