Feature Extraction
Transformers
Safetensors
ModularStarEncoder
custom_code
andreagurioli1995 commited on
Commit
dfa56a5
·
verified ·
1 Parent(s): a8dac07

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -10,11 +10,19 @@ tags: []
10
 
11
 
12
  ## Model Details
13
- Input should take this format when tokenized f"{tokenizer.sep_token}{code_snippet}{tokenizer.cls_token}"
14
 
15
  You can download the tokenizer following:
 
16
  from transformers import AutoTokenizer
 
17
  tokenizer = AutoTokenizer.from_pretrained("andreagurioli1995/ModularStarEncoder")
 
 
 
 
 
 
 
18
  ### Model Description
19
 
20
  <!-- Provide a longer summary of what this model is. -->
 
10
 
11
 
12
  ## Model Details
 
13
 
14
  You can download the tokenizer following:
15
+
16
  from transformers import AutoTokenizer
17
+
18
  tokenizer = AutoTokenizer.from_pretrained("andreagurioli1995/ModularStarEncoder")
19
+
20
+ Input should take this format when tokenized:
21
+
22
+ f"{tokenizer.sep_token}{code_snippet}{tokenizer.cls_token}"
23
+
24
+
25
+
26
  ### Model Description
27
 
28
  <!-- Provide a longer summary of what this model is. -->