Spaces:

Not-Grim-Refer
/

Falcoder-7b-Extended-Code-Generator

App Files Files Community

Not-Grim-Refer commited on Jun 22, 2023

Commit

465c5b4

•

1 Parent(s): 14a09b0

Update app.py

Files changed (1) hide show

app.py +1 -0

app.py CHANGED Viewed

@@ -18,6 +18,7 @@ EOS_TOKEN = "<|endoftext|>"
 UNK_TOKEN = "<|unk|>"
 MAX_INPUT_TOKENS = 1024 # max tokens from context
 tokenizer = AutoTokenizer.from_pretrained(REPO, use_auth_token=token, trust_remote_code=True)
 tokenizer.truncation_side = "left" # ensures if truncate, then keep the last N tokens of the prompt going L -> R

 UNK_TOKEN = "<|unk|>"
 MAX_INPUT_TOKENS = 1024 # max tokens from context
+REPO = "mrm8488/falcoder-7b"
 tokenizer = AutoTokenizer.from_pretrained(REPO, use_auth_token=token, trust_remote_code=True)
 tokenizer.truncation_side = "left" # ensures if truncate, then keep the last N tokens of the prompt going L -> R