Hugging Face's logo

Spaces:
contenteaseAI
/
backup-LargeLanguageModel
Runtime error

App Files Community
ShravanHN commited on
Commit
f581f01
·
1 Parent(s): ff72e28

reverted back to llama 3

Browse files
Files changed (2) hide show
  1. app.py +1 -1
  2. requirements.txt +1 -2
app.py CHANGED
@@ -42,7 +42,7 @@ h1 {
42
  """
43
 
44
  # Load the tokenizer and model with quantization
45
- model_id = "meta-llama/Meta-Llama-3.1-8B-Instruct"
46
  bnb_config = BitsAndBytesConfig(
47
  load_in_4bit=True,
48
  bnb_4bit_use_double_quant=True,
 
42
  """
43
 
44
  # Load the tokenizer and model with quantization
45
+ model_id = "meta-llama/Meta-Llama-3-8B-Instruct"
46
  bnb_config = BitsAndBytesConfig(
47
  load_in_4bit=True,
48
  bnb_4bit_use_double_quant=True,
requirements.txt CHANGED
@@ -1,5 +1,4 @@
1
  accelerate
2
- torch
3
- transformers==4.43.1
4
  SentencePiece
5
  bitsandbytes
 
1
  accelerate
2
+ transformers==4.42.4
 
3
  SentencePiece
4
  bitsandbytes