Spaces:

shorecode
/

gradio-3

Sleeping

Kevin Fink commited on Dec 7, 2024

Commit

d9a6e5a

1 Parent(s): e643487

dev

Files changed (1) hide show

app.py CHANGED Viewed

@@ -94,7 +94,7 @@ def fine_tune_model(model, dataset_name, hub_id, api_key, num_epochs, batch_size
                 model_inputs = tokenizer(
                     examples['text'],
                     max_length=max_length,  # Set to None for dynamic padding
-                    truncation='max_length',
                 )
                 # Setup the decoder input IDs (shifted right)

                 model_inputs = tokenizer(
                     examples['text'],
                     max_length=max_length,  # Set to None for dynamic padding
+                    truncation=True,
                 )
                 # Setup the decoder input IDs (shifted right)