taylorj94
/

Llama-3.2-1B

Text Generation

text-generation-inference

Model card Files Files and versions

taylorj94 commited on Dec 27, 2024

Commit

bfd2d06

·

verified ·

1 Parent(s): 1a5ec1d

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -92,4 +92,4 @@ class EndpointHandler:
         # Decode the output
         generated_text = response["choices"][0]["message"]["content"]
-        return [{"generated_text": generated_text}, allowed_token_ids, response]

         # Decode the output
         generated_text = response["choices"][0]["message"]["content"]
+        return [{"generated_text": generated_text, "allowed_token_ids": list(allowed_token_ids)}]