change model to mistralai
2410cc6
Allen Park
commited on
Spaces:
Running
Running
Commit History
try using meta llama 3.1 8b
9f865e6
Allen Park
commited on
use quantized version of lynx 8b
84e8597
Allen Park
commited on
update requirements.txt to not have versions
39f644b
Allen Park
commited on
add .to(device) back
5724967
Allen Park
commited on
add attention mask and pad token id
76c4bfe
Allen Park
commited on
get rid of .to(device)
8275a94
Allen Park
commited on
add device=cuda; initialize tokenizer and model outside of function call; add inputs to device
60ffe71
Allen Park
commited on
pass inputs.input_ids not just inputs
b5e9a85
Allen Park
commited on
add accelerate pip package and add device_map='auto'
7d126a2
Allen Park
commited on
add 3 inputs for function and rename from greet to model_call
9d86cbe
Allen Park
commited on
add transformers pip package and remove TextIteratorStreamer from imports
e303329
Allen Park
commited on
add torch
17d56be
Allen Park
commited on
make PROMPT not hardcoded and take input values from gradio interface
090dd00
Allen Park
commited on
add .gitignore
0e15888
Allen Park
commited on
add code to call lynx model
210b40c
Allen Park
commited on
add application file
d232ed1
Allen Park
commited on
