whatsthispdf05 / start_service.sh
mitulagr2's picture
Update to tinyllama
4399f8b
raw
history blame
196 Bytes
#!/bin/sh
# Start Ollama in the background
ollama serve &
# Wait for Ollama to start
sleep 5
# Pull and run <YOUR_MODEL_NAME>
ollama pull tinyllama
#
fastapi run /code/app/main.py --port 7860