This is the gguf format of DavidLanz/Taiwan-tinyllama-v1.0-chat link : https://huggingface.co/DavidLanz/Taiwan-tinyllama-v1.0-chat

This model works fine in the LLM Farm iOS app (test in iPhone 14 pro).

GGUF

Model size

1.1B params

Architecture

llama

8-bit

Inference API

Unable to determine this model's library. Check the docs .