HuggingFaceTB

/

SmolLM2-1.7B-Instruct-GGUF

like 39

Follow

Hugging Face Smol Models Research 1.44k

The main instruct model looks very promising and is strong and it can even do function calling, however, I have always met failure when using a gguf model (only tried llama cpp though) and function calling could never be done. Is it possible to do function calling with gguf models (perhaps some other way, other than llama.cpp)?

Thanks