Model Card for Model ID
Here is original model https://huggingface.co/aihub-app/zyte-1B
LM Studio - https://lmstudio.ai (Fully Supported, make sure you select Zypher template format for inference with model.)
We have chosen to upload our model exclusively in the Q8 format, taking into account its compact size. This decision strikes an optimal balance between speed, performance, and memory usage, ensuring efficient and effective utilization of resources.
Model Card Authors
Special thanks to Venkatesh Siddi for his invaluable support in the conversion of the model to the GGUF format. His expertise and assistance have been instrumental in this process. Connect with him on LinkedIn: https://www.linkedin.com/in/venkycs/
- Downloads last month
- 2