INT8 ONNX version of Felladrin/Llama-68M-Chat-v1 to use with Transformers.js.

Downloads last month
4
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the HF Inference API does not support transformers.js models with pipeline type text-generation

Model tree for Felladrin/onnx-Llama-68M-Chat-v1

Base model

JackFram/llama-68m
Quantized
(5)
this model