INT8 ONNX version of Felladrin/Llama-68M-Chat-v1 to use with Transformers.js.

Downloads last month
17
Inference Examples
Inference API (serverless) does not yet support transformers.js models for this pipeline type.

Model tree for Felladrin/onnx-Llama-68M-Chat-v1

Base model

JackFram/llama-68m
Quantized
(5)
this model