Hugging Face's logo

nm-testing
/
TinyLlama-1.1B-compressed-tensors-kv-cache-scheme

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community

No model card

Downloads last month
25,941
Safetensors
Model size
374M params
Tensor type
I64
路
F32
路
I32
路
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.