Hugging Face's logo

nm-testing
/
TinyLlama-1.1B-Chat-v1.0-W8A16-e2e

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
nm-autobot commited on
Commit
a03bec1
·
verified ·
1 Parent(s): be7bb4a

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. model.safetensors +1 -1
  2. recipe.yaml +1 -1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c92e5a3de86e62cd5a3b885ae32d70894a1d528c7a8776f9664e23e554160322
3
  size 1232060880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:623323e0b37bc2d08746bc4699aa009ee56e5126c24b063920982129dcfc034a
3
  size 1232060880
recipe.yaml CHANGED
@@ -1,6 +1,6 @@
1
  DEFAULT_stage:
2
  DEFAULT_modifiers:
3
  GPTQModifier:
 
4
  targets: Linear
5
  ignore: [lm_head]
6
- scheme: W8A16
 
1
  DEFAULT_stage:
2
  DEFAULT_modifiers:
3
  GPTQModifier:
4
+ scheme: W8A16
5
  targets: Linear
6
  ignore: [lm_head]