Hugging Face's logo

stan-hua
/
Meta-Llama-3.2-3B-Instruct-LC-RTN-W8A8

Safetensors
llama
8-bit precision
compressed-tensors
Model card Files Community
Meta-Llama-3.2-3B-Instruct-LC-RTN-W8A8
File size: 127 Bytes 
9e9830a
 
 
 
 
 
 
1
2
3
4
5
6
7
 
DEFAULT_stage:
  DEFAULT_modifiers:
    QuantizationModifier:
      ignore: [lm_head]
      targets: Linear
      scheme: W8A8