RelaxingSnorlax commited on
Commit
7fa2b8a
·
verified ·
1 Parent(s): 79a85f1

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. recipe.yaml +19 -0
recipe.yaml ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ quant_stage:
2
+ quant_modifiers:
3
+ QuantizationModifier:
4
+ ignore: ["lm_head"]
5
+ config_groups:
6
+ group_0:
7
+ weights:
8
+ num_bits: 8
9
+ type: float
10
+ strategy: tensor
11
+ dynamic: false
12
+ symmetric: true
13
+ input_activations:
14
+ num_bits: 8
15
+ type: float
16
+ strategy: tensor
17
+ dynamic: false
18
+ symmetric: true
19
+ targets: ["Linear"]