ayjays132 commited on
Commit
5bda505
1 Parent(s): 8efbdc5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -2
README.md CHANGED
@@ -1,3 +1,47 @@
1
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ model_configuration:
2
+ model_filename: dynamic_network.pth
3
+ max_neurons: 750000
4
+ epochs: 50
5
+ clip: 5
6
+ patience: 7
7
+ adaptation_rate: 0.05
8
+ sequence_length: 200
9
+ max_sequence_length: 200
10
+ weight_decay: 0.005
11
+ num_embeddings: 25000
12
+ embedding_dim: 768
13
+ hidden_dim: 2048
14
+ learning_rate: 0.00001
15
+ some_intermediate_size: 3072
16
+
17
+ hyperparameters:
18
+ input_dimension: 768
19
+ initial_neuron_count: 5000
20
+ some_adaptation_rate: 0.05
21
+ complexity_metric: null
22
+
23
+ additional_hyperparameters:
24
+ growth_improvement_threshold: 0.01
25
+ pruning_improvement_threshold: 0.005
26
+ stability_threshold: 0.02
27
+ max_complexity: 10000
28
+ low_stability_threshold: 0.01
29
+ min_epochs_before_growth: 5
30
+ desired_improvement_rate: 0.02
31
+ max_sequence_length: 200
32
+
33
  license: apache-2.0
34
+
35
+ datasets:
36
+ - vicgalle/alpaca-gpt4
37
+
38
+ language:
39
+ - en
40
+
41
+ library_name: transformers
42
+
43
+ tags:
44
+ - text-generation-inference
45
+
46
+ metrics:
47
+ - accuracy