Hugging Face's logo

Spaces:
HugoVoxx
/
GeoGenSolve
Sleeping

App Files
HugoVoxx commited on
Commit
8566641
·
verified ·
1 Parent(s): b677861

Upload 2 files

Browse files
Files changed (2) hide show
  1. aglib/meliad/transformer/configs/tasks/pg19_bytes.gin +9 -0
  2. aglib/meliad/transformer/configs/tasks/pg19_tokens.gin +9 -0
aglib/meliad/transformer/configs/tasks/pg19_bytes.gin ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+
2
+ NUM_EMBEDDINGS = 260
3
+
4
+ # Configure the input task.
5
+ decoder_stack.TransformerTaskConfig:
6
+ dataset_name = "pg19_bytes"
7
+
8
+ training_loop.Trainer:
9
+ num_steps = 500_000
aglib/meliad/transformer/configs/tasks/pg19_tokens.gin ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+
2
+ NUM_EMBEDDINGS = 32128
3
+
4
+ # Configure the input task.
5
+ decoder_stack.TransformerTaskConfig:
6
+ dataset_name = "pg19_tokens"
7
+
8
+ training_loop.Trainer:
9
+ num_steps = 500_000