celinelee commited on
Commit
f556ab5
1 Parent(s): 3b77a8e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -5
README.md CHANGED
@@ -1,8 +1,16 @@
1
- model: `facebook/bart-large`
2
- max position embeddings: 2048
 
 
 
 
 
 
 
3
  dataset: RISC -> ARM cloze training data
4
- LR: 3e-4, 520k steps
5
 
 
 
6
  Inference:
7
- beam size 20, top-100, gets 34 / 45 of the Project Euler test set.
8
- (ensure that `no_repeat_ngram_size`=0)
 
1
+ ```
2
+ {
3
+ model: facebook/bart-large,
4
+ max_position_embeddings: 2048,
5
+ learning_rate: 3e-4,
6
+ no_repeat_ngram_size: 0
7
+ num_steps: 520000
8
+ }
9
+ ```
10
  dataset: RISC -> ARM cloze training data
 
11
 
12
+
13
+
14
  Inference:
15
+
16
+ beam size 20, top-100, gets 34 / 45 of the Project Euler test set.