string: Most of the training parameters were fixed for all experiments: Adam [17] was used for optimisation with a learning rate of 10‚àí4 and asynchronous updates on 16 threads using the Hogwild! algorithm [23]; the initial halting unit bias mentioned in Equation (5) was 1; and the term from Equation (7) was 0.01.