Update README.md
Browse files
README.md
CHANGED
@@ -13,3 +13,20 @@ This model card accompanies the research paper, [Reversal Blessing: Thinking Bac
|
|
13 |
|
14 |
Here we release 4 models' checkpoints trained with simulation data described in out paper Section 4.
|
15 |
Please follow our github README to download and evaluate these models.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
Here we release 4 models' checkpoints trained with simulation data described in out paper Section 4.
|
15 |
Please follow our github README to download and evaluate these models.
|
16 |
+
|
17 |
+
|
18 |
+
<div align="center">
|
19 |
+
|
20 |
+
### Results of the Controlled Simulation Study of 4-Digits Multiplication
|
21 |
+
|
22 |
+
| || **Forward X** | || **Reverse X** | |
|
23 |
+
|:--|:--:|:--:|:--:|:--:|:--:|:--:|
|
24 |
+
| | **L2R** | **R2L(m,n)** | **R2L(m)** | **R2L** | **L2R(m,n)** | **L2R(n)** |
|
25 |
+
| **Test Accuracy (%)** | **99.81±0.15** | 59.71±1.99 | 60.93±0.88 | **100±0** | 97.82±0.35 | 99.85±0.10 |
|
26 |
+
| **Train Accuracy (%)** | **99.76±0.15** | 59.03±1.66 | 61.22±1.12 | **100±0** | 97.90±0.42 | 99.98±0.04 |
|
27 |
+
| **Test Cond. Ent. (nats)** | 0.06 | 1.18 | 0.08 | 0 | 0.84 | 0.01 |
|
28 |
+
| **Train Cond. Ent. (nats)** | 0.06 | 1.17 | 0.08 | 0 | 0.83 | 0.01 |
|
29 |
+
| **Theo. Cond. Ent. (nats)** | 0 | 1.49 | 0 | 0 | 1.49 | 0 |
|
30 |
+
| **Training loss** | **0.86** | 0.94 | 0.94 | **0.86** | 0.94 | 0.94 |
|
31 |
+
|
32 |
+
</div>
|