File size: 297 Bytes
4e1467d 0cab14c |
1 2 3 4 5 6 7 |
# Open-source Softmax Linear Unit
Replicating the results in the paper [Softmax Linear Units](https://transformer-circuits.pub/2022/solu/index.html) published recently by Anthropic.
TODO: update this readme with:
- usage information
- how to log runs, how to use pysvelte to look at activations |