Commit
•
6a9e9e0
1
Parent(s):
8fc9f3a
Update README.md
Browse files
README.md
CHANGED
|
@@ -31,6 +31,7 @@ model-index:
|
|
| 31 |
---
|
| 32 |
|
| 33 |
**WORK IN PROGRESS** Introduction
|
|
|
|
| 34 |
This example implements the EANet model for image classification, and demonstrates it on the CIFAR-100 dataset. EANet introduces a novel attention mechanism named external attention, based on two external, small, learnable, and shared memories, which can be implemented easily by simply using two cascaded linear layers and two normalization layers. It conveniently replaces self-attention as used in existing architectures. External attention has linear complexity, as it only implicitly considers the correlations between all samples.
|
| 35 |
|
| 36 |
|
|
|
|
| 31 |
---
|
| 32 |
|
| 33 |
**WORK IN PROGRESS** Introduction
|
| 34 |
+
|
| 35 |
This example implements the EANet model for image classification, and demonstrates it on the CIFAR-100 dataset. EANet introduces a novel attention mechanism named external attention, based on two external, small, learnable, and shared memories, which can be implemented easily by simply using two cascaded linear layers and two normalization layers. It conveniently replaces self-attention as used in existing architectures. External attention has linear complexity, as it only implicitly considers the correlations between all samples.
|
| 36 |
|
| 37 |
|