Blazer007 commited on
Commit
73d3b04
1 Parent(s): e8ff12a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -2
README.md CHANGED
@@ -9,7 +9,16 @@ tags:
9
 
10
  ## Model description
11
 
12
- More information needed
 
 
 
 
 
 
 
 
 
13
 
14
  ## Intended uses & limitations
15
 
@@ -17,7 +26,7 @@ More information needed
17
 
18
  ## Training and evaluation data
19
 
20
- More information needed
21
 
22
  ## Training procedure
23
 
 
9
 
10
  ## Model description
11
 
12
+ ### Image classification with ConvMixer
13
+
14
+ [Keras Example Link](https://keras.io/examples/vision/convmixer/)
15
+
16
+ In the [Patches Are All You Need paper](https://arxiv.org/abs/2201.09792), the authors extend the idea of using patches to train an all-convolutional network and demonstrate competitive results. Their architecture namely ConvMixer uses recipes from the recent isotrophic architectures like ViT, MLP-Mixer (Tolstikhin et al.), such as using the same depth and resolution across different layers in the network, residual connections, and so on.
17
+
18
+ ConvMixer is very similar to the MLP-Mixer, model with the following key differences: Instead of using fully-connected layers, it uses standard convolution layers. Instead of LayerNorm (which is typical for ViTs and MLP-Mixers), it uses BatchNorm.
19
+
20
+ Full Credits to <a href = "https://twitter.com/RisingSayak" target='_blank'> Sayak Paul </a> for this work.
21
+
22
 
23
  ## Intended uses & limitations
24
 
 
26
 
27
  ## Training and evaluation data
28
 
29
+ Trained and evaluated on [CIFAR-10](https://keras.io/api/datasets/cifar10/) dataset.
30
 
31
  ## Training procedure
32