Spaces:

qgyd2021
/

nx_denoise

Running

HoneyTian commited on Mar 3

Commit

413efc4

1 Parent(s): a2985be

update

Files changed (1) hide show

toolbox/torchaudio/models/nx_clean_unet/transformer/transformer.py CHANGED Viewed

@@ -49,7 +49,7 @@ class TransformerEncoderLayer(nn.Module):
                  ):
         super().__init__()
         self.norm1 = nn.LayerNorm(input_dim, eps=1e-5)
-        self.attention = RelativeMultiHeadedAttention(
             n_head=n_heads,
             n_feat=input_dim,
             dropout_rate=dropout_rate,

                  ):
         super().__init__()
         self.norm1 = nn.LayerNorm(input_dim, eps=1e-5)
+        self.attention = RelativeMultiHeadSelfAttention(
             n_head=n_heads,
             n_feat=input_dim,
             dropout_rate=dropout_rate,