How Much Self-Attention Do We Need? : Trading Attention for Feed-Forward Layers

Irie, Kazuki (Corresponding author); Gerstenberger, Alexander; Schlüter, Ralf; Ney, Hermann

Piscataway, NJ : IEEE (2020)
Contribution to a book, Contribution to a conference proceedings

In: 2020 IEEE International Conference on Acoustics, Speech, and Signal Processing : proceedings : May 4-8, 2020, Centre de Convencions Internacional de Barcelona (CCIB), Barcelona, Spain / sponsored by: the Institute of Electrical and Electronics Engineers, Signal Processing Society
Page(s)/Article-Nr.: 6154-6158