ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS
Attention Is All You Need
Abstract
The dominant sequence transduction models are based on complex recurrent or convolutional neural networks...
We propose a new simple network architecture, the Transformer, based solely on attention mechanisms.
Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable.