Attention is all you need
Attention is all you need
A quiet interpretation of the world's most famous paper.
History
This paper got released in 2017 and no longer after it did we discovered the emergent behaviors in transformers that set the ai era on fireworks. But to get here there had been quite some progress in the NLP research circles and to truly understand how we got here we’d have to start from the begining.