Attention Mechanism: from NLP to Computer Vision

In this article, we discuss the Attention mechanism and trace its history of use from natural language processing to computer vision. And finally, we will examine transformers and their application in computer vision.