Paper2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy et al.
Shows a pure transformer applied to sequences of image patches, with no convolutions, matches or beats CNNs on image classification once pretrained on enough data.
22 pageslink checked 17 Sept 2026FreeAdvanced