Abstract: Transformers are increasingly popular in computer vision, which treat an image as a sequence of image patches and learn robust global features from the sequence. However, pure transformers ...