Further Progress in Image Recognition Based on Deep Learning: with Focus on Unsupervised Representation Learning and Transformer

Abstract

The convolutional neural network using a large number of images with ground truth had been the defacto standard in image recognition since its overwhelming victory at ILSVRC2012. However, in recent years, unsupervised representation learning and Transformer, which is a different approach from CNN, have been proposed, and image recognition based on deep learning is progressing further. In this paper, I introduce recent research trends in image recognition with a focus on unsupervised representation learning and Transformer.