1 Introduction
1.1 Supervised and Unsupervised Learning
1.2 Self-supervised Learning
1.3 Outline
1.4 Notation
2 Pretext Task Methods
2.1 Autoencoders
2.2 Rotation Network (RotNet)
2.3 Solving Jigsaw Puzzles
2.4 Masked Autoencoders (MAE)
3 Information Maximization Methods
4 Teacher-Student Methods
5 Contrastive Representation Learning
6 Clustering-based Methods
7 Taxonomy of Representation Learning Methods
8 Meta-Study of Quantitative Results
8.1 Evaluation of Representation Learning Methods
8.2 Future Directions
9 Conclusion