1. Introduction
2. Methodology
2.1. Research Questions
2.2. Literature Search
2.3. Literature Selection and Quality Assessment
3. Background
3.1. Visual Transfer Learning
3.2. Knowledge Graph
3.3. Feature Extractor
3.4. Knowledge Graph Embedding
3.5. Training Objectives for Joint Embeddings
4. Visual Transfer Learning using Knowledge Graphs
4.2. Knowledge Graph as a Trainee
4.3. Knowledge Graph as a Trainer
4.4. Knowledge Graph as a Peer
5. Visual Transfer Learning Datasets and Benchmarks
5.1. Generic Knowledge Graphs
5.2. Image Datasets with Auxiliary Knowledge
5.3.2. Domain Generalization Datasets without Auxiliary Knowledge
6. Related Surveys
7. Challenges and Open Issues
8. Discussion and Conclusion