1. Introduction  
2. Preliminaries  
2.1 Reinforcement Learning  
2.2 Pre-training  
3. Online Pre-training  
3.1 Curiosity-driven Exploration  
3.2 Skill Discovery  
3.3 Data Coverage Maximization  
4. Offline Pre-training  
4.1 Skill Extraction  
4.2 Representation Learning  
5. Towards Generalist Agents with RL  
5.1 Visual Pre-training  
5.2 Natural Language Pre-training  
5.3 Multi-task and Multi-modal Pre-training  
5.4 Challenges & Future Directions  
6. Task Adaptation  
6.1 Representation Transfer  
6.2 Policy Transfer  
6.3 Challenges & Future Directions  
7. Conclusions and Future Perspectives