1 INTRODUCTION

2 DEFINITIONS AND BACKGROUND  
2.1 Markov decision process  
2.2 Definition of intrinsic motivation  
2.3 A model of RL with intrinsic rewards  
2.4 Intrinsic rewards and information theory  
2.5 Decisions and hierarchical RL  
2.6 Goal-parameterized RL  
2.7 Efficient learning with goal relabelling

3 CHALLENGES OF DRL  
3.1 Sparse rewards  
3.2 Temporal abstraction of actions

4 CLASSIFICATION OF METHODS

5 SURPRISE

6 NOVELTY MAXIMIZATION

7 SKILL LEARNING

8 OUTLOOKS OF THE DOMAIN  
8.1 Long-term exploration, detachment and derailment  
8.2 Deeper hierarchy of skills  
8.3 The role of flat intrinsic motivations

9 CONCLUSION