1 Introduction  
2 Overview  
2.1 Problem Definition and Annotations  
2.2 Recent Challenges in Applying RL  
2.3 Typology of Approaches  
3 Environment  
4 Policy  
5 State Space  
6 Action Space  
7 Reward Learning  
8 Future Direction  
9 Conclusion