1. Introduction  
2. Background  
3. Least-squares-based extensions to eligibility traces and off-policy learning  
4. Stochastic gradient based extensions to eligibility traces and off-policy learning  
5. Empirical Study  
6. Conclusion and Future Work