1. Introduction  
2. Problem Formulation  
2.1 Algorithm Configuration  
2.2 Review Scope  
3. Classification  
3.1 Problem View  
3.2 Configurator View  
4. Model-free Methods  
5. Model-based Offline Methods  
6. Theoretical Guarantees  
7. Realtime Methods  
8. Instance-specific Methods  
9. Multi-objective Methods  
10. Dynamic Methods  
11. Research Directions  
12. Conclusion