1. Introduction  
2. Overview  
2.1 Comparing Traditional Recipe  
2.2 Relation to Data Augmentation (DA)  
2.3 Survey Scope  
3. Knowledge Distillation Algorithms  
3.1 Knowledge  
3.2 Distillation  
4. Skill Distillation  
4.1 Context Following  
4.2 Alignment  
4.3 Agent  
4.4 NLP Task Specialization  
4.5 Multi-Modality  
5. Domain-Specified Vertical Distillation  
5.1 Law  
5.2 Medical and Healthcare  
5.3 Finance  
5.4 Science  
5.5 Miscellaneous  
7. Conclusion and Discussion