1 Introduction  
2 Related Surveys  
3 Human-in-the-Loop NLP Tasks  
3.1 Text Classification  
3.2 Parsing and Entity Linking  
3.3 Topic Modeling  
3.4 Summarization and Machine Translation  
3.5 Dialogue and Question Answering  
4 Human-in-the-Loop Goals  
5 Human-machine Interaction  
5.1 Interaction Mediums  
5.2 User Feedback Types  
5.3 Counterfactual Example Feedback  
5.4 Intelligent Interaction  
6 How to Use User Feedback  
6.1 Data Augmentation  
6.2 Model Direct Manipulation  
7 Research Directions & Open Problems  
7.1 Broader Roles of HITL NLP System  
7.2 Human-centered System Design  
8 Conclusion