1 Introduction

2 Related Work

3 Attack Methods  
3.1 White-box Attacks  
3.2 Black-box Attacks  

4 Defense Methods  
4.1 Prompt-level Defenses  
4.2 Model-level Defenses  

5 Evaluation  
5.1 Metric  
5.2 Dataset  
5.3 Toolkit  

6 Conclusion