1 INTRODUCTION

2 EVOLUTIONARY FROM TRADITIONAL TROJAN TO NEURAL NETWORK TROJAN  
2.1 The Traditional Trojan  
2.2 The Emerging Neural Network Trojan Attacks  
2.3 Relations between Traditional Trojan and Neural Network Trojan  

3 TROJAN ATTACKS TO DEEP NEURAL NETWORKS  
3.1 Cause of Neural Network Trojans  
3.2 State-of-the-Art Trojans on DNN  
3.3 Comparisons of DNN Trojans  
3.4 Research Challenges on Trojan Attacks  

4 DETECTION METHODS AGAINST NEURAL NETWORK TROJANS  
4.1 Principle of Trojan Detection  
4.2 State-of-the-Art Detection Methods  
4.3 Comparisons of Trojan Detection Methods  
4.4 Research Challenges on Trojan Detection  

5 DEFENSE METHODS AGAINST NEURAL NETWORK TROJANS  
5.1 Principle of Trojan Defense  
5.2 State-of-the-Art Defense Methods  
5.3 Comparisons of Trojan Defense Methods  
5.4 Research Challenges on Trojan Defense  

6 CONCLUSION