1 Introduction

2 What linguistic information is captured in neural networks  
2.1 Methods  
2.2 Linguistic phenomena  
2.3 Neural network components  
2.4 Limitations  

3 Visualization

4 Challenge sets

5 Adversarial examples

6 Explaining predictions

7 Other methods

8 Conclusion