1 Introduction  
2 Definitions  
2.1 Language Theoretic  
3 Results  
3.1 Convolutional Neural Networks  
3.2 Recurrent Neural Networks  
3.3 Transformer Networks  
3.4 Memory Augmented Neural Networks  
4 Summary