1 Introduction  
2 Evolution of Transformers from NLP to Computer Vision  
2.1 The Birth of Transformers in NLP  
2.2 The Rise of Transformers in Computer Vision  
2.3 Transformers for Videos  
3 Visual Action Transformers: Taxonomies  
3.1 Taxonomy 1: Classification based on Network Architecture  
3.2 Taxonomy 2: Action Transformers Modality  
3.3 Taxonomy 3: Action Transformer End-task  
4 The Performance Comparison, Bibliometric and Thematic Analysis  
5 Discussion and Future Directions  
6 Conclusion