1 INTRODUCTION

2 OVERVIEW  
2.1 Preliminaries  
2.2 Limitations  
2.3 Taxonomy  

3 EFFICIENT ATTENTION  

4 LONG-TERM MEMORY  

5 EXTRAPOLATIVE POSITIONAL EMBEDDINGS  

6 CONTEXT PROCESSING  

7 MISCELLANEOUS  

8 EVALUATION NECESSITY & OPTIMIZATION TOOLKIT  

9 DISCUSSION  

10 CONCLUSION