1. Introduction

Keywords

2. Transformer

2.1 Encoder and decoder

2.2 Multi-head self-attention mechanism

2.3 Position encoding

2.4 Position-wise feed-forward networks

3. The Application of Transformer in Single-cell

4. Downstream task analysis

5. Challenges and Prospects

6. Conclusion