1 Introduction  
2 Notations and Preliminaries  
2.1 Graph Data Representation  
2.2 Graph Neural Networks  
2.3 Graph Machine Learning Tasks  
3 GNN Acceleration: Training Algorithms  
4 GNN Acceleration: Inference Algorithms  
5 GNN Acceleration: COTS Systems  
6 GNN Acceleration: Customized Hardware  
7 GNN Acceleration: Special Graphs and Special GNNs  
8 Future Directions  
9 Conclusion