1 Introduction

1.1 Contribution and Structure

2 Related Work

3 Fundamentals: Power Grids, Graph Neural Networks and Reinforcement Learning

3.1 Power Grids

3.2 Graph Neural Networks

3.3 Reinforcement Learning

4 Graph Reinforcement Learning for Transmission Networks

4.1 RL Framework

4.2 Overall Approach and RL Algorithms

4.3 Graph Embeddings

4.4 Experiments and Evaluation

4.5 Discussion

5 Graph Reinforcement Learning for Distribution Grids

5.1 Voltage Control

5.2 Other Use Cases

5.3 Discussion

6 Other Applications

6.1 Energy Market

6.2 Power Communication Networks

6.3 Electric Vehicles Applications

7 Conclusion and Outlook