1 Introduction

2 A Taxonomy for MoErging Methods  
2.1 Expert model design choices  
2.2 Routing design choices  
2.3 Application design choices  

3 A Survey of MoErging Methods  

4 Related Methods and Problem Settings  
4.1 Multitask Learning  
4.2 Mixture-of-Experts models  
4.3 Model Merging  
4.4 Federated Learning  

5 Common Applications and Tools for MoErging 

6 Takeaways and Open Problems