1 Introduction  
1.1 Domain of the survey  
1.2 Problem formulation and motivation of the survey  
1.3 Scope of the survey  
1.4 Our contributions  
1.5 Survey organization  
2 Related Works  
3 Towards distributed machine learning  
3.1 Machine learning and Deep learning  
3.2 Distributed machine learning  
4 Byzantine fault tolerance in distributed machine learning  
4.1 Fault tolerance in distributed machine learning  
4.2 Byzantine fault tolerance in first-order optimization methods  
4.3 BFT approaches in first-order optimization methods  
5 Discussion and future work  
5.1 Discussion  
5.2 Potential future direction  
6 Conclusion