1 INTRODUCTION  
2 BACKGROUND  
2.1 Core Concepts of LLMs  
2.2 Evaluation Metrics for Efficiency  
3 BUDGET EFFICIENCY: SCALING LAWS  
4 DATA EFFICIENCY  
5 ARCHITECTURE EFFICIENCY  
6 TRAINING AND TUNING EFFICIENCY  
7 INFERENCE EFFICIENCY  
8 CONCLUSION