1 Introduction  
2 Taxonomy and Roadmap  
3 Knowledge and Capability Evaluation  
3.1 Question Answering  
3.2 Knowledge Completion  
3.3 Reasoning  
3.4 Tool Learning  
4 Alignment Evaluation  
4.1 Ethics and Morality  
4.2 Bias  
4.3 Toxicity  
4.4 Truthfulness  
5 Safety Evaluation  
5.1 Robustness Evaluation  
5.2 Risk Evaluation  
6 Specialized LLMs Evaluation  
6.1 Biology and Medicine  
6.2 Education  
6.3 Legislation  
6.4 Computer Science  
6.5 Finance  
7 Evaluation Organization  
7.1 Benchmarks for NLU and NLG  
7.2 Benchmarks for Knowledge and Reasoning  
7.3 Benchmarks for Holistic Evaluation  
8 Future Directions  
8.1 Risk Evaluation  
8.2 Agent Evaluation  
8.3 Dynamic Evaluation  
8.4 Enhancement-Oriented Evaluation for LLMs  
9 Conclusion